Search papers, labs, and topics across Lattice.
1
0
3
Compound AI systems can achieve nearly 4x throughput improvement and cut tail latency in half with a modular, autoscaling inference architecture.
