Search papers, labs, and topics across Lattice.
3
0
1
18
FairInference provides the novelelta-token fairness guarantee: for a well-behaved client, if a token is generated in d time units in isolation, it will be generated within d + {\delta} time units in multi-tenant execution, providing strong latency isolation guarantees for LLM serving.
Sintr safeguards BFT systems against Byzantine clients, ensuring database integrity with minimal performance trade-offs.
Understanding the replication factor trade-offs in Fast BFT SMR could redefine performance benchmarks for fault-tolerant distributed systems.