Search papers, labs, and topics across Lattice.
University of Science and Technology of China
2
0
3
LUMEN slashes recovery times in distributed LLM serving by intelligently coordinating load-aware recovery strategies during worker failures.
RDMA failover can be made significantly more efficient and correct by selectively retransmitting only the requests that were actually lost during a link failure, avoiding redundant retransmissions and semantic violations.