Search papers, labs, and topics across Lattice.
Affiliation:
3
0
4
8
MISA-T boosts rollout throughput by over 53% while preserving workload integrity, revolutionizing how RL pipelines manage heterogeneous demands.
TensorCast reveals that decoupling tensor management from computation can boost performance by over 90% in multi-turn interactions, challenging the status quo of LLM infrastructure.
Rethinking GPU reliability, this study shows that ranking nodes by failure risk can outperform traditional predictive maintenance methods, capturing 64% of failures in the top 5% of at-risk GPUs.
