Sayantan Dasgupta

Xsim achieves less than 5% error in predicting training times for heterogeneous AI systems, revolutionizing how we simulate and optimize distributed LLM training.

Distilling language models just got more efficient: a new loss function focuses on the long tail of token probabilities, boosting performance without extra compute.