Search papers, labs, and topics across Lattice.
Pluralis Research
2
0
4
Training billion-parameter Transformers can be stabilized by controlling curvature through a novel architecture warm-up strategy, leading to smoother convergence and fewer instabilities.
Training LLMs across 176 untrusted workers is now possible without computation duplication, thanks to a new verification mechanism that detects corrupted inter-stage communication in pipeline parallelism.