Latticethe structure behind the noise

Papers Digest Topics Selected Labs Collections FAQ

Created by Flynn Lachendro

Papers Digest Topics Labs Saved

Search

Search papers, labs, and topics across Lattice.

Built by Flynn Lachendro·𝕏 / Twitter·RSS··FAQ·Glossary·Privacy

Tianhao Chen | Lattice

Tianhao Chen

Papers on Lattice

1

Total citations

0

Topics

4

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Natural Language Processing (1)Scaling Laws & Emergent Abilities (1)Training Efficiency & Optimization (1)

Frequent co-authors

Tianhao Chen (1)Xin Xu (1)Xin Xu (1)Lu Yin (1)

Papers (1)

Mar 5, 2026

6d ago·also School of Mechanical Engineering

Progressive Residual Warmup for Language Model Pretraining

By strategically warming up residual connections layer-by-layer, ProRes unlocks faster and more stable pretraining for language models.

Tianhao Chen, Tianhao Chen, Xin Xu +11

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Scaling Laws & Emergent Abilities+1

Lu Yin (1)