Fu Feng

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Scaling Laws & Emergent Abilities (1)Training Efficiency & Optimization (1)

Frequent co-authors

Fu Feng (1)Yucheng Xie (1)Ruixiao Shi (1)Ruixiao Shi (1)

Papers (1)

Apr 16, 2026

Fu Feng +5Apr 16, 2026

Constraint-based Pre-training: From Structured Constraints to Scalable Model Initialization

Stop retraining from scratch: WeiT lets you initialize models of *any* size with SOTA performance, adapting pre-trained knowledge to your specific compute budget.

Fu Feng, Fu Feng, Yucheng Xie +3

Architecture Design (Transformers, SSMs, MoE)Scaling Laws & Emergent Abilities Training Efficiency & Optimization

Search

Fu Feng

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)