Latticethe structure behind the noise

Papers Digest Topics Selected Labs Collections FAQ

Created by Flynn Lachendro

Papers Digest Topics Labs Saved

Search

Search papers, labs, and topics across Lattice.

Built by Flynn Lachendro·𝕏 / Twitter·RSS··FAQ·Glossary·Privacy

Peijie Jiang | Lattice

Peijie Jiang

Papers on Lattice

1

Total citations

0

Topics

2

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Training Efficiency & Optimization (1)

Frequent co-authors

Yuqi Feng (1)Cunyin Peng (1)Jia Liu (1)Kunlong Chen (1)

Papers (1)

May 25, 2026

Peijie Jiang +63w ago

PowLU: An Activation Function for Stable Pre-Training of LLMs

Ditch SwiGLU's quadratic instability: PowLU offers a rational power function that stabilizes LLM pre-training without sacrificing performance.

Peijie Jiang, Yuqi Feng, Cunyin Peng +4

Architecture Design (Transformers, SSMs, MoE)Training Efficiency & Optimization

Zhiqiang Zhang (1)