Yinqi Yang

Baidu Inc

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)

Frequent co-authors

Yao Chen (1)Junyuan Shang (1)Xiangzhao Hao (1)Simeng Zhang (1)

Papers (1)

Jun 16, 2026

3w ago·also Baidu

ConSA: Controllable Sparsity in Hybrid Attention via Learnable Allocation

Learned attention allocation patterns reveal that SWA is best positioned in lower layers, challenging conventional wisdom on attention distribution in LLMs.

Yao Chen, Yinqi Yang, Junyuan Shang +6

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization

Search

Yinqi Yang

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)