Yuyang Wu

Independent Researcher

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)Scaling Laws & Emergent Abilities (1)

Frequent co-authors

Yufeng Du (1)Hao Peng (1)

Papers (1)

Sep 30, 2026

Independent Researcher2w ago·also UIUC

RoPE at the End of Its Rope? Theory, Diagnosis, and Mitigation of Long-Context Failures

A theoretical framework and diagnostic tool reveal that RoPE's long-context failures stem from a quantifiable semantic-positional tradeoff, with reasoning tasks suffering semantic reversal and retrieval tasks positional insensitivity.

Yuyang Wu, Yufeng Du, Hao Peng

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Scaling Laws & Emergent Abilities

Yuyang Wu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)

Search

Yuyang Wu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)