M. C. Rao

Papers on Lattice

Total citations

Topics

h-index

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Interpretability & Mechanistic Interp (1)Open-Source Models & Weights (1)

Frequent co-authors

Manoj Chandrashekar Rao (1)

Papers (1)

Apr 9, 2026

M. C. Rao +1Apr 9, 2026

Sensitivity-Positional Co-Localization in GQA Transformers

Forget intuition: task-sensitive layers in GQA transformers are actually *anti-localized* with RoPE-influential layers, but targeting the former with LoRA and RoPE adaptation still unlocks surprising performance gains.

M. C. Rao, Manoj Chandrashekar Rao

Architecture Design (Transformers, SSMs, MoE)Interpretability & Mechanistic Interp Open-Source Models & Weights

M. C. Rao

Research focus

Frequent co-authors

Papers (1)

Search

M. C. Rao

Research focus

Frequent co-authors

Papers (1)