Olatunji Ruwase

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Ahan Gupta (1)Zhihao Wang (1)Neel Dani (1)Masahiro Tanaka (1)

Papers (1)

Apr 29, 2026

Ahan Gupta +52d ago

AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism

Training LLMs on ultra-long contexts just got a whole lot easier: AutoSP automates sequence parallelism and activation checkpointing, boosting context length by up to 2.7x with negligible throughput cost.

Ahan Gupta, Zhihao Wang, Neel Dani +3

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Olatunji Ruwase

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)