Zhanming Shen

Affiliation:

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Distributed Systems & Hardware (1)RLHF & Preference Learning (1)

Frequent co-authors

Tianqi Xu (1)Lu Lv (1)Haoyang Huang (1)Wenjie Huang (1)

Papers (1)

Aug 24, 2026

Tianqi Xu +173d ago·also Affiliation:, Baidu, UK

TailSieve: Partial-Rollout-Guided Tail Routing for LLM Rollouts

TailSieve achieves up to 2.59x speedup in LLM rollouts by intelligently routing long-tail requests, transforming how we handle high-concurrency decoding.

Tianqi Xu, Lu Lv, Haoyang Huang +15

Distributed Systems & Hardware RLHF & Preference Learning

Search

Zhanming Shen

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)