Ivan Kobyzev

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)Training Efficiency & Optimization (1)

Frequent co-authors

Abbas Ghaddar (1)Boxing Chen (1)Yufei Cui (1)

Papers (1)

Apr 7, 2026

Abbas Ghaddar +3Apr 7, 2026·also Mila, McGill

BOSCH: Black-Box Binary Optimization for Short-Context Attention-Head Selection in LLMs

Static rankings of attention heads for local/global behavior become unreliable after hybridizing attention mechanisms in LLMs, necessitating adaptive selection methods like BOSCH.

Abbas Ghaddar, Ivan Kobyzev, Boxing Chen +1

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Training Efficiency & Optimization

Search

Ivan Kobyzev

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)