Shahar Somin

Bar-Ilan University Ramat

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)Natural Language Processing (1)

Frequent co-authors

Yaniv Livertovsky (1)Gonen Singer (1)

Papers (1)

Jun 17, 2026

3w ago

Complementary Attention Head Pruning for Efficient Transformers

CAHP reveals that pruning attention heads through a graph-theoretical approach can enhance model efficiency without sacrificing performance, outperforming traditional methods in high-compression settings.

Yaniv Livertovsky, Shahar Somin, Gonen Singer

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Natural Language Processing

Search

Shahar Somin

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)