Nikhil Ghosh

Flatiron Institute

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Inference & Quantization (1)Training Efficiency & Optimization (1)

Frequent co-authors

Zeliang Zhang (1)Jiani Liu (1)Bin Yu (1)Xiaodong Liu (1)

Papers (1)

Apr 8, 2026

2w ago·also BAIR, Microsoft Research, Center for Computational Biology, Dept. of EECS +2

Does a Global Perspective Help Prune Sparse MoEs Elegantly?

MoEs can be pruned more effectively by considering cross-layer redundancy, leading to significant performance gains compared to uniform pruning strategies.

Zeliang Zhang, Nikhil Ghosh, Jiani Liu +2

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Training Efficiency & Optimization

Search

Nikhil Ghosh

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)