Jinwoong Kim

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Natural Language Processing (1)Training Efficiency & Optimization (1)

Frequent co-authors

Sangjin Park (1)

Papers (1)

Mar 3, 2026

Jinwoong Kim +11w ago

MaBERT:A Padding Safe Interleaved Transformer Mamba Hybrid Encoder for Efficient Extended Context Masked Language Modeling

By interleaving Transformers and Mamba, MaBERT achieves a 2x speedup in training and inference for long-context masked language modeling, without sacrificing GLUE benchmark performance.

Jinwoong Kim, Sangjin Park

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Training Efficiency & Optimization

Search

Jinwoong Kim

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)