Deepon Halder

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Natural Language Processing (2)Data Curation & Synthetic Data (1)Open-Source Models & Weights (1)Architecture Design (Transformers, SSMs, MoE) (1)

Frequent co-authors

Angira Mukherjee (1)Raj Dabre (1)

Papers (2)

Mar 15, 2026

Deepon Halder +12d ago

Multilingual TinyStories: A Synthetic Combinatorial Corpus of Indic Children's Stories for Training Small Language Models

Training SLMs for low-resource Indic languages just got easier: a new synthetic dataset of children's stories offers a large, localized, and simple corpus.

Deepon Halder, Angira Mukherjee

Data Curation & Synthetic Data Natural Language Processing Open-Source Models & Weights

Deepon Halder +12d ago

Top-b: Entropic Regulation of Relative Probability Bands in Autoregressive Language Processes

By dynamically adjusting the candidate set size based on Shannon entropy, Top-b offers a more nuanced approach to decoding that balances exploration and exploitation, outperforming static truncation methods.

Deepon Halder, Raj Dabre

Architecture Design (Transformers, SSMs, MoE)Natural Language Processing Reasoning & Chain-of-Thought

Search

Deepon Halder

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (2)