Cosmo Santoni

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (2)Inference & Quantization (2)Open-Source Models & Weights (1)Tool Use & Agents (1)

Frequent co-authors

C. Santoni (1)

Papers (2)

Mar 10, 2026

C. Santoni +16d ago

Compiler-First State Space Duality and Portable $O(1)$ Autoregressive Caching for Inference

Mamba-2's efficiency doesn't require custom CUDA kernels: XLA's compiler optimizations are enough to unlock near-optimal performance across diverse hardware.

C. Santoni, Cosmo Santoni

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Open-Source Models & Weights

Feb 25, 2026

Cosmo Santoni2w ago

Contextual Memory Virtualisation: DAG-Based State Management and Structurally Lossless Trimming for LLM Agents

LLMs can retain more context and history without blowing your token budget using a DAG-based memory system and lossless trimming that cuts context length by up to 86%.

Cosmo Santoni

Architecture Design (Transformers, SSMs, MoE)Inference & Quantization Tool Use & Agents

Search

Cosmo Santoni

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (2)