Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
JTON, a strict JSON superset, is introduced to reduce token usage when LLMs process structured data by factoring out column headers into a single row (Zen Grid) and encoding values with semicolons. Experiments across seven real-world domains demonstrate a 15-60% token reduction compared to compact JSON, with a slight accuracy improvement (+0.3 pp) in comprehension tests across 10 LLMs and 100% syntactic validity in generation tests across 12 LLMs. A Rust/PyO3 implementation further provides SIMD-accelerated parsing at 1.4x the speed of Python's json module.
Slash your LLM token costs by up to 60% when processing structured data with JTON's Zen Grid encoding, which also nudges accuracy up slightly.
When LLMs process structured data, the serialization format directly affects cost and context utilization. Standard JSON wastes tokens repeating key names in every row of a tabular array--overhead that scales linearly with row count. This paper presents JTON (JSON Tabular Object Notation), a strict JSON superset whose main idea, Zen Grid, factors column headers into a single row and encodes values with semicolons, preserving JSON's type system while cutting redundancy. Across seven real-world domains, Zen Grid reduces token counts by 15-60% versus JSON compact (28.5% average; 32% with bare_strings). Comprehension tests on 10 LLMs show a net +0.3 pp accuracy gain over JSON: four models improve, three hold steady, and three dip slightly. Generation tests on 12 LLMs yield 100% syntactic validity in both few-shot and zero-shot settings. A Rust/PyO3 reference implementation adds SIMD-accelerated parsing at 1.4x the speed of Python's json module. Code, a 683-vector test suite, and all experimental data are publicly available.