Search papers, labs, and topics across Lattice.
The authors formulate "compile by training," a framework that converts natural-language task specifications into standalone, locally executable neural functions to eliminate repeated frontier API costs, latency, and provider dependency. By leveraging teacher models to synthesize task-specific data and train lightweight adapters for a compact interpreter, the framework transforms fuzzy text operations into versionable, composable software artifacts. On FuzzyBench-Hard, where fast weight-generating compilers yield 0% exact matches, compile-by-training achieves 83.6% semantic accuracy with compilation latencies of roughly one minute.
Recurring frontier API calls can be replaced by one-minute compile-time distillation, turning plain-text prompts into local, versionable neural functions that achieve 83.6% accuracy on benchmarks where instantaneous compilers fail entirely.
Many recurring text functions are easy to describe but difficult to implement with rules, while calling a large remote model for every input introduces repeated cost, latency, and dependency on a provider. We present compile by training, which turns a natural-language specification into a reusable neural function. At compile time, teacher models generate task-specific examples that are used to train a small adapter for a compact interpreter. The resulting function runs without the teachers and can be stored, versioned, and composed like ordinary software. On FuzzyBench-Hard, a subset on which the Program-as-Weights fast compiler produced no exact matches, compile by training reaches 83.6% semantic accuracy. This higher accuracy comes with a higher compile-time cost: roughly a minute rather than seconds for the fast compiler. We deploy the compiler in a public interactive service and demonstrate compiled functions in a multi-site website helper, a language-controlled 3D avatar, and a bidirectional English-Claudish translator.
