Search papers, labs, and topics across Lattice.
This paper introduces LLM4OSC, a novel architecture that leverages large language models (LLMs) for generating Open Sound Control (OSC) commands while ensuring high reliability through deterministic validation. By employing a structured intent JSON format and a human-reviewed device profile, the system achieves 100% semantic accuracy and eliminates wrong-send errors in critical performance contexts. The research highlights the importance of propose-validate-send as a framework for enhancing the safety and effectiveness of language-to-control systems in professional audio environments.
Achieving 100% semantic accuracy in OSC command generation while eliminating wrong-send errors could redefine reliability standards in live performance technology.
Open Sound Control (OSC) is the dominant wire protocol for real-time parametric control in professional audio, live performance, and virtual production. Large language models can emit plausible OSC, but they hallucinate addresses, mishandle type tags, and fail under paraphrase- unacceptable in show-critical contexts. We present LLM4OSC, a local-first architecture in which models propose structured intent JSON over a human-reviewed device profile, and deterministic code validates, clamps, and encodes before any UDP send. We introduce a frozen evaluation harness with CI gates on wrong-send rate: mismatches that would still pass validation and transmit. On a Max/MSP hero profile (12 patterns; 8 literal + 8 paraphrase + 4 refusal cases), after profile tag enrichment, symbolic slot fill, NL refine, and a retrieval confidence gate, backends B0--B3 all pass frozen gates (100% semantic accuracy, 0% wrong-send). B0 (rules) remains the production default at ~0.05ms; LLM backends remain ~3-4s. Historical few-shot B2 accuracy of 62.5% rises to 100% on this suite only after symbolic post-processing- not because the 0.5B model alone becomes show-safe. We argue for propose-validate-send and wrong-send rate as first-class metrics for language-to-control systems.
