Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a framework called Generation Networks, which employs graphical probabilistic models to document generative flows and articulate properties of LLM-native software systems. By addressing the stochastic and prompt-dependent behavior of large language models, the authors aim to establish a more rigorous approach to LLM-native development that parallels traditional software engineering practices. The key result is a structured methodology that enhances design-level reasoning and analysis in the context of LLM-based software, potentially transforming how developers approach system behavior and interactions.
A new framework for LLM-native software could revolutionize how we document and reason about generative flows, bridging the gap between traditional engineering and AI.
Engineering LLM-native software remains a challenging and immature field. Current practice is largely exploratory, relying on experimentation and heuristic techniques such as prompting and context engineering. These, however, are low-level and lack the principled structure needed to support design-level reasoning or analysis. In contrast, traditional software engineering leverages modularity and abstraction to communicate and analyze system behavior. To bring similar rigor to LLM-native development, we propose methods for documenting generative flows and for stating properties of LLM-based software designs. Such methods must account for the stochastic, prompt-dependent behavior of large language models while remaining expressive enough to capture emergent phenomena. Our initial approach is based on graphical probabilistic models, tailored to capture phenomena characteristic of LLM-native systems. This framework -- what we term Generation Networks -- aims to provide a foundation for principled reasoning about generative interactions and system-level properties in LLM-centric software architectures.