Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a framework using GPT-4 to automatically generate Finite State Machines (FSMs) from natural language requirements, addressing the critical role of FSM quality in model-driven engineering. The framework incorporates an expert-centric approach using FSM mutation and test generation to repair LLM-generated FSMs. Experiments with simulated data evaluate GPT-4's ability to perform the tasks within the framework and assess the effectiveness of different FSM repair methods.
GPT-4 can automatically generate FSMs from natural language requirements, but expert-guided repair via mutation and testing is crucial for ensuring FSM quality.
Finite state machines (FSM) are executable formal specifications of reactive systems. These machines are designed based on systems'requirements. The requirements are often recorded in textual documents written in natural languages. FSMs play a crucial role in different phases of the model-driven system engineering (MDE). For example, they serve to automate testing activities. FSM quality is critical: the lower the quality of FSM, the higher the number of faults surviving the testing phase and the higher the risk of failure of the systems in production, which could lead to catastrophic scenarios. Therefore, this paper leverages recent advances in the domain of LLM to propose an LLM-based framework for designing FSMs from requirements. The framework also suggests an expert-centric approach based on FSM mutation and test generation for repairing the FSMs produced by LLMs. This paper also provides an experimental analysis and evaluation of LLM's capacities in performing the tasks presented in the framework and FSM repair via various methods. The paper presents experimental results with simulated data. These results and methods bring a new analysis and vision of LLMs that are useful for further development of machine learning technology and its applications to MDE.