Evaluating large language models on business process modeling: framework, benchmark, and self-improvement analysis

A comprehensive benchmark is designed, consisting of 20 diverse business processes, and the evaluation approach is used to investigate LLM self-improvement techniques, encompassing self-evaluation, input optimization, and output optimization, indicating that output optimization offers promising potential for enhancing quality.