Search papers, labs, and topics across Lattice.
This paper introduces ShikumiMiner, a static-analysis framework that utilizes Abstract Syntax Tree (AST) and Control Flow Graph (CFG) features to identify and compare recurring implementation patterns in C++ local LLM codebases. By analyzing ten open-source GitHub repositories, the authors classify functions into seven distinct categories using a multi-label Random Forest model. The findings reveal significant patterns that can inform developers in the design and optimization of LLM applications, enhancing their understanding of existing code structures.
Uncovering recurring implementation patterns in LLM codebases could revolutionize how developers approach building and optimizing AI applications.
Large language models are paving the way towards innovation by understanding, analyzing, summarizing and generating content in the modern world. Currently there are thousands of LLM projects developed by engineers in open-source repositories. However, whether these LLM projects have underlying patterns or not remains a question. Exploring these underlying patterns will give new dimensions to the developers who aim to develop these LLM projects. In this paper, we propose ShikumiMiner, a static-analysis framework that combines Abstract Syntax Tree (AST) and Control Flow Graph (CFG) features to detect and compare recurring implementation patterns in C++ local LLM codebases. We analyze ten GitHub open-source repositories and classify functions into seven study-specific categories using a multi-label Random Forest model. Studying these patterns can provide useful insights for developers aiming to design LLM applications.
