Search papers, labs, and topics across Lattice.
This paper synthesizes the fragmented literature on post-training adaptation techniques in machine learning, proposing a six-dimensional taxonomy that organizes methods by mechanism, goal, data requirement, persistence, structural scope, and model type. By clarifying distinctions between commonly conflated terms and mapping relationships among adaptation strategies, the authors provide a comprehensive framework that enhances understanding and comparison across various model classes and deployment contexts. Key findings highlight the evolution of adaptation techniques from traditional machine learning to multimodal large language models, while also addressing critical challenges in evaluation and governance.
A unified taxonomy reveals the intricate relationships among post-training adaptation techniques, illuminating how they evolve and interact across diverse AI models.
Post-training adaptation has become central to modern machine learning practice and includes techniques such as retraining, fine-tuning, parameter-efficient adaptation, alignment, retrieval augmentation, model editing, unlearning, calibration, and Multimodal Instruction Tuning. However, the literature remains fragmented across technique families, model classes, and deployment contexts, making it difficult to compare methods or describe how a trained model has been modified. This survey synthesizes the post-training adaptation literature and introduces a six-dimensional taxonomy organized by mechanism, goal, data requirement, persistence, structural scope, and model type. The taxonomy distinguishes commonly conflated terms such as fine-tuning, retrieval augmentation, and prompting, and shows how adaptation strategies evolve from traditional machine learning through deep learning, foundation models, large language models, and multimodal large language models. It also maps relationships among techniques, including inheritance, supersession, hybridization, and layered deployment stacks. The resulting vocabulary can support technical documentation, model-change tracking, and governance analysis. The survey concludes by identifying open challenges in evaluation, reproducibility, persistent inference-time adaptation, unlearning, multimodal adaptation, and governance-aware post-training workflows.
