Search papers, labs, and topics across Lattice.
Microsoft Research
UWAnt GroupCornellFudanHarvardHUSTMistralNortheasternRoboraction.aiTulane UniversityDec 22, 2025arXiv:2512.22208The paper introduces Moxin 7B, a fully open-source LLM developed with complete transparency in training, datasets, and implementation details. To extend Moxin's capabilities, the authors developed three variants: Moxin-VLM (vision-language), Moxin-VLA (vision-language-action), and Moxin-Chinese. Experiments demonstrate that these models achieve strong performance in their respective domains, leveraging open-source frameworks and data.
Moxin 7B and its variants (VLM, VLA, Chinese) offer a new suite of fully transparent, open-source multimodal models, pushing beyond simple weight sharing to enable deeper customization and collaborative research.
Recently, Large Language Models (LLMs) have undergone a significant transformation, marked by a rapid rise in both their popularity and capabilities. Leading this evolution are proprietary LLMs like GPT-4 and GPT-o1, which have captured widespread attention in the AI community due to their remarkable performance and versatility. Simultaneously, open-source LLMs, such as LLaMA and Mistral, have made great contributions to the ever-increasing popularity of LLMs due to the ease to customize and deploy the models across diverse applications. Moxin 7B is introduced as a fully open-source LLM developed in accordance with the Model Openness Framework, which moves beyond the simple sharing of model weights to embrace complete transparency in training, datasets, and implementation detail, thus fostering a more inclusive and collaborative research environment that can sustain a healthy open-source ecosystem. To further equip Moxin with various capabilities in different tasks, we develop three variants based on Moxin, including Moxin-VLM, Moxin-VLA, and Moxin-Chinese, which target the vision-language, vision-language-action, and Chinese capabilities, respectively. Experiments show that our models achieve superior performance in various evaluations. We adopt open-source framework and open data for the training. We release our models, along with the available data and code to derive these models.
