Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a cascaded Low-Rank Adaptation (LoRA)-based framework for multimodal fusion aimed at enhancing action recognition in medical training environments. By employing a sequential integration approach, the architecture allows for efficient adaptation of modality-specific components without the need for retraining, thus facilitating scalable integration of heterogeneous data. Experimental results on the NurViD and Nurse Training datasets demonstrate that this method outperforms individual modality models and achieves competitive results compared to existing dataset-specific baselines.
Cascaded LoRA-based fusion outperforms traditional models in recognizing actions in complex medical training environments without extensive retraining.
This paper presents a cascaded Low-Rank Adaptation (LoRA)-based multimodal fusion framework for action and activity recognition in healthcare-oriented training environments. The proposed architecture combines parameter-efficient modality-specific adaptation with sequential fusion, enabling modalities to be integrated in stages without retraining previously learned components. Rather than assuming a fixed fusion structure, the framework first integrates more closely related modalities and then incorporates additional heterogeneous modalities, supporting scalable adaptation across datasets with different modality sets.We evaluate the framework on two healthcare-oriented training environment datasets: NurViD and the Nurse Training dataset. Across these datasets, preliminary results suggest that the proposed cascaded fusion strategy improves over individual modality models and provides competitive performance relative to previously reported dataset-specific baselines. Overall, these findings indicate that cascaded LoRA-based fusion is a promising parameter-efficient approach for integrating heterogeneous modalities in medical training action and activity recognition tasks. github: https://github.com/anonymous0-ai/LoRA-Based-Cascaded-Multimodal-Fusion-.git.