Search papers, labs, and topics across Lattice.
This paper introduces PromptPath, an adaptive framework for in-context learning (ICL) that enhances task-specific adaptation by dynamically regulating computational pathways based on prompt information. Unlike traditional methods that rely on shallow task adaptation, PromptPath employs a prompt-driven routing mechanism to activate and compose low-rank experts, enabling models to tailor their computational processes for different tasks. Experimental results on 3D point cloud and 2D visual recognition benchmarks show that PromptPath not only outperforms existing ICL approaches but also demonstrates robust generalization across domains and tasks.
PromptPath transforms in-context learning by dynamically tailoring computational pathways, leading to superior performance and interpretability in diverse tasks.
In-context learning (ICL) has attracted increasing attention for enabling models to perform new tasks using only a few ``input--output'' prompt examples. However, existing approaches suffer from \textbf{shallow task adaptation}, where prompts are primarily used as contextual cues to implicitly infer task intent through semantic representations, while the underlying computational process remains unchanged. This limitation restricts task-specific adaptation and compromises inference interpretability. We argue that prompts should not only condition feature representations but also dynamically regulate the model's computation pathways. To this end, we propose \textbf{PromptPath}, an adaptive ICL framework that enables computation-level adaptation through prompt-conditioned dynamic pathways. Specifically, PromptPath introduces a prompt-driven routing mechanism to selectively activate and compose lightweight low-rank experts, forming task-specific computational pathways tailored to different prompts. By integrating prompt information directly into the inference process, PromptPath dynamically reconfigures model computation to enhance task specialization and interpretability. Extensive experiments on 3D point cloud and 2D visual recognition benchmarks demonstrate that PromptPath consistently outperforms state-of-the-art ICL baselines while exhibiting strong cross-domain and cross-task generalization.
