Multimodal Models

MF-VPD reduces model parameters by nearly 77% while boosting performance in visual perception tasks, making it a game-changer for efficient AI applications.

Automatic music transcription models struggle with pop music, as evidenced by a mere 38% Onset F1 score on the new MulTTiPop dataset.

FreMo reveals that effective multi-modality transportation forecasting hinges on exploiting frequency-domain characteristics rather than traditional time-domain methods.

Achieving robust and unbiased unlearning in diffusion models is now possible with AutoAnchor, which enhances performance by over 30% without manual bias.

Directly analyzing policy videos can yield more effective training curricula than traditional text-based evaluations in multi-agent reinforcement learning.

ProsMAE outperforms traditional methods by leveraging diverse histopathology datasets to significantly improve ISUP grade classification accuracy.

Thinking chain entropy outperforms answer entropy in visual language models, revealing critical insights into their reasoning capabilities.

JEPA-style predictive learning can yield remarkably accurate network representations, achieving over 92% accuracy in classifying protocol families from partial data.

SAM-MT decouples latency from target count, enabling real-time video segmentation that rivals single-target performance even with multiple objects in view.

Event-based lip reading accuracy improves dramatically when leveraging viseme-aware temporal modeling, revealing the critical role of motion trajectories in distinguishing lip movements.

Low-rank adaptation in vision-language alignment not only cuts costs but also boosts performance, revealing a surprising shift from hallucination to conservatism in model behavior.

Fine-grained textual cues can dramatically improve face attack detection, revealing vulnerabilities in existing systems that rely solely on visual data.

UAV-OVVIS enables flexible target detection in UAV videos, outperforming traditional methods by allowing open-vocabulary queries for instance-level segmentation.

Canvas360 not only redefines panoramic generation with geometry-aware techniques but also delivers a dataset of 1 million samples that transforms how we approach in-context tasks.

Reward functions that generalize across environments can be learned more effectively by strategically leveraging heterogeneous feedback modalities, leading to substantial improvements in agent performance.

By leveraging outdated DEMs, this framework achieves real-time, high-fidelity 3D terrain reconstruction, transforming wildfire hazard assessments.

Achieving a 6.06% boost in semantic alignment while maintaining over 99% reconstruction fidelity, $S^2AE$ redefines how we approach concept consistency in vision-language models.

A novel AI-driven approach reveals that targeted facial stimuli can significantly enhance the detection of perceptual differences between autistic and neurotypical individuals.

Surpassing larger models, this agent achieves 91.4% retrieval accuracy in long-horizon multimodal dialogues by leveraging episodic memory for efficient context management.

An ensemble approach combining U-Net and a geospatial model can accurately predict viticulture potential, outperforming traditional assessment methods.

A single DNN model can dynamically adjust input resolution for LiDAR object detection, achieving superior performance and efficiency in real-time applications.

Language gradients can cripple discrete symbol systems in world models, but a novel architecture can restore grounding accuracy to 97.2% without LLM fine-tuning.

A unified benchmark that evaluates federated learning in medical imaging across multiple organs reveals critical gaps in existing assessments and emphasizes the need for efficiency and privacy metrics.

Cross-modal attention reduces Doppler synthesis error by 39%, revealing the hidden mechanical contributions to fetal cardiovascular dynamics.

Learning the generation order in multimodal tasks can boost performance by over 4%—a game changer for DLMs.

MoE architectures outperform dense models in quantization resilience, revealing that structure trumps size in on-device VLM performance.

Vision-language models struggle with safety-critical reasoning, but AUTOPILOT-VQA reveals their limitations in understanding real-world driving incidents.

VocaDet enables open-vocabulary object detection that evolves with user input, achieving high performance without retraining the model.

Sum-abs reduction in SHAP-weighted fusion not only preserves attribution mass but also enhances multimodal emotion recognition, nearly matching the performance of traditional early fusion methods.

Captions selected with VEGAS align significantly better with human attention, boosting retrieval performance and challenging the status quo of video captioning metrics.

VLMs may ace dish recognition but often falter in delivering safe dietary advice, revealing a critical gap in their practical application for health management.

WCog-VLA achieves a groundbreaking 92.9 PDMS score by merging world cognition with generative modeling, setting a new benchmark for proactive autonomous driving.

MobiDiff achieves a 5.3x speedup in generating synthetic mobility data while maintaining high fidelity to real-world patterns.

Closed-source AI models can outperform open-weight counterparts by 10% on seemingly simple tasks, revealing hidden vulnerabilities in multimodal systems.

A dual-system approach in aerial navigation can double success rates and cut decision delays by over 50%, revolutionizing how UAVs interpret language instructions in real-time.

A novel hybrid approach boosts rare-class instance segmentation performance by up to 9.5 AP points by intelligently combining T2I generation with context-aware I2I editing.

VLM-based agents often miss the mark by proposing experiments that fail to clarify their hypotheses, revealing a significant gap in their reasoning capabilities.

LEEVLA reveals that effectively guiding attention to task-critical evidence can dramatically enhance performance in vision-language-action tasks.

LingBot-VA 2.0 achieves few-shot generalization in complex robot manipulation tasks, outperforming traditional video generative models.

State-of-the-art performance in endoscopic referring segmentation is now achievable through a novel attribute retrieval approach, transforming how we interpret complex medical imagery.

Vision Transformers outperform CNNs in modeling human texture perception, revealing a fundamental shift in how we understand visual processing in AI.

Integrating geographical encoding with a robust data quality assessment reduces poverty prediction errors by nearly 19% in satellite imagery analysis.

Multimodal queries in UAV imagery can significantly reduce visual-query ambiguity and improve target localization across diverse scenarios.

Post-training techniques could be the key to overcoming the limitations of traditional imitation learning in autonomous driving, ensuring safer and more reliable vehicle behavior in complex environments.

Agents communicate more effectively when they are confident and early in the episode, challenging conventional wisdom about uncertainty-driven communication.

HSA achieves up to 41.5% improvement in scene decomposition accuracy by leveraging hierarchical semantic understanding with minimal labeled data.

SkelGen4D achieves high-quality text-driven mesh animation without the burden of extensive skeleton annotations, outperforming fully supervised models.

StatLUT achieves artifact-free photorealistic style transfer by decoupling color and structure, outperforming state-of-the-art methods in visual fidelity.

The Temporal Ratio reveals how attention shifts between future and present frames can predict a model's ability to generalize compositional tasks in video-action contexts.

LUMI revolutionizes lossless image compression by decoupling it from tokenizer behavior, achieving superior performance with a unified approach across different LLM architectures.