Computer Vision - Weekly Roundup

Interactive video generation can be sped up by 1.4x by intelligently caching transformer residuals based on detected control transitions, without sacrificing quality.

A single image can now yield complete, high-fidelity 3D scenes, indoors and out, by adapting object-centric priors with adaptive chunking and explicit 2D-3D correspondence.

Inserted objects can now be made "alive" and interact realistically within videos, solving a long-standing challenge in video editing.

Diffusion models reveal feature generation order quantitatively, exposing architectural differences and suggesting ordered training benefits.

Deterministic dermoscopic preprocessing actually degrades performance in leakage-controlled evaluations, suggesting current automated analysis might be over-engineering for minimal gains.

Interactive video generation can be sped up by 1.4x by intelligently caching transformer residuals based on detected control transitions, without sacrificing quality.

A single image can now yield complete, high-fidelity 3D scenes, indoors and out, by adapting object-centric priors with adaptive chunking and explicit 2D-3D correspondence.

Inserted objects can now be made "alive" and interact realistically within videos, solving a long-standing challenge in video editing.

Diffusion models reveal feature generation order quantitatively, exposing architectural differences and suggesting ordered training benefits.

Deterministic dermoscopic preprocessing actually degrades performance in leakage-controlled evaluations, suggesting current automated analysis might be over-engineering for minimal gains.

Rare event probabilities in diffusion models can now be estimated orders of magnitude faster, unlocking their use in high-stakes scientific simulation.

The geometric intuition behind SVD is revealed as the direct algorithmic engine driving PCA, kernel methods, and PageRank, unifying their proofs and implementations.

Edge CNN adaptation can now achieve near-zero activation memory overhead by decoupling backward computations from full-width layer inputs.

A novel ResNet-BiLSTM model achieves 85.78% F1 for multi-label perceptual bug detection in video games, proving temporal modeling is key for identifying diverse visual glitches.

Privacy-preserving federated learning achieves segmentation performance on skin lesions comparable to centralized methods, without centralizing sensitive patient data.

Unfrozen video-language models implicitly know when they've seen enough evidence, a signal that can be extracted and used to boost answer accuracy by nearly 10% without retraining.

Multimodal geometric scores are surprisingly sensitive to the *direction* of modality degradation, not just its magnitude, revealing a critical geometric dependency previously overlooked.

Pinpoint the exact birth-death plane regions driving topological data differences with guaranteed error control, moving beyond global statistical tests.

Interactive AI worlds can now speak and react in real-time with spatially accurate sound, bridging the sensory gap in generative environments.

A 48.9M parameter robot policy matches systems 163x larger by prioritizing fine-grained, compressed visual representations over scale or generative priors.

Latent-based diffusion model watermarking is fundamentally brittle to geometric distortions, with a theoretically derived perturbation bound explaining its limited robustness.

Satellite images are not $n^2$ independent samples; their effective sample size plummets to $\Theta(n^2/r^2)$ due to spatial correlation, fundamentally altering generalization analysis.

End-to-end driving models can learn interpretable safety costs over reachable futures, drastically reducing collisions without fine-tuning.

Existing autoregressive post-training weights, often discarded after diffusion model conversion, can be directly applied to significantly boost dLLM performance, even outperforming dedicated diffusion post-training when combined.

Generative flow matching directly refines 4D hand-object interactions during synthesis, integrating physical constraints and 2D evidence without post-hoc optimization.

Robot world models can now predict photorealistic RGB *and* accurate metric depth, bridging the gap between visually plausible rollouts and geometrically consistent 3D environments.

Automated code generation from 3DGS papers not

Data-free diffusion distillation now achieves FID 2.04 at 1-NFE by unifying generation and score estimation in a single student network.

Generating molecular graphs in a pretrained VAE's latent space via flow matching unlocks significant efficiency gains and enables property-guided generation without retraining.

A novel initialization technique for diffusion samplers bypasses initial steps by directly sampling a softened clean-space posterior, achieving order-of-magnitude gains on rare-mode inverse problems.

LLM interrogations reveal diffusion model's internal tokens capture scene semantics surprisingly early, even without explicit prompts, and correlate with generation quality.

Causal representation learning now achieves block disentanglement under weaker intervention assumptions, directly enabling label-free visual state estimation in embodied agents.

Hierarchical JEPAs unlock efficient long-horizon visual planning by learning distinct latent spaces for different temporal scales, dramatically boosting success rates and reducing compute.

Aligning DLM generation with reference distributions via feature-space MMD significantly boosts performance on perplexity and reasoning tasks without retraining the entire model.

Bosonic Gaussian states can be identified with unprecedented accuracy using a novel warm-start strategy combined with non-Gaussian measurements, outperforming classical Gaussian estimation.

Learned corner selection for cooperative guards dramatically boosts deployment efficiency and agent utilization in partially observable environments, outperforming established methods without sacrificing formal guarantees.

Local AI models now predict user well-being from passive computer activity, offering explainable feedback directly within a workplace sensing application.

Deterministic weather foundation models can be efficiently transformed into powerful probabilistic forecasters, generating skillful 15-day forecasts in minutes.

Nighttime anomaly detection is significantly enhanced by fusing M-band and DNB satellite signals, achieving higher accuracy and broader applicability than thermal-only methods.

Explicitly modeling the temporal rate of change in spatio-temporal graph models unlocks superior prediction accuracy and pattern preservation for propagating phenomena.

Physics-based secure key distribution can now sustainably support federated learning for medical imaging, reducing key material needs by 35x without sacrificing accuracy.

Most reported gains in crop disease classification from environmental sensors are illusory, driven by simple session memorization rather than genuine multimodal learning.

Unreported sinkhole locations are effectively treated as right-censored, unlocking continuous, time-aware susceptibility predictions from multimodal data.

Wi-Fi sensing accuracy jumps to 92.83% by decomposing CSI into trajectory-guided tokens that capture complex temporal dynamics.

Generative image editing sliders now offer a smooth, predictable perceptual journey, eliminating jarring jumps and imperceptible stretches.

Flowcharts break silently across aspect ratios, but a new agentic pipeline with VLM critics now guarantees connectivity and editability.

Robots can now learn complex manipulation tasks from a single demonstration video by recursively accessing fine-grained sub-event details, boosting success rates by up to 9%.

Generative models are becoming so good at mimicking real images that content alone is no longer a reliable indicator of authenticity, necessitating a shift to reconstruction-based verification.

NeuroCBIR achieves near-perfect subject re-identification in 3D brain MRIs and encodes clinically relevant information for downstream tasks, all within seconds per scan.

Individual token selection and metadata caching unlock sparse attention for diffusion transformers without sacrificing generation quality, achieving up to $2.32\times$ speedups.

Most generative image models fail to produce usable automotive instructional imagery, with only two Google-based generators achieving >14% usable outputs, underscoring the critical role of the image generator over prompt engineering.

Simulation-based motion priors can be effectively distilled into real-world robot video generation, overcoming appearance gaps and boosting downstream policy performance.

Unknown traffic objects are detected with 2.6% higher recall than RT-DETR by fusing semantic and visual prompts symmetrically, enabling real-time open-world detection without NMS.

Folding multi-branch redundancy slashes speculative decoding costs in diffusion LLMs, unlocking up to 2x faster generation.

Directly learning robot action policies from raw video without explicit action labels unlocks scalable world action models.

Autoregressive video models can now perform explicit, goal-directed reasoning by jointly predicting the final outcome and intermediate steps, achieving state-of-the-art performance with 75% fewer training steps.

Current omnimodal video embeddings struggle with physical reasoning, yet specific physics can be recovered and leveraged to significantly improve the physical fidelity of generated videos.

Composing aesthetic preference with explicit rubric rewards unlocks substantial gains in text-to-image generation, outperforming existing open-source models by a significant margin.

State-of-the-art text-to-image models, despite photorealism, still exhibit pervasive world-consistency failures that existing metrics miss.

Generative 3D reconstruction now scales from objects to cityscapes with arbitrary resolution, matching per-scene optimization quality without per-scene tuning.

Imperfect diffusion models can now achieve exact target distribution sampling at inference time by correcting inherent path and endpoint errors.

Persistent world models can now track objects even when they leave the agent's view, thanks to a novel actor-observer decoupling mechanism.

Real-time 3D Gaussian avatar animation is now achievable at 60fps on mobile by distilling complex neural inference into a linear blendshape approximation, reducing CPU cost by 1000x.

Explicitly disentangling and structuring spatial geometry latents via CR-GEO and routed optimization unlocks significantly more effective 3D reasoning from 2D images, pushing SPAR-Bench and SPBench performance to new heights.

Adversarial distillation achieves state-of-the-art few-step visual generation by learning log-density ratios directly via classification, eliminating the need for auxiliary score fitting.

Standard UAD evaluations for brain MRI are brittle, with a single axis-order mismatch capable of collapsing voxel AUROC from 0.873 to 0.583, while slice-level AUROC remains largely unaffected.

Achieve precise, intuitive 3D control over video generation by moving rigid object meshes, eliminating depth ambiguity and viewpoint inconsistencies.

Dynamically recomputing embeddings at each denoising step in diffusion transformers halves training compute while achieving state-of-the-art FID scores.

Topology-preserving 3D generation now achieves 98% fewer tokens and 58.5% faster inference by encoding shapes as overlapping slice latents instead of expensive voxels.

Multimodal sampling with Wasserstein gradient flows and forward diffusion is fundamentally limited by slow mixing, requiring exponential time to bridge well-separated modes.

A single CatBoost model detects wildfires 26 times earlier than GOES FDC and VIIRS, and achieves significantly higher F1 scores, even at night.

Adversarial domain adaptation that explicitly conditions on predicted weather unlocks robust street-view perception even with non-street-view training data.

Malware analysis just got a new tool: S4 models unlock long-range dependency detection in execution flows, outperforming traditional deep learning for multi-class classification.

A novel Four-Dimensional Architecture Selection Framework correctly recommends 70% of deployed autonomous driving architectures, offering critical guidance for system design.

Adversarial training on Fourier phase perturbations unlocks over 20% domain generalization gains in medical imaging by decoupling spatial structure from domain-specific textures.

Discrete neural samplers achieve fixed-point convergence and drastically reduce mode collapse by leveraging Gibbs sampling within a masked diffusion framework.

Diffusion models can achieve fairness and diversity simultaneously without sensitive attribute labels by using a frozen model adapter and a vision-language embedding space.

Geographic context unlocks precise PCS anomaly detection, revealing infrastructure health issues previously missed by purely visual methods.

Artists can now directly sculpt 3D object motion relative to a moving camera, overcoming the inherent ambiguity of 2D controls in video generation.

Most video generation models fail to render text accurately, with even top performers exhibiting a 25% word error rate on a new benchmark designed for this critical oversight.

Current egocentric video generation models fail to execute multi-step manipulation tasks realistically, often skipping crucial actions and exhibiting poor physical dynamics.

Transformer and RNN tractography models achieve state-of-the-art performance by introducing a novel generation-validation phase for streamline-level supervision, overcoming the limitations of local loss functions.

End-to-end learning of temporally predictable latent spaces for world models unlocks superior future scene understanding without the need for separate representation and prediction training stages.

Human mobility generation can now be achieved without target trajectories by learning relative movement transitions, not absolute destinations, across cities.

Diffusion models can lose diversity when only later timesteps are updated during reward optimization, a finding that challenges prior assumptions and motivates a new training paradigm.

A data-driven weather model now rivals operational NWP for 1 km resolution forecasts over complex Alpine terrain, but struggles with localized wind extremes.

Diffusion models can plan collision-free, multi-agent trajectories without any training data by leveraging analytical local scores derived from geometric constraints.

Predict PDE dynamics on submanifolds with zero-shot generalization to moving sources and mild nonlinearities, achieving 4-8x lower error than surrogates at millisecond query times.

Discrete diffusion models can achieve optimal sampling complexity for categorical MRFs by decomposing the score into time- and target-dependent multiplicative components, allowing for a single, weight-shared score network.

A single denoising process now unifies discrete token generation and continuous latent trajectories, enabling diffusion models to jointly reason about token dependencies and global structure.

A unified proactive generation framework enables LLMs to form reusable factual memories from streaming video without compromising real-time perception.

VideoLLMs forget up to 40% of temporal context by the output layer, but a simple inference-time injection can recover it.

Robots can now plan complex, long-horizon tasks in novel environments by predicting sparse visual sub-goals, achieving 70% success in zero-shot real-world experiments.

LLM/VLM agents significantly outperform non-agentic methods in preserving unedited parts during iterative 3D asset modification, but current agentic edits are prohibitively slow.

StreamMAE unlocks self-supervised learning on continuous video streams, matching i.i.d. MAE performance by tackling intra-batch similarity with novel regularization.

Autonomous driving diffusion planners now learn to intrinsically adhere to driving rules and explain their decisions, significantly improving safety in challenging scenarios.

Sonar-only SLAM now achieves robust topological mapping by verifying loop closures with a sequence-aware approach, overcoming the inherent ambiguity of acoustic echoes.

Radar novel-view synthesis finally unlocks Doppler, achieving 90.7% object detection recovery by separating scene geometry from sensor spread and enabling zero-shot configuration transfer.

Physics-constrained generation now achieves comparable fidelity to multi-step methods in a single neural transport evaluation.

Visual perception agents can achieve significant performance gains by actively seeking information beyond a single glance, outperforming static models by up to 30 points on challenging benchmarks.

A 260M-parameter looped diffusion model achieves performance surpassing a 6.5x larger non-looped counterpart with significantly less inference compute.

Standard image ViTs, when adapted with masked Siamese learning on "super images," unlock state-of-the-art video representation learning with orders of magnitude less pretraining.

Current VLMs, despite impressive general capabilities, fail to grasp the nuanced social dynamics required for robot navigation, lagging behind simple rule-based systems.

A novel decoupled autoencoder design unlocks 32x spatial compression for diffusion models while simultaneously boosting reconstruction fidelity and accelerating training convergence.

Diffusion language models can now generate high-quality text with up to 49% fewer network evaluations by matching output distributions.