Computer Vision - Weekly Roundup

Enforcing uniform load balancing across video tokens fundamentally breaks visual coherence, but bifurcating experts into semantic and generic tiers resolves patch fragmentation while driving emergent coarse-to-fine denoising.

Timing human supervision across a test stream proves far more impactful than intra-batch sample selection, matching full active test-time adaptation performance while querying only a fraction of test batches.

Robot policies can now test and refine manipulation plans entirely within a learned visual simulator across ten distinct embodiments, gaining up to 21.4 percentage points in task success without any target-domain fine-tuning.

Streaming video assistants face an unresolved utility–latency–storage trilemma the moment interactions are interrupted across sessions, exposing acute failures in long-term recall and missing-evidence awareness.

High-resolution 4K video upscaling no longer requires iterative diffusion: a single denoising step can outperform multi-step refiners while slashing latency by nearly 9×.

Enforcing uniform load balancing across video tokens fundamentally breaks visual coherence, but bifurcating experts into semantic and generic tiers resolves patch fragmentation while driving emergent coarse-to-fine denoising.

Timing human supervision across a test stream proves far more impactful than intra-batch sample selection, matching full active test-time adaptation performance while querying only a fraction of test batches.

Robot policies can now test and refine manipulation plans entirely within a learned visual simulator across ten distinct embodiments, gaining up to 21.4 percentage points in task success without any target-domain fine-tuning.

Streaming video assistants face an unresolved utility–latency–storage trilemma the moment interactions are interrupted across sessions, exposing acute failures in long-term recall and missing-evidence awareness.

High-resolution 4K video upscaling no longer requires iterative diffusion: a single denoising step can outperform multi-step refiners while slashing latency by nearly 9×.

Fully factorizing self-attention across separate temporal, spectral, and spatial dimensions slashes compute while dominating SITS segmentation benchmarks—and uncovers that common tile-size discrepancies have quietly rendered most published baseline comparisons invalid.

Pixel diffusion’s chronic high-frequency blur is not an architectural bottleneck: a lightweight adversarial post-training phase restores natural spectral power laws without causing mode collapse or requiring changes to the sampling pipeline.

Append-only memory guarantees attention collapse in long-horizon video reasoning, but actively rewriting a bounded working memory from an external filesystem boosts hard-subset task accuracy by over 20%.

Generative models can only rely on efficient local denoising up to the exact moment they commit to global semantics, after which both phenomena collapse into a single sharp phase transition as system size grows.

Marginal conformal guarantees often mask severe error spikes on hard examples, but inverting localized risk curves delivers tight conditional error control without sacrificing distribution-free finite-sample validity.

Chronological text logs routinely confuse distinct physical objects across multi-day video, a failure mode resolved by explicitly clustering grounded visual instances into persistent entity biographies rather than relying on episodic text search.

Probing a frozen diffusion relighter with paired background queries extracts complex scene shadows and ambient lighting directly onto synthetic inserts, bypassing the need for banner-specific retraining.

A model trained solely on file metadata—with zero medical imaging data—hits 0.992 balanced accuracy on a flagship pediatric x-ray benchmark, proving that evaluation artifacts and pipeline choices dominate architectural gains.

Scaling model size fails to fix fundamental cross-video reasoning deficits in frontier MLLMs, but targeted supervision from physics simulators reliably transfers zero-shot to real-world multi-view video tasks.

CLIP's cross-modal gap makes text-derived classifier weights actively harm class-incremental learning—discarding the text branch entirely in favor of closed-form visual SVMs delivers superior continual recognition.

Decoupling student rollout generation from teacher supervision kernels enables stable on-policy distillation for few-step flow models, outperforming multi-reward GRPO while accelerating convergence.

Image editors secretly encode 3D projective geometry accurate to 0.8° of pitch—outperforming specialized calibration networks—yet completely fail if explicitly prompted to identify the horizon or vanishing points.

Earth observation streams and foundation model embeddings can be compressed 1,800× into continuous neural fields while retaining 90%+ downstream performance and cutting data retrieval latency tenfold.

Sparse neuron dictionaries are not just passive interpretability tools: actively steering frozen VLM tokens through query-guided concept activation delivers up to a +9.5 point accuracy boost on complex spatial reasoning without retraining.

Continual learners no longer need oracle task IDs to dynamically scale capacity, as loss-driven width expansion coupled with persistent key-value attention prevents catastrophic forgetting across unsegmented task streams.

Decoupling group-level interaction dynamics from individual body kinematics is the missing ingredient for multiperson generative models to generalize across arbitrary agent counts and severely corrupted observations.

Closed-loop vision verification is no longer bottlenecked by intractable generative surrogates: compact stochastic world models cut parameter counts by 130× while resolving over 80% of previously unverified RGB state spaces.

Non-factorized diffusion language models achieve superior few-step generation by leveraging a discrete latent space learned via Mixture-of-Experts routing, bypassing posterior collapse issues.

Independent chunk scoring in autoregressive video generation unlocks sustained visual quality over extended horizons, overcoming the temporal consistency trade-offs of prior methods.

Video world models can now maintain persistent scene memory without ever-growing storage by warping and fusing low-rank features into a fixed-size HexMemory.

Video agents can now autonomously discover and fix their own reasoning flaws by re-watching videos and evolving their evidence-gathering strategies.

Synthesizing historical street views is now possible with 17% better realism and consistency by treating it as a reward-guided editing problem.

Unified OCR foundation models achieve state-of-the-art visual intelligence by integrating recognition, parsing, and reasoning through instruction-following and a novel competence-guided policy optimization.

Decoupling structured semantics from frame-level actions and distilling autoregressive rollouts via shared, compressed memory tokens solves the long-standing trade-off between real-time responsiveness and multi-step drift in interactive world models.

Downstream classifier accuracy can actually improve when neural compressors intentionally distort reconstruction distributions away from mismatched source domains toward a target distribution.

Collecting more errors doesn't guarantee better models: targeting only the high-impact failure modes signaled by a network's own internal representations outperforms standard rarity-based active learning while saving annotation budget.

Robots can master delicate tool manipulation directly from unpaired human videos, achieving a 73% performance leap over SOTA by anchoring control in object-centric 3D pose priors rather than raw end-to-end pixels.

Categorical sampling cripples discrete diffusion by discarding intermediate uncertainty—diffusing directly over the probability simplex fixes this information collapse, enabling an 8-step distilled model to beat 128-step discrete baselines on GSM8K.

Human hair priors can substitute for non-existent animal fur datasets, enabling dense, editable 3D animal grooming with an order-of-magnitude faster optimization.

Image models do not need noisy vision-language reward models to master compositional reasoning: training on programmatically verified synthetic scenes yields a 10x boost in spatial accuracy that transfers directly to natural prompts.

Deciphering ancient scripts typically fails when characters mutate drastically across dynasties, but modeling script drift as continuous Neural ODE trajectories bridges 3,000 years of morphological divergence from Oracle Bone to modern characters.

While natural vision largely abandoned pixel reconstruction for latent objectives, handwriting recognition fundamentally requires it because character identities reside almost exclusively in high-pixel-variance directions that contrastive methods and JEPAs discard.

Single-step diffusion models can outperform their multi-step teachers when distributional matching is reformulated as a Wasserstein gradient flow over Gaussian mixtures.

Video diffusion models hallucinate rich scene completions but inevitably drift; anchoring their appearance priors directly inside a 3D geometric latent space eliminates sequential inconsistency and slashes trajectory error by 32%.

Unified models can master multi-turn visual self-correction through end-to-end trajectory RL, eliminating the need for external critic models or inference-time verifiers while yielding double-digit visual alignment gains.

Recursive image editing collapses not from weak visual priors, but from exposure bias to model artifacts—a failure mode fixable entirely without multi-turn data by distilling clean teachers into on-policy rollouts.

Multi-noise score matching mathematically splits the neural tangent kernel into two distinct spectral bulks, explaining why diffusion models master data distributions long before collapsing into training set memorization.

Diffusion models are completely blind to class frequencies at high signal-to-noise ratios, acquiring relative mode weights exclusively within a narrow $\mathcal{O}(1)$ SNR window known as the speciation time.

Model collapse in generative self-training can be weaponized: intentionally amplifying a generator's Jacobian-derived geometric distortions creates a far more potent negative guidance signal than standard synthetic outputs.

Pairing learned generative transport with theoretically prescribed normal contraction eliminates off-manifold drift down to $10^{-7}$ precision, driving double-digit success gains in robotic manipulation.

Frozen 4B image generators can outperform proprietary models at multi-subject composition simply by letting an autonomous coding agent iteratively rewrite their Python orchestration harnesses.

Ditching brittle hand-estimator-plus-SLAM cascades for an end-to-end streaming memory network slashes world-space hand tracking error by 21.4% while doubling inference throughput.

Severe oversaturation and artifacts in few-step video distillation stem directly from compounding critic errors, which can be neutralized via a single-line geometric projection without discarding the true generative signal.

Conversational 3D heads no longer need static weights: turning live dyadic audiovisual streams into an online self-supervised training signal makes avatar motion up to 11.1% more coherent as dialogues unfold.

Treating satellite spectra as continuous functions rather than discrete vectors unlocks zero-shot reconstruction of completely unseen spectral bands at resolutions finer than native sensors.

Ditching autoregressive token generation in favor of continuous flow matching slashes tool-use latency by over 50× while beating proprietary MLLMs at image retouching.

Real-time translation between different sign languages is finally feasible, cutting streaming latency by 38% with only a 2.1 BLEU penalty against offline models despite severe cross-lingual word-order mismatches.

Leading image generation models fail over 40% of goal-driven visual reasoning tasks, but decoupling explicit visual planning from generation boosts task completion by up to 14.6 points without fine-tuning.

Diffusion teachers and online score networks are no longer bottlenecks for distilling autoregressive video models: directly minimizing sample MMD against reference videos improves VBench scores while unlocking 14B post-training on just eight H200 GPUs.

Pre-trained Softmax ViTs can directly bootstrap linear-attention models without expensive pre-training from scratch: simply copy the operator-agnostic MLP weights and distill the attention routing behavior.

High-fidelity 3D texture generation is now achievable without any 3D assets, by cleverly transforming 2D images into effective training data.

A novel training strategy allows video segmentation models to learn from hours-long sequences, overcoming memory and gradient limitations to achieve 10x speedup over SOTA.

City-scale UAV navigation with satellite imagery reveals current VLN agents forget 40% of context after 379m, necessitating new memory architectures.

Recurrent token mixing via GTR achieves 58.9 AP on COCO with sub-2ms latency, offering a practical, efficient alternative to quadratic self-attention for high-resolution dense prediction.

This work builds Video-HopChain, a dataset of 22,550 multi-hop video questions over 13,378 videos, together with a held-out benchmark of 1,000 questions, which raises the mean over eight video understanding and reasoning benchmarks from 55.4 to 57.9 and introduces Confidence-Gated Exploration (CGE).

The Hierarchical Feature Integration Network is introduced, which fuses high-level semantic and local geometric features for each point, overcoming the limitations of token-based point-cloud reconstruction.

This paper proposes a fully automated data generation pipeline that generates pointwise perceptual distance labels between image pairs without any human annotation, and demonstrates that the diffusion trajectory aligns well with the human visual system.

A Coarse-to-Fine Scene Expert Network (C2FXNet) that achieves unified detection through hierarchical scene guidance through dual-level guidance mechanism, and enables robust multi-scene detection without scene-specific training.

A generalized Medical Imaging Disentanglement Learning framework that outperforms state-of-the-art supervised and self-supervised classification methods in accuracy across all datasets and successfully isolates target-specific latent representations.

Expensive pixel-level segmentation masks are unnecessary for fine-grained root phenotyping: parameter-efficient tuning of just 3.8% of a frozen DINOv3 ViT directly maps raw minirhizotron images to root traits with $R^2 \ge 0.93$.