Recommendation & Information Retrieval - Weekly Roundup

Weak interactive feedback can dynamically steer LLMs to the correct similarity criterion for test-time decisions, unlocking significant performance gains beyond static mixtures.

AI-powered scoping reviews can now efficiently identify optimal plant trait combinations for ecosystem services, bridging the gap between cutting-edge research and practical application.

Multi-head attention applied to network depth unlocks substantial performance gains and compute efficiency in large MoE models.

Irrelevant text distractors cripple mixed-modality retrieval performance more than images, revealing a text modality preference that degrades performance in a V-shaped curve.

Standard two-level softmax sampling is demonstrably biased; corrected methods achieve near-exact softmax approximations with negligible overhead.

Weak interactive feedback can dynamically steer LLMs to the correct similarity criterion for test-time decisions, unlocking significant performance gains beyond static mixtures.

AI-powered scoping reviews can now efficiently identify optimal plant trait combinations for ecosystem services, bridging the gap between cutting-edge research and practical application.

Multi-head attention applied to network depth unlocks substantial performance gains and compute efficiency in large MoE models.

Irrelevant text distractors cripple mixed-modality retrieval performance more than images, revealing a text modality preference that degrades performance in a V-shaped curve.

Standard two-level softmax sampling is demonstrably biased; corrected methods achieve near-exact softmax approximations with negligible overhead.

Adversarial shifts in bandit arm means, not just gaps, break standard best-arm identification algorithms, requiring a novel importance-weighting approach for robust performance.

Stored patch vectors from visual document retrieval systems can be inverted to reconstruct original pages, revealing sensitive information and enabling source page identification with high accuracy.

Generative recommender training strategies that append missed targets can actively harm ranking performance by introducing detrimental probability competition.

Black-box MIPS oracles can approximate attention with $O(1/\varepsilon^2)$ keys by augmenting queries and keys, bypassing $\sqrt{n}$ and $\log n$ dependencies.

Intermediate retrieval signals, not just final outcomes, unlock efficient credit assignment for training LLM search agents.

AI agents can now build and reuse persistent, artifact-specific knowledge, dramatically improving their ability to find relevant information for complex tasks and reducing operational costs.

LLMs can learn to actively compute evidence by routing through retrieval and computation, dramatically improving performance on complex, multi-source reasoning tasks.

A single, lightweight model-internal mechanism can effectively bridge the gap between corpus retrieval and long-context inference, outperforming specialized SOTA systems on both.

Personal LLM agents can significantly improve recommendation quality by mediating platform rankings with cross-platform history, but naive mediation introduces substantial harmful overrides.

Sequential recommenders can dramatically boost catalog diversity by adaptively pruning action sets, achieving up to 5.21x diversity gains without sacrificing session depth.

A new benchmark reveals that even sophisticated RAG systems struggle with prompt injection, with DistilBERT leading detection at 89.6% F1.

LLM agents can autonomously optimize RAG pipelines by diagnosing retrieval vs. generation failures, outperforming traditional hyperparameter tuning and achieving Pareto efficiency.

A small, causally identified set of attention heads reliably detects network infrastructure information across diverse LLMs, but their responsibility may reside in single neurons or be distributed across the head depending on the model.

Distributed MMD with Random Fourier Features achieves near-perfect correlation with expected drift magnitude on massive e-commerce data, while per-dimension KS tests falter.