Martin Takac

Compact retrievers can achieve nearly half the performance of larger models while being up to 9.7× faster, challenging the assumption that bigger is always better in retrieval tasks.

Transforming noisy web text into a high-quality petroleum engineering dataset boosts retrieval performance by over 44% on benchmark tasks.

Layer span variation can unlock a new dimension of deterministic rollout diversity, boosting performance by over 10 percentage points on reasoning tasks.