Search papers, labs, and topics across Lattice.
This paper introduces Recursive Inference Machines (RIMs), a neural reasoning framework that integrates recursive inference mechanisms inspired by classical inference engines. RIMs generalize Tiny Recursive Models (TRMs) by adding a reweighting component, leading to improved performance on ARC-AGI and Sudoku benchmarks. The authors also demonstrate RIMs' effectiveness in tabular data classification, surpassing TabPFNs.
Neural networks can reason better by explicitly incorporating recursive inference mechanisms from classical AI, outperforming existing neural reasoners on challenging benchmarks.
Neural reasoners such as Tiny Recursive Models (TRMs) solve complex problems by combining neural backbones with specialized inference schemes. Such inference schemes have been a central component of stochastic reasoning systems, where inference rules are applied to a stochastic model to derive answers to complex queries. In this work, we bridge these two paradigms by introducing Recursive Inference Machines (RIMs), a neural reasoning framework that explicitly incorporates recursive inference mechanisms inspired by classical inference engines. We show that TRMs can be expressed as an instance of RIMs, allowing us to extend them through a reweighting component, yielding better performance on challenging reasoning benchmarks, including ARC-AGI-1, ARC-AGI-2, and Sudoku Extreme. Furthermore, we show that RIMs can be used to improve reasoning on other tasks, such as the classification of tabular data, outperforming TabPFNs.
