Search papers, labs, and topics across Lattice.
This paper investigates the conditions under which AI-driven research and development (R&D) can lead to self-amplifying improvements in AI capabilities. By deriving a recursive reproduction number, \(\mathcal{R}_{\mathrm{AI}}\), the authors characterize the balance between feedback strength and the increasing difficulty of research progress, revealing that when \(\mathcal{R}_{\mathrm{AI}}>1\), improvements compound across cycles, leading to a self-amplifying regime. The findings highlight that higher baseline research productivity can accelerate progress without necessarily inducing self-amplification, while also identifying key metrics to differentiate between genuine recursive amplification and rapid advancements due to other factors.
Self-amplifying AI improvements can occur before visible acceleration, challenging our understanding of AI development dynamics.
AI is increasingly used in the R\&D process that produces future AI systems. We study the conditions under which this feedback becomes self-amplifying. Our model describes how the rate of AI capability growth depends on baseline research productivity, recursive feedback, and the increasing difficulty of research progress. We derive a recursive reproduction number, $\mathcal{R}_{\mathrm{AI}}$, that determines whether improvements are amplified or damped across development cycles. This quantity compares the strength of feedback with the rate at which further progress becomes more difficult. When $\mathcal{R}_{\mathrm{AI}}>1$, the effects of improvements compound across development cycles, placing the system in a self-amplifying regime. When $\mathcal{R}_{\mathrm{AI}}<1$, their effects weaken across cycles. The transition depends on the structure of the AI R\&D feedback loop and need not occur at any particular level of model capability. A system can therefore enter a self-amplifying regime before acceleration becomes visible, while rapid progress can also occur without self-amplification. Higher baseline research productivity can accelerate progress without changing whether the system is self-amplifying, but the duration of the development cycle becomes a limiting timescale for amplification. Increasing research difficulty can end a period of self-amplification. Extending the model to multiple research actors shows that improvements shared across organizations can make the overall research ecosystem self-amplifying even when no individual actor is. The framework identifies measurable properties of AI R\&D systems that can help distinguish recursive amplification from rapid progress driven by other sources, including the strength of recursive feedback, how effectively improvements propagate into successor systems, cycle duration, and the increasing difficulty of further progress.
