Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces E3, an automated review assistant designed to identify technical concerns in research papers, including unsupported claims, missing ablations, and weak baselines. E3 is evaluated using an issue-level backtesting protocol on ICLR 2026 papers, comparing its performance against human reviews and LLM baselines (GPT-5.4 and Claude-Opus-4-6). Results show E3 achieves significantly higher recall in identifying issues compared to human reviewers and LLM baselines, suggesting its potential to augment the peer review process.
Human peer reviewers miss nearly 30% more critical issues in research papers than this new automated critique tool, E3.
We present E3, an automated review assistant that augments reviewers and engineering teams by identifying decision-relevant technical concerns in research papers. For each concern, E3 reports its nature, its location, its bearing on the contribution, and the analysis or evidence that would resolve it, covering unsupported claims, missing ablations, weak baselines, hidden assumptions, threats to validity, and leakage risks. To evaluate E3 without contamination confounds we adopt an issue-level backtesting protocol: the corpus is restricted to papers postdating the training cutoff of every automated source, and for each paper a meta-judge that observes only anonymised reviews labels every issue-source pair as Caught, Partial, or Missed. Applied to 100 ICLR 2026 papers and 4598 judged issue rows, comparing E3 against the ICLR human reviews and two prompt-matched LLM baselines built on gpt-5.4 from OpenAI and claude-opus-4-6 from Anthropic, with meta-judge gpt-5.5, E3 attains the highest recall on every aggregate metric. Partial-inclusive recall reaches 90.2 percent, which is 15.5 points over GPT, 17.1 points over Claude, and 29.2 points over the human reviews, and strict recall preserves the ordering at 65.8 percent. On concerns raised by the human reviewers, E3 recovers 89.6 percent; on concerns the human reviewers missed it surfaces 1635 additional rows admitted into the judged union, 406 above the next-best source. Corpus, baseline prompts, judge prompt template, and evaluation code are released.