Search papers, labs, and topics across Lattice.
This study addresses the challenge of ranking Reddit sentences for relevance to ADHD symptoms using a novel combination of retrieval and reranking techniques. By employing zero-shot experimentation and a staged retrieval design that integrates sparse BM25 retrieval with LLM-based reranking, the authors achieved significant performance improvements. The LLM reranker outperformed other methods, indicating the potential of advanced language models in semantic ranking tasks for mental health symptom identification.
LLM-based reranking outperformed traditional methods, highlighting the untapped potential of language models in mental health symptom relevance assessment.
This paper describes our submissions to eRisk 2026 Task 3, ADHD Symptom Sentence Ranking. The task requires systems to rank candidate Reddit sentences according to their relevance to each of the 18 symptoms in the Adult ADHD Self-Report Scale (ASRS-v1.1). Because no annotated training data were released for this first edition of the task, we relied on zero-shot experimentation, manual validation, and unsupervised or weakly guided retrieval pipelines. Our systems combine sparse BM25 retrieval, evidence-aware rescoring for self-referential symptom reports, embedding-based reranking, query-prototype expansion, and LLM-based reranking. All submitted systems follow a staged retrieval design in which BM25 retrieves candidates at scale and semantic or LLM rerankers refine the final rankings. Among our submissions, the LLM reranker achieved the strongest official scores, followed by the prototype query-expansion run. Our manual top-10 analysis aligned with the official expert scoring trend, suggesting that staged reranking is a promising direction for further development.
