Search papers, labs, and topics across Lattice.
This study revisits the Syllogistic Evaluation Framework-Common Logic Grammar Construction (SEF-CLGC) to assess the impact of formal logical notations on the reasoning capabilities of Small Language Models (SLMs). By training SLMs on a mix of natural and symbolic languages, the authors evaluated their performance on the SemEval-2026 Task 11, achieving a content score of 27.80% while notably reducing content bias in reasoning. These findings highlight the potential of integrating formal logic into language models to enhance their reasoning accuracy and reliability.
Relying solely on Small Language Models, this approach achieved a surprising 27.80% content score while reducing reasoning bias.
This paper revisits our pipeline called Syllogistic Evaluation Framework-Common Logic Grammar Construction (SEF-CLGC). We combine formal logical notations with Small Language Models (SLMs) to evaluate reasoning performance on the SemEval-2026 Task 11 Subtask 1: Disentangling Content and Formal Reasoning in Large Language Models. Our experiments show that by relying solely on SLMs, trained on a combination of natural and symbolic languages, our best model achieves a content score of 27.80% on the task while significantly lowering the content bias in reasoning.
