Lattice AI Research

Research focus

Data Curation & Synthetic Data (2)Eval Frameworks & Benchmarks (2)Natural Language Processing (1)Reasoning & Chain-of-Thought (1)

Frequent co-authors

Paola Merlo (2)Paola Merlo (1)Chunyang Jiang (1)Chunyang Jiang (1)

Papers (2)

Mar 16, 2026

Mar 16, 2026·also UNIGE

Datasets for Verb Alternations across Languages: BLM Templates and Data Augmentation Strategies

LLMs struggle with systematic cross-sentence knowledge of verb alternations, a weakness exposed by new Blackbird Language Matrices (BLMs) datasets in English, German, Italian, and Hebrew.

Giuseppe Samo, Paola Merlo

Data Curation & Synthetic Data Eval Frameworks & Benchmarks Natural Language Processing

Feb 24, 2026

Feb 24, 2026·also UNIGE

Blackbird Language Matrices: A Framework to Investigate the Linguistic Competence of Language Models

LLMs can be dissected like never before using Blackbird Language Matrices, a new task revealing if they're truly grasping linguistic structure or just pattern-matching.

Paola Merlo, Paola Merlo, Chunyang Jiang +5

Data Curation & Synthetic Data Eval Frameworks & Benchmarks Reasoning & Chain-of-Thought

Search

Giuseppe Samo

Research focus

Frequent co-authors

Papers (2)