Search papers, labs, and topics across Lattice.
This study investigates the utility of language model representations as neural predictors during naturalistic language comprehension by analyzing data from Brain Treebank, MEG-MASC, and Podcast ECoG using eight frozen language models. The results reveal that a significant portion of the data (67 out of 432 evaluable rows) meets a controlled predictive-only criterion, indicating that language model-derived features can effectively annotate neural activity during comprehension tasks. The findings highlight the nuanced relationship between language model predictions and neural responses, suggesting that while these models can enhance understanding of neural activity, they do not necessarily imply shared neural processing mechanisms.
Language model features can serve as powerful neural predictors during natural speech comprehension, revealing complex interactions between model outputs and brain activity.
Language-model representations provide structured, high-dimensional annotations of naturalistic language stimuli and can serve as informative neural predictors during comprehension. We analyzed locked derived data from Brain Treebank, MEG-MASC, and Podcast ECoG with eight frozen language models, blocked encoding models, and matched temporal, nuisance, and representation-capacity controls. Positive held-out prediction and gains over low-level baselines were widespread in source-level summaries. Across Brain Treebank and Podcast ECoG, 67 of 432 evaluable rows met a controlled predictive-only criterion, and model-side feature ablations changed prediction scores in most evaluable source rows. Brain-derived, timing-linked, acoustic, and implanted-signal controls confirmed component-level sensitivity of the analysis pipeline. These findings show that language-model-derived quantities can annotate neural activity during natural speech and text comprehension. Participant-level matched-control advantages were localized rather than uniform, response-profile and feature-specificity contrasts bounded representational or computational interpretations, and complete co-indexed integrated interpretation will require future jointly indexed coverage. Together, the analyses identify language-model features as useful neural predictors and separate predictive usefulness from claims about shared neural organization or language-processing computations.
