Mapping Brains with Language Models: A Survey

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • Fulltext

    Final published version, 272 KB, PDF document

Over the years, many researchers have seemingly made the same observation: Brain and language model activations exhibit some structural similarities, enabling linear partial mappings between features extracted from neural recordings and computational language models. In an attempt to evaluate how much evidence has been accumulated for this observation, we survey over 30 studies spanning 10 datasets and 8 metrics. How much evidence has been accumulated, and what, if anything, is missing before we can draw conclusions? Our analysis of the evaluation methods used in the literature reveals that some of the metrics are less conservative. We also find that the accumulated evidence, for now, remains ambiguous, but correlations with model size and quality provide grounds for cautious optimism.
Original languageEnglish
Title of host publicationFindings of the Association for Computational Linguistics: ACL 2023
PublisherAssociation for Computational Linguistics (ACL)
Publication date2023
Pages9748-9762
ISBN (Electronic)978-1-959429-62-3
DOIs
Publication statusPublished - 2023
EventFindings of the Association for Computational Linguistics: ACL 2023 - Toronto, Canada
Duration: 1 Jul 20231 Jul 2023

Conference

ConferenceFindings of the Association for Computational Linguistics: ACL 2023
LandCanada
ByToronto
Periode01/07/202301/07/2023

ID: 381566615