Published December 11, 2023 | Version v1
Journal article Open

Local similarity and global variability characterize the semantic space of human languages

  • 1. Carnegie Mellon University
  • 2. Dataminr, Inc.
  • 3. Educational Testing Service
  • 4. University of Chicago

Description

How does meaning vary across the world's languages? Scholars recognize the existence of substantial variability within specific domains, ranging from nature and color to kinship. The emergence of large language models enables a systems-level approach that directly characterizes this variability through comparison of word organization across semantic domains. Here, we show that meanings across languages manifest lower variability within semantic domains and greater variability between them, using models trained on both 1) large corpora of native language text comprising Wikipedia articles in 35 languages and also 2) Test of English as a Foreign Language (TOEFL) essays written by 38,500 speakers from the same native languages, which cluster into semantic domains. Concrete meanings vary less across languages than abstract meanings, but all vary with geographical, environmental, and cultural distance. By simultaneously examining local similarity and global difference, we harmonize these findings and provide a description of general principles that govern variability in semantic space across languages. In this way, the structure of a speaker's semantic space influences the comparisons cognitively salient to them, as shaped by their native language, and suggests that even successful bilingual communicators likely think with "semantic accents" driven by associations from their native language while writing English. These findings have dramatic implications for language education, cross-cultural communication, and literal translations, which are impossible not because the objects of reference are uncertain, but because associations, metaphors, and narratives interlink meanings in different, predictable ways from one language to another.

Data availability

Data and code are available through the GitHub repository associated with the project: https://github.com/mllewis/SYSTEMSEM (102). Some study data available Personal TOEFL Essays can only be analyzed in a secure setting because they contain personally identifying information.

Files

lewis-et-al-2023-local-similarity-and-global-variability-characterize-the-semantic-space-of-human-languages.pdf

Files (25.1 MB)

Name Size Download all
Article
md5:ab57f12efb8c4eb821744ce1dfa501fb
21.1 MB Preview Download
Supporting information
md5:e5bd8b0497972a73703277fcd1a067d2
4.0 MB Preview Download

Additional details

Identifiers

DOI
10.1073/pnas.2300986120
Other
oai:uchicago.tind.io:10430

Funding

National Science Foundation
1520074

UChicago Information

Division(s)
Social Sciences Division
Department(s)
Sociology