Published December 11, 2023
| Version v1
Journal article
Open
Local similarity and global variability characterize the semantic space of human languages
- 1. Carnegie Mellon University
- 2. Dataminr, Inc.
- 3. Educational Testing Service
- 4. University of Chicago
Description
How does meaning vary across the world's languages? Scholars recognize the existence of substantial variability within specific domains, ranging from nature and color to kinship. The emergence of large language models enables a systems-level approach that directly characterizes this variability through comparison of word organization across semantic domains. Here, we show that meanings across languages manifest lower variability within semantic domains and greater variability between them, using models trained on both 1) large corpora of native language text comprising Wikipedia articles in 35 languages and also 2) Test of English as a Foreign Language (TOEFL) essays written by 38,500 speakers from the same native languages, which cluster into semantic domains. Concrete meanings vary less across languages than abstract meanings, but all vary with geographical, environmental, and cultural distance. By simultaneously examining local similarity and global difference, we harmonize these findings and provide a description of general principles that govern variability in semantic space across languages. In this way, the structure of a speaker's semantic space influences the comparisons cognitively salient to them, as shaped by their native language, and suggests that even successful bilingual communicators likely think with "semantic accents" driven by associations from their native language while writing English. These findings have dramatic implications for language education, cross-cultural communication, and literal translations, which are impossible not because the objects of reference are uncertain, but because associations, metaphors, and narratives interlink meanings in different, predictable ways from one language to another.
Data availability
Data and code are available through the GitHub repository associated with the project: https://github.com/mllewis/SYSTEMSEM (102). Some study data available Personal TOEFL Essays can only be analyzed in a secure setting because they contain personally identifying information.
Files
lewis-et-al-2023-local-similarity-and-global-variability-characterize-the-semantic-space-of-human-languages.pdf
Files
(25.1 MB)
| Name | Size | Download all |
|---|---|---|
|
Article md5:ab57f12efb8c4eb821744ce1dfa501fb |
21.1 MB | Preview Download |
|
Supporting information md5:e5bd8b0497972a73703277fcd1a067d2 |
4.0 MB | Preview Download |
Additional details
Identifiers
- DOI
- 10.1073/pnas.2300986120
- Other
- oai:uchicago.tind.io:10430
Funding
- National Science Foundation
- 1520074