Published October 28, 2024 | Version v1
Journal article Open

Does counting change what counts? Quantification fixation biases decision-making

  • 1. University of Pennsylvania
  • 2. University of Chicago
  • 3. Massachusetts Institute of Technology

Description

People often rely on numeric metrics to make decisions and form judgments. Numbers can be difficult to process, leading to their underutilization, but they are also uniquely suited to making comparisons. Do people decide differently when some dimensions of a choice are quantified and others are not? We explore this question across 21 preregistered experiments (8 in the main text, N = 9,303; 13 in supplement, N = 13,936) involving managerial, policy, and consumer decisions. Participants face choices that involve tradeoffs (e.g., choosing between employees, one of whom has a higher likelihood of advancement but lower likelihood of retention), and we randomize which dimension of each tradeoff is presented numerically and which is presented qualitatively (using verbal estimates, discrete visualizations, or continuous visualizations). We show that people systematically shift their preferences toward options that dominate on tradeoff dimensions conveyed numerically—a pattern we dub "quantification fixation." Further, we show that quantification fixation has financial consequences—it emerges in incentive-compatible hiring tasks and in charitable donation decisions. We identify one key mechanism that underlies quantification fixation and moderates its strength: When making comparative judgments, which are essential to tradeoff decisions, numeric information is more fluent than non-numeric information. Our findings suggest that when we count, we change what counts.

Data availability

Fully anonymized data, materials, preregistrations, and analysis code are available on the Open Science Framework (https://osf.io/97peh/?view_only=566b843cf41a46f9962237423078597e) (35). All other data are included in the article and/or SI Appendix.

Files

chang-et-al-2024-does-counting-change-what-counts-quantification-fixation-biases-decision-making.pdf

Files (26.9 MB)

Name Size Download all
Article
md5:3c356418029c59af9e71f47df0666716
440.6 kB Preview Download
Supporting information
md5:97d880bf8ba9b4d81382f883a4e894e3
26.4 MB Preview Download

Additional details

Identifiers

DOI
10.1073/pnas.2400215121
Other
oai:uchicago.tind.io:13821

Funding

MindCORE
Postdoctoral Research Fellowship

UChicago Information

Division(s)
Booth School of Business
Department(s)
Behavioral Science