Published November 10, 2022 | Version v1
Journal article Open

Large studies reveal how reference bias limits policy applications of self-report measures

  • 1. University of Pennsylvania
  • 2. University of Texas at Austin
  • 3. University of Chicago
  • 4. University of Pittsburgh
  • 5. University of Colorado-Boulder
  • 6. Mathematica, Inc.

Description

There is growing policy interest in identifying contexts that cultivate self-regulation. Doing so often entails comparing groups of individuals (e.g., from different schools). We show that self-report questionnaires—the most prevalent modality for assessing self-regulation—are prone to reference bias, defined as systematic error arising from differences in the implicit standards by which individuals evaluate behavior. In three studies, adolescents (N = 229,685) whose peers performed better academically rated themselves lower in self-regulation and held higher standards for self-regulation. This effect was not observed for task measures of self-regulation and led to paradoxical predictions of college persistence 6 years later. These findings suggest that standards for self-regulation vary by social group, limiting the policy applications of self-report questionnaires.

Files

Large-studies-reveal-how-reference-bias-limits-policy-applications-of-self-report-measures.pdf

Files (5.3 MB)

Name Size Download all
Supplementary information
md5:ef0646a45e96e59c48d550452abeef65
3.9 MB Preview Download
Article
md5:2f041a66b739a84cfbcdf4034d9d0d1c
1.4 MB Preview Download

Additional details

Identifiers

DOI
10.1038/s41598-022-23373-9
Other
oai:uchicago.tind.io:5055

Funding

National Institute of Child Health and Human Development
10.13039/100000071 R01HD084772-01

UChicago Information

Division(s)
Social Sciences Division
Department(s)
Kenneth C. Griffin Department of Economics