# Nobel and novice: Author prominence affects peer review.

- **DOI:** [10.1073/pnas.2205779119](https://doi.org/10.1073/pnas.2205779119)
- **Rating:** Strong (4.1 out of 5)
- **Verdict:** A rigorous real-world field experiment that delivers the strongest causal evidence yet for status bias in peer review, constrained mainly by its single-paper, single-field scope.
- **Framework version:** v5.0
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-06-05
- **Evaluation page:** https://www.nabu.science/paper/10.1073%2Fpnas.2205779119

## Strengths

- **Real-world field experiment, real reviewers** The design embeds the manipulation in an actual journal submission and collects 534 genuine review reports, making the findings directly relevant to peer review as it operates rather than to a lab analogue.
  - Dimension: methodological rigour
  - Location: Manuscript Assessment; Materials and Methods
- **Clean separation of bias components** By varying author visibility across five conditions and prespecifying which to compare, the study isolates the recommendation-stage effect from invitation-stage selection and estimates both the positive and negative components of status bias.
  - Dimension: contribution
  - Location: Identification Strategy; Manuscript Assessment
- **Large, decision-relevant effect sizes** Reject recommendations swing from 22.6% when the prominent author is shown to 65.4% when the lesser-known author is shown, a difference large enough to inform concrete editorial policy on anonymized review.
  - Dimension: application pathway
  - Location: Manuscript Assessment; Discussion and Conclusion

## Limitations

- **Single paper, single field scope** All evidence comes from one finance manuscript with one Nobel-laureate-level author, so the magnitude of the effect may be specific to this paper, field, and extreme prominence, limiting direct transferability.
  - Dimension: application pathway
  - Location: Limitations
- **Consent procedure introduces moral hazard** The two-step consent process meant reviewers who proceeded knew they were in a study, raising selection and moral-hazard concerns; this is mitigated by an 81.2% consent rate with no significant between-condition differences but cannot be fully ruled out.
  - Dimension: methodological rigour
  - Location: Limitations; Methods: Informed Consent
- **Name origin and skin-tone confound** The two authors differ in name origin and skin tone, factors the authors acknowledge could contribute to the observed differences and cannot disentangle from prominence.
  - Dimension: contribution
  - Location: Limitations

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Clean. Reported figures are internally consistent: condition-specific report counts (AL 101 + AA 110 + AH 102 + LL 114 + HH 107) sum to 534, and abstract rejection rates (23%/48%/65%) align with body figures (22.6%/48.2%/65.4%). Statistical tests match data types and both significant and null results are reported.
- **Research conduct:** Noted. Ethics approvals are declared with specific IRB identifiers (Graz 39/126/63 ex 2020/21; Innsbruck 13/2021) and Elsevier sign-off, and the study is preregistered with public data and code on OSF; approvals are declared-but-unverified. The design involves ethically sensitive concealment of experimental conditions in live peer review and a disclosed conflict in that the handling editor is a co-author, both described with mitigating safeguards.
- **Reference integrity:** Clean. All 23 cited references resolved to real publications via PubMed, Crossref, or OpenAlex.
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
