nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-3215A661·Framework v5.0·Pipeline v0.4·Evaluated 05 Jun 2026·OECD: 5.8 Other social sciences·Subfield: Sociology and Political Science·Basis: Full text·Type: Field experiment

Nobel and novice: Author prominence affects peer review.

Huber et al.Huber, Inoua, Kerschbamer et al.·2022·Proceedings of the National Academy of Sciences of the United States of America·10.1073/pnas.2205779119 ↗

In brief

A rigorous real-world field experiment that delivers the strongest causal evidence yet for status bias in peer review, constrained mainly by its single-paper, single-field scope.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Abstract

Peer review is a well-established cornerstone of the scientific process, yet it is not immune to biases like status bias, which we explore in this paper. Merton described this bias as prominent researchers getting disproportionately great credit for their contribution, while relatively unknown researchers get disproportionately little credit [R. K. Merton, Science 159, 56-63 (1968)]. We measured the extent of this bias in the peer-review process through a preregistered field experiment. We invited more than 3,300 researchers to review a finance research paper jointly written by a prominent author (a Nobel laureate) and by a relatively unknown author (an early career research associate), varying whether reviewers saw the prominent author's name, an anonymized version of the paper, or the less-well-known author's name. We found strong evidence for the status bias: More of the invited researchers accepted to review the paper when the prominent name was shown, and while only 23% recommended "reject" when the prominent researcher was the only author shown, 48% did so when the paper was anonymized, and 65% did when the little-known author was the only author shown. Our findings complement and extend earlier results on double-anonymized vs. single-anonymized review [R. Blank, Am. Econ. Rev. 81, 1041-1067 (1991); M. A. Ucci, F. D'Antonio, V. Berghella, Am. J. Obstet. Gynecol. MFM 4, 100645 (2022)].

Strengths · Limitations

Strengths

#methodological rigour

Real-world field experiment, real reviewers

The design embeds the manipulation in an actual journal submission and collects 534 genuine review reports, making the findings directly relevant to peer review as it operates rather than to a lab analogue.

↳ Manuscript Assessment; Materials and Methods

#contribution

Clean separation of bias components

By varying author visibility across five conditions and prespecifying which to compare, the study isolates the recommendation-stage effect from invitation-stage selection and estimates both the positive and negative components of status bias.

↳ Identification Strategy; Manuscript Assessment

#application pathway

Large, decision-relevant effect sizes

Reject recommendations swing from 22.6% when the prominent author is shown to 65.4% when the lesser-known author is shown, a difference large enough to inform concrete editorial policy on anonymized review.

↳ Manuscript Assessment; Discussion and Conclusion

Limitations

#application pathway

Single paper, single field scope

All evidence comes from one finance manuscript with one Nobel-laureate-level author, so the magnitude of the effect may be specific to this paper, field, and extreme prominence, limiting direct transferability.

↳ Limitations

#methodological rigour

Consent procedure introduces moral hazard

The two-step consent process meant reviewers who proceeded knew they were in a study, raising selection and moral-hazard concerns; this is mitigated by an 81.2% consent rate with no significant between-condition differences but cannot be fully ruled out.

↳ Limitations; Methods: Informed Consent

#contribution

Name origin and skin-tone confound

The two authors differ in name origin and skin tone, factors the authors acknowledge could contribute to the observed differences and cannot disentangle from prominence.

↳ Limitations

Does this match your read? Add your assessment ↓

Nabu Commentary

The adjudicated scores reflect a well-executed field experiment whose central design choices are both novel and appropriate: stratified randomization by institution, a prespecified strategy that isolates the recommendation effect from invitation-stage selection, and appropriate non-parametric tests with multiple-comparison corrections. The effect sizes reported in the manuscript-assessment results are large and the statistical comparisons are consistently significant, which anchors the high contribution and craft assessments. The dimensions that pulled scores down are scope-related rather than execution-related: the single-paper, single-field design and the extreme prominence of the Nobel-laureate treatment constrain how far the magnitude generalizes, which is why impact transferability is rated well below the quality dimensions. The two-step consent process and the handling editor being a co-author introduce residual concerns, but both are disclosed, IRB-approved, and mitigated by documented data-handling safeguards and a high, condition-balanced consent rate, so they temper rather than undermine the craft assessment.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
4.1±0.1

Contribution
4.2

The three-condition design separately estimates the positive and negative components of the Matthew effect using a real journal submission and 534 real reviewer reports, advancing beyond prior double- versus single-anonymized comparisons. The single-paper, single-field scope is an acknowledged constraint that keeps the contribution below the airtight band.

Abstract; Manuscript Assessment; Limitations

only 23% recommended "reject" when the prominent researcher was the only author shown... 65% did when the little-known author was the only author shown

Methodological Rigour
4.1

Institution-stratified randomization, a prespecified identification strategy isolating the anonymized-invitation conditions (AL/AA/AH), appropriate non-parametric tests, and documented preregistration deviations support competent execution. Acknowledged moral-hazard and confound limitations keep the score in the well-executed but non-airtight band; no reliability cap applies.

Methods: Randomization and Invitations in Waves; Identification Strategy; Statistical Tests; Deviations from the Preregistration Document

we found statistically significant differences (AL vs. LL: z=-2.172, P = 0.030...), we refrained from pooling

Reporting
4.2

The two-letter condition notation is introduced and applied consistently, and the identification logic for focusing on AL/AA/AH is explained transparently. Qualifying language separates documented effects from the unproven motivational mechanism.

Identification Strategy; Discussion and Conclusion

our study was not designed to elucidate the motivational drivers of this bias

Positioning
3.9

The paper engages substantively with Merton, Blank, and Ucci et al. and offers a candid limitations analysis covering confounds and scope. Engagement with the broader audit-study/field-experiment literature is thinner and the policy discussion runs somewhat ahead of a single-study evidence base.

Introduction; Limitations; Discussion and Conclusion

we used only one paper in one field... we cannot unambiguously speak for other fields of science

Lower confidence on Positioning — domain match limited.

Reliability

Caveats4 of 4 checks


Internal CoherenceClean

Reported figures are internally consistent: condition-specific report counts (AL 101 + AA 110 + AH 102 + LL 114 + HH 107) sum to 534, and abstract rejection rates (23%/48%/65%) align with body figures (22.6%/48.2%/65.4%). Statistical tests match data types and both significant and null results are reported.

Research ConductNoted

Ethics approvals are declared with specific IRB identifiers (Graz 39/126/63 ex 2020/21; Innsbruck 13/2021) and Elsevier sign-off, and the study is preregistered with public data and code on OSF; approvals are declared-but-unverified. The design involves ethically sensitive concealment of experimental conditions in live peer review and a disclosed conflict in that the handling editor is a co-author, both described with mitigating safeguards.

Flags: 5 declared / 5 total

Reference IntegrityClean

All 23 cited references resolved to real publications via PubMed, Crossref, or OpenAlex.

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice · SDG 10
Type of advanceEmpirical
Route to useSuggested
AdvanceExtends
CitationsFWCI 44.0
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessValidated
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The primary claim was tested in a large preregistered field experiment with over 3,300 real reviewers and 534 actual review reports at a real journal, providing real-world population data well beyond a pilot.

From the paper
“On the crucial question of whether peer review should be single-anonymized or double-anonymized, our results speak in support of the latter.”

The paper names a concrete real-world use of its findings, informing the choice of double-anonymized peer review, but does not explicitly name the journals, editors or publishers who would act on it.

Pathway

Journal editors and publishers would act on these findings by adopting double-anonymized review processes to reduce status bias against less prominent authors.

Barrier

The evidence comes from a single manuscript in a single field at one journal, and widespread preprints and working papers make truly anonymized review increasingly difficult to implement.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. 'Put the illness in a box': a longitudinal interpretative phenomenological analysis of changes in a sufferer's pictorial representations of pain following participation in a pain management programme

    Nizza, Smith, Kirkham · 2017 · Clinical medicine

    Primary claim

    as control is regained, a sufferer’s relationship with their chronic pain can visibly change

    Supported
    Evidence Score
    3.2±0.2
    Reliability
    No concerns
  2. Real-Time Inequality

    Thomas Blanchet, Léon Mouillet, Emmanuel Saez, et al. · 2022 · Economics and business

    Primary claim

    our methodology accurately predicts growth during downturns.

    Supported
    Evidence Score
    3.9±0.1
    Reliability
    Caveats
  3. TRACES: A Benchmark for Epistemic Reliability in Scientific Reasoning by LLMs

    Rodionov, Assylbekov · 2026 · Computer and Information Sciences

    Primary claim

    Across 30 models and 10 repeated runs, aggregate IFR-a is 0.93 ± 0.004 and aggregate IFR-i is 0.809 ± 0.009.

    Supported
    Evidence Score
    3.0±0.2
    Reliability
    Caveats

How the rubric works →