nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-2ADDB3CD·Framework v5.8·Pipeline v0.4·Evaluated 24 Aug 2026·OECD: 3.2 Clinical medicine·Subfield: Social Psychology·Basis: Full text·Type: Randomized controlled trial

Failed Replication of Oxytocin Effects on Trust: The Envelope Task Case.

Lane et al.Lane, Mikolajczak, Treinen et al.·2015·PloS one·10.1371/journal.pone.0137000 ↗

Primary claim

two failed replications of this effect, despite sufficient power to replicate the original large effect

Well-supported · two randomized null studies had ample power for the originally reported effect size
In brief

Two powered null replications convincingly reject the original large Envelope Task effect, but single-lab, male-only samples constrain broader generalization.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Abstract

The neurohormone Oxytocin (OT) has been one of the most studied peptides in behavioral sciences over the past two decades. Many studies have suggested that OT could increase trusting behaviors. A previous study, based on the "Envelope Task" paradigm, where trust is assessed by the degree of openness of an envelope containing participant's confidential information, showed that OT increases trusting behavior and reported one of the most powerful effects of OT on a behavioral variable. In this paper we present two failed replications of this effect, despite sufficient power to replicate the original large effect. The non-significant results of these two failed replications clearly exclude a large effect of OT on trust in this paradigm but are compatible with either a null effect of OT on trust, or a small effect, undetectable with small sample size (N = 95 and 61 in Study 1 and 2, respectively). Taken together, our results question the purported size of OT's effect on trust and emphasize the need for replications.

Key Claims

Primary finding · Well-supported

two failed replications of this effect, despite sufficient power to replicate the original large effect

two randomized null studies had ample power for the originally reported effect size

Abstract
Quote verified
Secondary · Supported

The non-significant results of these two failed replications clearly exclude a large effect of OT on trust in this paradigm

Study 1 and the pooled evidence reject a large effect, though Study 2 alone was smaller

Abstract
Quote verified
Secondary · Supported

our results question the purported size of OT’s effect on trust

the evidence directly tests one paradigm, while broader interpretation relies on contextual literature

Abstract
Quote verified
Secondary · Supported

compatible with either a null effect of OT on trust, or a small effect, undetectable with small sample size

confidence intervals and power analysis preserve both null and small-effect interpretations

Abstract
Quote verified
Secondary · Supported

this paradigm should not be used as a manipulation check

two failures undermine reliability for this use, but independent laboratories were not tested

Introduction final paragraph; Discussion opening
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Powered test of the original effect

The discussion calculates that only 14 participants would be needed for the original d=2.29 effect and that Study 1 could detect a conventional large effect, directly supporting rejection of a large effect.

↳ Discussion, paragraph beginning “In the case of the envelope task”

#methodological rigour

Blinded randomized replication procedures

Both studies randomly assigned participants to oxytocin or placebo and used colleague-held allocation codes to maintain double blinding until study completion.

↳ Study 1 Participants; Study 2 Participants

#positioning

Alternative explanations remain integrated

The discussion evaluates five explanations spanning false positivity, experimenter effects, small effects, reversed effects, and pharmacokinetic uncertainty rather than treating non-significance as proof of no effect.

↳ Discussion, five-hypothesis analysis

Limitations

#methodological rigour

Adverse-event outcomes are not reported

Participants were informed about possible adverse effects and allergic reactions, but neither Results section reports systematic adverse-event collection or outcomes after intranasal oxytocin.

↳ Ethics Statement; Study 1 Results; Study 2 Results

#methodological rigour

Replication scope remains methodologically narrow

Study 1 used a different questionnaire and is acknowledged as conceptual, while both studies came from one laboratory and included only healthy young adult males.

↳ Discussion opening; Study 1 Participants; Study 2 Participants

#application pathway

Broader transfer requires independent testing

The evidence directly addresses the Envelope Task under closely related laboratory conditions and does not empirically establish generalization to other trust paradigms, laboratories, or populations.

↳ Study 1 and Study 2 Methods; Discussion opening

Does this match your read? Add your assessment ↓

Nabu Commentary

The central replication claim is supported by consistent null Envelope Task results and power calculations directed at the original d=2.29 effect. Randomization, double blinding, baseline checks, and convergent ANOVA and ordinal-regression analyses support competent execution, while absent adverse-event results reduce the Methodological Rigour assessment. The abstract and five-hypothesis discussion calibrate the main conclusion to rejection of a large effect rather than proof of no effect. Impact remains primarily methodological because both studies use healthy young adult males in one laboratory and address a single paradigm.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
3.8±0.1

Contribution
3.9

Two failed replications materially constrain a previously reported very large effect while preserving uncertainty between a null and a small effect. The advance is meaningful but restricted to one trust paradigm and research group.

Abstract; Discussion, power-analysis paragraphs

“clearly exclude a large effect of OT on trust in this paradigm”

Methodological Rigour
3.4

Both studies use random assignment, double-blind administration, baseline comparisons, and ANOVA plus ordinal regression. No systematic adverse-event results are reported despite administering intranasal oxytocin, which lowers the score within the competent-methods band.

Study 1 Participants and Statistics; Study 2 Participants and Statistics; Ethics Statement; Results

“The administration followed a double-blind procedure”

Reporting
4.1

The paper moves coherently from the original effect through two null studies to five possible explanations and clearly distinguishes exclusion of a large effect from uncertainty about small effects. The studies’ separate parent aims and some conditional field-wide speculation add structural and interpretive friction.

Material and Method opening; Abstract; Discussion

“we do not know which hypothesis is true”

Positioning
4.1

The discussion engages failed replications, meta-analytic skepticism, publication bias, pharmacokinetic uncertainty, and potential moderators. Limitations generally alter the stated scope of interpretation, although Study 1’s conceptual-replication status receives less detailed treatment than other alternatives.

Discussion, opening and five-hypothesis analysis

“Study 1 is not a direct replication of the original study”

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

The principal Envelope Task results are numerically coherent and consistently reported, but one secondary positive result is contingent on outlier removal and the power claim requires careful attention to effect-size scope.

Research ConductClean

Ethics approval, informed consent, random assignment, and double-blind administration are declared. Registration, data availability, code availability, and conflict disclosures are not established by the supplied text but do not constitute demonstrated conduct failures.

Flags: 1 declared / 5 total

Reference IntegrityClean

35 of 35 checkable references verified

36 references in manuscript 1 are books, websites or datasets — counted, but not index-checkable

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaHealth · Generic health relevance
Type of advanceEmpirical
Route to useSuggested
AdvanceAdvances
CitationsFWCI 10.1
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessPiloted
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

Two adequately powered double-blind randomized experiments by the same team consistently showed the null result, but no independent group has yet confirmed it.

From the paper
“they confirm that this paradigm should not be used as a manipulation check”

The paper names a concrete use of its findings, that the Envelope Task should be dropped as a manipulation check, but does not specify who should act on this beyond the research field.

Pathway

Oxytocin and behavioral-science researchers would abandon the Envelope Task as a manipulation check and demand replications before trusting single-study effects.

Barrier

The null findings cannot distinguish a true null from a small or context-dependent effect, so the field lacks the theory and independent evidence needed to change practice decisively.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Heightened play following play observation in the absence of 22-kHz calls in juvenile rats

    Frederic Michon Linde, Marijke Achterberg, Lena V. Kaufmann, et al. · 2026 · Neuroscience

    Primary claim

    observer rats showed increased pinning after play observation in sessions without detected 22-kHz calls

    Supported
    Evidence Score
    3.5±0.1
    Reliability
    Caveats
  2. Oxytocin not only increases trust when money is at stake, but also when confidential information is in the balance

    Moïra Mikolajczak, Nicolas Pinon, Anthony Lane, et al. · 2010 · Clinical medicine

    Primary claim

    Oxytocin does increase trust, and that its effects extend beyond money. Specifically, participants on OT were 44 times more trusting that their privacy would not be violated than participants on placebo.

    Unsupported
    Evidence Score
    2.8±0.2
    Reliability
    Caveats
  3. The oxytocin receptor (OXTR) contributes to prosocial fund allocations in the dictator game and the social value orientations task

    Israel, Lerer, Shalev, et al. · 2009 · Clinical medicine

    Primary claim

    the current investigation demonstrates that common variants in the oxytocin receptor gene, an important element of mammalian social circuitry, underlie such individual differences.

    Unsupported
    Evidence Score
    2.9±0.2
    Reliability
    Caveats

How the rubric works →