Loading evaluation data…
Relative to baseline (no System 3 access), accuracy significantly rose when AI was accurate and fell when it erred (+25/-15 percentage points; Study 1), the behavioral signature of cognitive surrender
randomized accuracy contrasts establish AI-dependent performance, but minimal internal scrutiny is inferred rather than directly measured
Time pressure (Study 2) and per-item incentives and feedback (Study 3) shifted baseline performance but did not eliminate this pattern
the AI-Accurate versus AI-Faulty gap persisted across both randomized moderator studies and the pooled synthesis
Engaging System 3 also increased confidence, even following errors
AI access increased confidence, though error-specific confidence was isolated more directly in Study 3 than Study 1
Across studies, participants with higher trust in AI and lower need for cognition and fluid intelligence showed greater surrender to System 3
pooled moderator analyses support the pattern, but individual-difference evidence is correlational and uneven across separate studies
Derived from the full evaluation — not a separate score.
Strengths
Study 1 compares Brain-Only performance with AI-Accurate and AI-Faulty trials, while Studies 2 and 3 reproduce the accuracy gap under time pressure and incentives with feedback.
↳ Study 1, Figure 3; Study 2, Figures 5–6; Study 3, Figures 8–9
The preregistered trial-level synthesis reports a large pooled association between AI correctness and participant correctness, with similar Cohen's h values across all three studies.
↳ General Discussion, Cognitive Surrender Effect Size; Figure 10
The theoretical and discussion sections distinguish the proposal from cognitive offloading and automation bias while addressing both algorithm aversion and algorithm appreciation.
↳ Tri-System Theory of Cognition; Mechanisms Underlying Cognitive Surrender
Limitations
Cognitive surrender is defined as minimal scrutiny and absent deliberation, but the experiments measure consultation, adoption, override, accuracy, and confidence rather than whether internal reasoning occurred.
↳ Table 2; Common Procedures; Cognitive Surrender vs. Cognitive Offloading
Claims about a triadic cognitive ecology and altered autonomy extend beyond seven adapted CRT items, short exposures, and one experimentally controlled AI system.
↳ General Discussion; Societal Implications; Limitations and Future Research Directions
The AI was forced through hidden prompts to provide correct or confidently incorrect answers, and the proposed interface and policy interventions were not tested in naturalistic settings.
↳ Empirical Overview; Societal Implications; Limitations and Future Research Directions
The strongest evidence is the repeated randomized contrast showing that participant accuracy tracks whether AI advice is correct or faulty, supported by the trial-level synthesis and consistent per-study effect sizes. Preregistration, Brain-Only comparisons, repeated-trial modeling, and replication across settings support a quality score in the competent-execution band. The main downward pressure comes from the definition of cognitive surrender as absent deliberation, because the experiments observe behavior but do not directly identify the internal process distinguishing surrender from assisted reasoning. The controlled CRT paradigm and forced AI-error manipulation also limit transfer to the broad societal domains discussed.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Sound3.6
Confidence mediumThe randomized AI-accuracy paradigm and replication across three experiments meaningfully extend evidence on human reliance on AI advice. The empirical advance is clearer than the claim that Tri-System Theory establishes a distinct cognitive architecture.
accuracy significantly rose when AI was accurate and fell when it erred
Randomized trial type, Brain-Only comparisons, preregistration, and mixed-effects models fit the repeated-trial behavioral question. The design does not directly observe the absence of deliberation required by the paper's definition of cognitive surrender.
Minimal internal engagement.
The paper presents a traceable theory-to-hypothesis-to-study sequence and reports its main contrasts with effect sizes and confidence intervals. Its abstract and conclusion sometimes convert observed consultation and adoption into stronger claims about bypassed internal cognition.
often surrender to its outputs
The discussion engages dual-process criticism, cognitive offloading, automation bias, algorithm aversion, and algorithm appreciation. Its limitations identify the controlled setting, CRT specificity, and single exposure, although the broader societal claims are not always narrowed accordingly.
may limit generalizability to real-world settings
Caveats4 of 4 checks
The principal numerical results are coherent, but the reported synthesis sample has a minor unresolved arithmetic discrepancy and the interpretation of adoption as minimal-scrutiny surrender is not fully identified by the observed measures.
IRB approval, informed consent, debriefing, preregistration, and OSF availability are declared in the Data Collection and Empirical Overview sections. External materials were not supplied for verification, which is an assessability gap rather than a conduct concern.
Flags: 3 declared / 5 total
56 of 56 checkable references verified
59 references in manuscript 3 have no canonical index record — counted, but not index-checkable 4 references confirmed by manual review
No retraction notice found in Retraction Watch.
Sources: Retraction Watch ✓
Where this paper’s evidence sits on the path from initial observation to real-world use.
The studies provide a replicated laboratory proof of concept and identify feedback and incentives as candidate intervention levers. They do not test those levers in operational healthcare, finance, legal, or educational settings.
Future research should extend these findings using field experiments outside the lab
AI-generated, human-governed. Something look off? Contact us to request a review.