Crunching the numbers. Responsibly.
The most rigorous study to date, conducted in the field of condensed matter physics, showed that after controlling for a clearly demonstrated Early View postulate, the remaining difference in citation counts between OA and non-OA articles is explained by the Selection Bias postulate.
the field-specific benchmark analysis supports the direction, but observational evidence and limited disciplinary coverage constrain certainty
Even the most robust methods developed to date are unable to show causality unequivocally, nor can they generalize the observed effects at the author level or across a large number of varied disciplines.
the surveyed studies remain observational and the review consistently identifies unresolved confounding and disciplinary variation
When both the Early View effect and the Selection Bias effect were controlled for, the magnitude of the CID across all 24 major physics journals was variable but averaged just 7%.
the reported estimate is directly scoped to the reviewed physics analysis and retains acknowledged field limitations
Derived from the full evaluation — not a separate score.
Strengths
The Executive overview and pp. 13–16 distinguish the OA, Selection Bias, and Early View postulates and apply them as a common interpretive structure across heterogeneous studies.
↳ Executive overview, p. 4; Deconstructing the Open Access citation effect, pp. 13–16
The review analyzes both Lawrence's reported citation advantage and Anderson et al.'s disadvantage, then traces methodological problems in each rather than treating either result as decisive.
↳ Correlations of online availability and increased citations, pp. 7–9
The conclusion calls for fixed citation windows, controls for selection and early-view effects, cross-disciplinary replication, and randomized OA treatment where practical.
↳ Conclusions, pp. 17–18
Limitations
The Introduction states that the article surveys the original research literature but provides no databases, search terms, date limits, or inclusion criteria. Readers therefore cannot assess the completeness or reproducibility of the evidence base.
↳ Introduction, p. 5
The claim that science is driven “not by access, but by discovery” generalizes beyond the condensed-matter and physics-focused evidence that the review identifies as most rigorous.
↳ Conclusions, p. 18
The title page lists affiliations with two commercial publishers and a citation-index provider, but the article contains no explicit conflict-of-interest statement addressing those interests.
↳ Title page; Acknowledgements, p. 19
The three-postulate structure and the detailed treatment of citation windows, skewness, and selection effects support a quality score in the upper competent range. The study-by-study discussion engages results both favorable and unfavorable to OA, so the evidence does not establish serious one-sided marshalling. The absence of a search and inclusion method remains a material craft limitation for a review making claims about the state of a literature. The final “not by access, but by discovery” formulation also lowers clarity because it reaches beyond the condensed-matter and physics-focused evidence emphasized elsewhere.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Strong3.8
Confidence mediumThe review provides a timely methodological synthesis by organizing heterogeneous OA-citation studies around access, selection, and timing explanations. Its originality is bounded because the article credits Kurtz et al. with first formalizing those postulates.
“Kurtz et al. were the first to formalize these possible explanations”
The review compares study samples, citation windows, aggregation choices, and confounders across findings both favorable and unfavorable to an OA advantage. It does not report a search strategy, databases, or inclusion criteria, leaving the completeness and selection of the reviewed literature unreproducible.
“we survey the original research literature on this topic to date”
Definitions, methodological problems, and the three-postulate framework create a readily traceable argument from correlation to causal alternatives. The final statement that science is driven “not by access, but by discovery” is broader than the discipline-bound evidence and preceding caveats support.
“the process of science is driven not by access, but by discovery”
The review substantively discusses positive, negative, and residual OA-citation findings and repeatedly identifies disciplinary and causal limitations. Its final interpretive tone is firmer than warranted by its acknowledgment that the benchmark evidence cannot be generalized across disciplines.
“generality cannot be assumed across all areas of research”
Caveats3 of 4 checks
The review is internally consistent overall, but its broad closing statement about science being driven by discovery rather than access is stronger than the field-specific synthesis immediately preceding it.
No ethics approval, preregistration, or data-release requirement arises for this narrative review. Commercial publishing and citation-index affiliations are listed, but no explicit conflict-of-interest statement accompanies them.
Flags: 0 declared / 5 total
Reference integrity check could not run: no references section detected in extracted text.
0 references in manuscript
No retraction notice found in Retraction Watch.
Sources: Retraction Watch ✓
Where this paper’s evidence sits on the path from initial observation to real-world use.
The principal actionable output is methodological guidance for future citation studies, including fixed windows and controls for selection and early availability. It is a synthesis rather than an operational intervention or implementation protocol.
“Such studies need to ensure that the signature skewed distribution of citation patterns is not casually assigned”
AI-generated, human-governed. Something look off? Contact us to request a review.