Loading evaluation data…
Limitation: This content is identified as Editorial / Commentary. Evaluation of this content might be partial, and should be treated as indicative.
A study published today in PLoS Biology provides robust evidence that open-access articles are more immediately recognized and cited than non-OA articles. This editorial provides some additional follow up data from the most recent analysis of the same cohort in April 2006, 17 to 21 months after publication. These data suggest that the citation gap between open access and non-open access papers continues to widen. I conclude with the observation that the "open access advantage" has at least three components: (1) a citation count advantage (as a metric for knowledge uptake within the scientific community), (2) an end user uptake advantage, and (3) a cross-discipline fertilization advantage. More research is needed, and JMIR is inviting research on all aspects of open access. As the advantages for publishing open access from a researchers' point of view become increasingly clear, questions around the sustainability of open access journals remain. This journal is a living example that "lean publishing" models can create successful open access journals. Open source tools which have been developed by the Public Knowledge Project at the University of British Columbia with contributions from the Epublishing & Open Access group at the Centre for Global eHealth Innovation in Toronto are an alternative to hosting journals on commercial open access publisher sites.
These data suggest that the citation gap between open access and non-open access papers continues to widen
a single hybrid-journal cohort shows a widening unadjusted gap, with adjusted results deferred to the companion study
the “open access advantage” has at least three components: (1) a citation count advantage, (2) an end user uptake advantage, and (3) a cross-discipline fertilization advantage
two components depend on journal anecdotes, personal observation, and unpublished preliminary analysis
This citation advantage remains significant even when adjusted in multivariate regression models to correct for differences in article and author characteristics
the adjusted models are not shown in the editorial and are deferred to the companion publication
This journal is a living example that lean publishing models can create successful open access journals
no financial or comparative sustainability evidence is reported for the journal's self-referential claim
Derived from the full evaluation — not a separate score.
Strengths
The Beyond Citations section separates scientific citation uptake from end-user access and cross-disciplinary diffusion, giving subsequent research distinct mechanisms to investigate.
↳ Beyond Citations, summary paragraph
The citation section identifies confounding, cross-sectional analysis, and time since publication as important limitations in earlier open-access comparisons.
↳ Citation Advantage of Open Access Articles, paragraphs 4–5
The cohort is described as part of a planned multi-year series, and the editorial directly invites original research on open-access effects and ramifications.
↳ Citation Advantage of Open Access Articles, paragraph 2; More Research Needed: A Call for Papers
Limitations
End-user uptake rests on anecdotal reports, while cross-discipline fertilization relies on personal observation and preliminary unpublished analysis. Both are nevertheless incorporated into a firm three-component conclusion.
↳ Beyond Citations
The PNAS design allowed authors to choose and pay for immediate open access. The editorial invokes an independent effect after multivariable adjustment without discussing remaining unmeasured selection.
↳ Citation Advantage of Open Access Articles, paragraphs 2–3 and 6
The Sustainability section promotes JMIR's lean model and criticizes larger publishers without reporting revenue, cost, or other comparative viability measures.
↳ Sustainability
The additional PNAS follow-up supports a widening unadjusted citation gap, while adjusted analyses are deferred to the companion study and supplement. The editorial's clearest contribution is its separation of citation, end-user, and cross-disciplinary benefits, but only the citation component receives cohort-based support. Anecdotes and unpublished observations do not sustain the same level of certainty for the other components. The sustainability discussion further broadens the argument without comparative financial evidence, making the article more persuasive and agenda-setting than evidentially conclusive.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Limited2.4
Confidence highThe editorial adds a three-component taxonomy of open-access advantage and one additional follow-up point to an existing cohort study. Its substantive advance remains limited because end-user uptake and cross-discipline fertilization rely on anecdotes and unpublished analysis.
“the open access advantage really has at least three components”
The progression from citation evidence to broader mechanisms is traceable, but the broader framework and sustainability case are supported asymmetrically and without comparative evidence. Distinct serious failures in evidence marshalling and assertion bind the score at 2.0.
“Preliminary (yet unpublished) analysis”
Subheadings and explicit enumeration make the argument easy to follow. Certainty is less well calibrated because two proposed components are framed as established advantages despite their anecdotal or preliminary support.
“has at least three components”
The article distinguishes gold-road evidence from earlier self-archiving studies and cites a skeptical view. It does not address residual author self-selection in the hybrid-journal cohort and does not fully carry acknowledged uncertainty into its summary framework.
“further research into the more qualitative advantages”
Lower confidence on Reporting, Positioning — domain match limited.
Caveats4 of 4 checks
The article is structurally coherent, but its declarative framing exceeds the evidence it reports for the broader open-access framework and causal interpretation of the citation association.
The author's institutional interests are visible, but the editorial promotes the author's journal, solicitation activity, and publishing tools while making unsupported comparative sustainability claims.
Flags: 1 declared / 5 total
8 of 8 checkable references verified
10 references in manuscript 2 are books, websites or datasets — counted, but not index-checkable
No retraction notice found in Retraction Watch.
Sources: Retraction Watch ✓
Where this paper’s evidence sits on the path from initial observation to real-world use.
The editorial frames a research agenda rather than an intervention or implementation approach. Two proposed mechanisms lack tested measures, leaving a long path to decision-ready use.
“much more rigorous research is required”
AI-generated, human-governed. Something look off? Contact us to request a review.