Global scale across multiple dimensions
The analysis covers 19 million outputs and 420 million citation links, measuring diversity by institutions, countries, subregions, regions, and fields of research.
↳ Contribution and Method, pp. 827–833
Abstract The goal of open access is to allow more people to read and use research outputs. An observed association between highly cited research outputs and open access has been claimed as evidence of increased usage of the research, but this remains controversial. A higher citation count also does not necessarily imply wider usage such as citations by authors from more places. A knowledge gap exists in our understanding of who gets to use open access research outputs and where users are located. Here we address this gap by examining the association between an output’s open access status and the diversity of research outputs that cite it. By analysing large-scale bibliographic data from 2010 to 2019, we found a robust association between open access and increased diversity of citation sources by institutions, countries, subregions, regions, and fields of research, across outputs with both high and medium–low citation counts. Open access through disciplinary or institutional repositories showed a stronger effect than open access via publisher platforms. This study adds a new perspective to our understanding of how citations can be used to explore the effects of open access. It also provides new evidence at global scale of the benefits of open access as a mechanism for widening the use of research and increasing the diversity of the communities that benefit from it.
we found a robust association between open access and increased diversity of citation sources by institutions, countries, subregions, regions, and fields of research, across outputs with both high and medium–low citation counts
large observational corpus and extensive robustness checks support direction, but residual selection and coverage limitations remain
Open access through disciplinary or institutional repositories showed a stronger effect than open access via publisher platforms.
GREEN generally exceeds GOLD across reported comparisons, though overlapping categories and residual selection limit interpretation
It also provides new evidence at global scale of the benefits of open access as a mechanism for widening the use of research and increasing the diversity of the communities that benefit from it.
observational citation diversity cannot identify OA-caused wider use or the full communities benefiting
the citation diversity advantage also accrues preferentially to traditionally prestigious centres of research.
regional citation-flow patterns support the direction, with incomplete bibliographic coverage limiting geographic inference
Derived from the full evaluation — not a separate score.
Strengths
The analysis covers 19 million outputs and 420 million citation links, measuring diversity by institutions, countries, subregions, regions, and fields of research.
↳ Contribution and Method, pp. 827–833
The reported pattern is checked across publication years, two diversity indices, OA categories, equal-sized samples, fields, and 14 citation-count bins.
↳ Robustness of results, pp. 837–840; Supplementary Figures A–N
The paper discusses randomized null results, author self-selection, prestige, discipline, and resource access, then explicitly limits its conclusion to an observational association.
↳ Introduction, p. 826; Results, p. 836; Discussion, pp. 840–841
Limitations
Citation-count stratification reduces one source of confounding but does not independently adjust for discipline, institutional prestige, author characteristics, or research-resource context.
↳ Method, p. 827; Results, pp. 834–836; Discussion, pp. 840–841
Crossref-only DOI coverage, MAG inclusion, and the exclusion of outputs with fewer than two citations constrain regional and disciplinary generalization without quantitative bias bounds.
↳ Input data, pp. 832–833; Data limitations, pp. 841–842
The Abstract describes OA as a mechanism widening use, and the Conclusion treats diverse citing outputs as wider use, although the study identifies an observational association in a narrow proxy.
↳ Abstract, final sentence; Conclusion, pp. 842–843
The study’s contribution rests on combining global scale with a citation-diversity framing that extends beyond conventional citation counts. The methodology gains credibility from repeated analyses across time, measures, OA categories, fields, samples, and citation-count bins, but those checks do not fully adjust for selection into OA or quantify bibliographic coverage bias. The paper’s literature positioning and limitations discussion are substantive, including explicit treatment of randomized null evidence and regional data gaps. Scores are moderated chiefly because some Abstract and Conclusion wording turns an observational citation association into stronger claims about OA-driven benefits and wider use.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
The study extends citation-diversity analysis from narrow prior samples to 19 million outputs and five institutional, geographic, and disciplinary groupings. The advance is meaningful but uses standard diversity indices in an observational extension rather than introducing causal identification or a new analytic method.
“making it the largest study of this type to date”
The workflow defines the corpus, two diversity indices, and extensive checks across years, measures, citation bins, samples, fields, and OA categories. Crossref/MAG selection and classification errors are not quantitatively bounded, and citation-count stratification does not resolve all residual OA-selection confounding.
“our analysis is not able to confirm the exact causal links”
The article has a coherent progression from motivation and methods through results, robustness, limitations, and conclusion. Reporting is reduced when the Abstract and Conclusion describe causal benefits and wider use more strongly than the observational citation proxy establishes.
“benefits of open access as a mechanism for widening the use of research”
The paper engages randomized null evidence, self-selection, prestige, disciplinary confounding, and the two closest diversity studies. Its limitations discussion connects coverage problems to regional findings, although the magnitude of those effects on the headline association is not quantitatively bounded.
“there may be limitations in our coverage of certain areas of Asia, Sub-Saharan Africa and other regions”
Caveats4 of 4 checks
The reported corpus, methods, and descriptive findings are internally consistent, and the paper explicitly disclaims causal identification. Some Abstract, Results, and Conclusion wording nevertheless shifts from association in citation-based proxies toward causal benefits and wider use.
Funding and competing interests are disclosed, the study uses bibliographic metadata rather than human-subject data, and processed data and analysis code are claimed available through Zenodo and GitHub. One or more identifiers named in the paper's availability or registration statements did not resolve when checked on 2026-09-28T16:08:08.243051+00:00: https://github.com/Curtin-Open-Knowledge-Initiative/citation-diversity. Recorded as a discrepancy between the paper's claims and the cited sources; not an assessment of the underlying research.
Flags: 3 declared / 5 total
21 of 21 checkable references verified
25 references in manuscript 4 are books, websites or datasets — counted, but not index-checkable
References not verified automatically are resolved manually within 24 hours.
No retraction or expression of concern found in Crossref (includes Retraction Watch).
Sources: Crossref (incl. Retraction Watch) ✓
The association is demonstrated on population-scale real-world bibliographic data (19 million outputs, 420 million citation links), consistent across years, regions, fields, measures, and citation-count strata.
“a potential insight into where the benefits of OA are being seen and a guide to improving our policy implementation of OA for wider access”
The conclusion names a real-world use, guiding open-access policy implementation, but names no specific actor, organisation or setting that would act on the findings.
Open-access policymakers, funders and university administrators could use citation diversity evidence to justify repository and open-access mandates that widen who uses research.
The observational design cannot rule out confounding such as author self-selection and institutional prestige, leaving the causal benefit of open access unproven.
Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3
AI-generated, human-governed. Something look off? Contact us to request a review.
Keep reading
Other papers Nabu has evaluated blind, starting with the same field.
Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications
These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.
TentativeChao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics
papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year
TentativeMasashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences
日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.
Tentative