nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-BD44CD8F·Framework v5.9·Pipeline v0.4·Evaluated 28 Sept 2026·OECD: 5.8 Other social sciences·Subfield: Statistics, Probability and Uncertainty·Basis: Full text·Type: Cross-sectional study

Does open access foster interdisciplinary citations? Decomposing open access citation advantage

Kai Nishikawa et al.Kai Nishikawa, Akiyoshi Murakami·2025·Scientometrics·10.1007/s11192-025-05297-z ↗

Primary claim

OA increased both interdisciplinary and within-discipline citations in many fields studied, and only interdisciplinary citations in chemistry, computer science, and clinical medicine.

Tentative · causal wording applied to unadjusted observational citation ratios with residual selection and article-level confounding
In brief

A useful decomposition of OA citation patterns across fields, constrained by causal conclusions that its observational comparisons cannot establish.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Unlikely to hold — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract

Abstract The existence of an open access (OA) citation advantage—that is, whether OA increases citations—has been a topic of interest for many years. Although numerous studies have focused on whether OA increases citations, expectations for OA go beyond that. One such expectation is the promotion of knowledge transfer across various fields. This study aimed to clarify what effects OA, particularly gold OA, has on knowledge transfer across fields. Specifically, we measure the effect of OA on interdisciplinary and within-discipline citation counts by decomposing an existing OA citation advantage metric. OA increased both interdisciplinary and within-discipline citations in many fields studied, and only interdisciplinary citations in chemistry, computer science, and clinical medicine. In these three fields, clinical medicine showed a tendency toward interdisciplinary citations, independent of journal or paper. These findings suggest that OA fosters knowledge transfer across disciplines.

Key Claims

Primary finding · Tentative

OA increased both interdisciplinary and within-discipline citations in many fields studied, and only interdisciplinary citations in chemistry, computer science, and clinical medicine.

Unlikely to hold — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

causal wording applied to unadjusted observational citation ratios with residual selection and article-level confounding

Abstract
Quote verified
Secondary · Tentative

These findings suggest that OA fosters knowledge transfer across disciplines.

interdisciplinary citation counts do not identify OA-caused knowledge transfer

Abstract; Conclusion, pp. 2979–2980
Quote verified
Secondary · Tentative

The analysis revealed that OA fostered interdisciplinary citations in 13 out of the 18 natural science fields examined.

field-level associations are reported, but the observational comparison cannot establish that OA fostered them

Conclusion, pp. 2979–2980
Secondary · Tentative

clinical medicine OA papers were more frequently cited across different fields, not because they covered different topics than non-OA papers, but because OA has improved the availability of these papers.

topic similarity does not identify improved availability as the causal mechanism

Results and Discussion, p. 2978
Quote verified
Secondary · Well-supported

A high IOACA in chemistry and computer science was largely driven by specific journals or highly-cited papers, whereas in clinical medicine it appears to be a characteristic of the entire field.

journal, quartile, and paper-level breakdowns directly show concentration in chemistry and computer science

Results, pp. 2973–2975

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Clear interdisciplinary citation decomposition

The paper separates aggregate OA citation advantage into IOACA and WOACA, allowing field-level citation differences to be distinguished by whether citing papers come from within or outside the field.

↳ Introduction, pp. 2966–2967; Methods, pp. 2968–2969

#methodological rigour

Transparent large-scale corpus construction

The analysis uses a large 2017 SCIE cohort, a six-year citation window, and DOAJ matching to avoid treating current OA status as evidence of original gold-OA publication.

↳ Methods, pp. 2967–2968

#methodological rigour

Heterogeneity examined below field level

JIF-quartile and journal-level analyses show that chemistry and computer-science results are concentrated in particular journals or papers rather than presenting every positive field average as uniform.

↳ Figure 4; Tables 2–3; Results, pp. 2973–2975

Limitations

#methodological rigour

Confounding remains materially uncontrolled

The headline analysis compares raw average citation ratios, while JIF quartiles provide only a coarse descriptive check. Selection into gold OA and article-, author-, journal-, and topic-level differences remain plausible explanations for the associations.

↳ Literature Review, p. 2965; Methods, pp. 2968–2969; Figure 4

#reporting

Causal language exceeds study design

The Abstract and Conclusion state that OA “increased” citations and “fostered” knowledge transfer, although the observational analysis does not identify an OA-caused effect.

↳ Abstract; Conclusion, pp. 2979–2980

#application pathway

Scope limits broader policy use

The analysis covers one 2017 cohort of gold-OA, WoS-indexed natural-science papers using coarse, mutually exclusive ESI fields. Transfer to other databases, disciplines, years, and OA routes remains untested.

↳ Methods, pp. 2967–2968; Limitations, pp. 2979–2980

Does this match your read? Add your assessment ↓

Nabu Commentary

The IOACA/WOACA decomposition is a meaningful descriptive extension of OA citation-advantage research, supported by a large corpus and transparent metric definitions. Annual, JIF-quartile, and journal-level analyses add useful checks and reveal that some field-level results are concentrated in particular venues or papers. The central weakness is inferential: raw OA/non-OA citation ratios do not isolate OA from selection and other confounding processes. Because the Abstract and Conclusion nevertheless describe OA as increasing citations and fostering knowledge transfer, the paper requires major revision to align its claims and limitations with the observational evidence.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
2.8±0.1

Contribution
3.7

The IOACA/WOACA decomposition clearly extends aggregate OA citation-advantage analysis and is applied across 18 fields. Its advance is meaningful but descriptive, and the asserted accessibility mechanism is not identified by the design.

Introduction, pp. 2966–2967; Methods, pp. 2968–2969; Results, pp. 2972–2978

“We also decomposed the OACA to explore whether OA increases the number of interdisciplinary citations.”

Methodological Rigour
2.0

The study uses a large, transparently constructed cohort, a six-year citation window, DOAJ cross-checking, annual comparisons, and JIF-quartile analyses. Raw OA/non-OA ratios nevertheless leave selection and article-level confounding uncontrolled, while the paper makes causal claims.

Methods, pp. 2967–2969; Figures 3–4; Conclusion, pp. 2979–2980

“The analysis revealed that OA fostered interdisciplinary citations in 13 out of the 18 natural science fields examined.”

Reporting
3.3

The progression from research questions to metric definitions, field groups, and focused case studies is easy to follow. Precision falls at the headline level because “increased” and “fosters” imply causal effects not isolated by the analysis.

Abstract; Methods, pp. 2968–2969; Conclusion, pp. 2979–2980

“These findings suggest that OA fosters knowledge transfer across disciplines.”

Positioning
3.1

The paper positions IOACA against OA citation-advantage and citation-diversity research and discusses a complicating clinical-medicine finding. It identifies selection bias in the literature but does not trace residual confounding through the limitations or causal conclusion.

Literature Review, pp. 2964–2967; Discussion and Implications, pp. 2978–2980

“the selection bias postulate states that papers authored by reputable authors or those of higher quality are more likely to be made OA”

Lower confidence on Contribution, Positioning — domain match limited.

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

The reported descriptive results are internally consistent, but the causal wording of the central interpretation exceeds what the observational comparisons identify.

Research ConductClean

The paper identifies the proprietary bibliometric sources and analysis tools, declares no funding or competing interests, and involves no human-subject procedure requiring ethics approval.

Flags: 1 declared / 5 total

Reference IntegrityClean

32 of 32 checkable references verified

36 references in manuscript 4 are books, websites or datasets — counted, but not index-checkable

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice
Type of advanceMethodological
Route to useNamed
AdvanceExtends
CitationsToo early
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessValidated
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The primary claim is tested on total population data of over 1.5 million Web of Science papers across 18 fields with a six-year citation window, representing large-scale real-world bibliometric data, though limited to one database and gold OA only.

From the paper
“the findings will provide policymakers, research funders, academic libraries, and individual researchers with a rationale for promoting OA.”

The paper names specific actors (policymakers, research funders, academic libraries, researchers) and the purpose (a rationale for promoting OA), but does not specify the concrete decision or mechanism by which they would apply it.

Pathway

Policymakers, research funders and academic libraries would use these findings as evidence to justify and shape open access mandates, APC subsidies and publishing policies.

Barrier

The findings rest on a single database, one field classification system and gold OA only, so robustness across other datasets, classifications and OA types must be confirmed before policy reliance.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Suspected distortion of citations in high-impact cancer journals

    Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications

    Primary claim

    These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.

    Tentative
    Evidence Score
    3.5±0.1
    Reliability
    Caveats
  2. The citation trap: Papers published at year-end receive systematically fewer citations

    Chao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics

    Primary claim

    papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year

    Tentative
    Evidence Score
    3.0±0.2
    Reliability
    Caveats
  3. Quantitative Analysis of the Open Access Citation Advantage

    Masashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences

    Primary claim

    日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

    Tentative
    Evidence Score
    2.9±0.2
    Reliability
    Caveats

How the rubric works →