nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-07BD8A57·Framework v5.9·Pipeline v0.4·Evaluated 29 Sept 2026·OECD: 5.8 Other Social Sciences·Subfield: Statistics, Probability and Uncertainty·Basis: Full text·Type: Cross-sectional study

Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009-2014

Pablo Dorta-González et al.Pablo Dorta-González, Sara M. González-Betancor, María Isabel Dorta-González·2017·Scientometrics·10.1007/s11192-017-2422-y ↗

Primary claim

there is no generalizable gold OA citation advantage, neither at article nor at journal level

Supported · broad unadjusted category comparisons support the descriptive pattern but cannot identify the effect of OA itself
In brief

A broad multidisciplinary map challenges a universal gold-OA citation advantage, but unadjusted comparisons cannot separate access from selection and journal prestige.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Possible — the claim's weakest requirement is that the effect exists at all. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract not available — view at DOI ↗

Key Claims

Primary finding · Supported

there is no generalizable gold OA citation advantage, neither at article nor at journal level

Possible — the claim's weakest requirement is that the effect exists at all. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

broad unadjusted category comparisons support the descriptive pattern but cannot identify the effect of OA itself

Abstract; Conclusions, p. 9
Quote verified
Secondary · Well-supported

the percentage of OA articles has increased in the time period 2009-2014 in all three indexes

direct 2009 and 2014 prevalence measurements consistently increase across SCIE, SSCI, and AHCI

Conclusions, pp. 8–9; Table 2
Quote verified
Secondary · Supported

Although there are scientific disciplines where the average impact of an article is higher in the case of OA (36 categories), in most disciplines the opposite happens (173 categories)

Table 4 directly reports the category counts, though category aggregation limits interpretation of underlying article-level effects

Conclusions, p. 9; Table 4
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Unusually broad multidisciplinary empirical coverage

The analysis includes 1,137,634 articles from the 2009 Web of Science cohort and reports results across 249 subject categories, substantially broadening the evidence base beyond individual fields.

↳ Abstract; Methodology; Table 1

#methodological rigour

Transparent definitions and descriptive calculations

The paper defines fully gold OA, fixes a six-year citation window, provides the OACA formula, and illustrates its interpretation with a worked example.

↳ Methodology, pp. 3–4; Table 3

#positioning

Balanced framing of contested literature

The Introduction discusses studies both supporting and questioning the OA citation advantage and explicitly distinguishes open-access, early-view, and selection-bias explanations.

↳ Introduction, pp. 2–3

Limitations

#methodological rigour

No control for known confounding

The article compares unadjusted OA and non-OA averages without controlling for journal prestige, article quality, author characteristics, or selection into fully OA journals, although selection bias is identified as necessary to consider.

↳ Introduction, p. 3; Methodology, p. 4

#positioning

Aggregation may conceal important heterogeneity

Results are aggregated at subject-category level, and the Conclusions acknowledge that opposing journal- or article-level effects may create misleading similarity without quantifying that risk.

↳ Conclusions, final paragraph

#application pathway

Limited pathway from evidence to action

The paper identifies no specific policy process, institutional decision, or implementation pathway, and its descriptive design cannot isolate the effect of OA itself.

↳ Methodology; Conclusions

Does this match your read? Add your assessment ↓

Nabu Commentary

The paper's principal value lies in its scale: Table 1 covers all 249 Web of Science subject categories, while Figure 4 adds a journal-level comparison. The descriptive calculations are transparent, and the conclusion that a uniform advantage is not visible in these aggregates follows from Tables 4 and 5. Confidence in interpreting this as an OA effect is substantially lower because the Methodology provides no adjustment for selection bias or journal visibility, despite the Introduction identifying these mechanisms as central. The literature framing and exposition are stronger than the causal identification, placing the paper near the middle of the quality scale overall.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
3.0±0.2

Contribution
3.3

The paper adds a broad descriptive comparison across 249 Web of Science categories and examines both article citations and journal impact factors. Its advance is empirical coverage rather than resolution of why OA and non-OA outcomes differ.

Introduction, final paragraphs; Methodology; Table 1; Figure 4

this paper is the first multidisciplinary study that includes all scientific disciplines

Methodological Rigour
2.5

Gold OA, the citation window, and the OACA calculation are transparently defined, but comparisons rely on unadjusted category averages. Selection bias and journal visibility are acknowledged without matching, adjustment, or sensitivity analysis, binding the observational-methods ceiling.

Introduction, pp. 2–3; Methodology, pp. 3–4; Conclusions, p. 9

any analysis must take into account the effect of time and selection bias

Reporting
4.0

The paper follows a linear progression from the disputed postulate through data construction, article-level results, journal-level results, and conclusions. The OACA formula and worked example aid interpretation, while the main conclusion is expressly framed as what cannot be concluded.

Methodology, p. 4; Table 3; Conclusions, p. 9

it cannot be concluded that gold OA has increased its impact

Positioning
3.2

The Introduction covers both supportive and sceptical OA-citation literature and identifies early-view and selection-bias explanations. The Conclusions disclose journal visibility, APC, and aggregation limitations, but do not quantify how they alter the reported pattern.

Introduction, pp. 2–3; Conclusions, p. 9

there may be advantageous and no-advantageous journals/articles which may counterpart their effects

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

The principal totals and reported correlations are internally coherent, but one large unexplained category discontinuity reduces confidence in comparisons of subject-category prevalence over time. It does not directly affect the 2009 citation comparison underlying the main descriptive result.

Research ConductClean

The bibliometric design does not require human- or animal-subject approval, funding is disclosed, and no visible conflict, registration, or availability claim creates a conduct concern.

Flags: 0 declared / 5 total

Reference IntegrityClean

20 of 20 checkable references verified

21 references in manuscript 1 have no canonical index record — counted, but not index-checkable 1 reference confirmed by manual review

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice · SDG 9
Type of advanceEmpirical
Route to useNot stated
AdvanceExtends
CitationsFWCI 3.8
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessValidated
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The primary claim is tested directly on real-world population data covering over 1.1 million articles across all Web of Science subject categories over a six-year citation window.

The paper draws conclusions about the absence of a gold OA citation advantage but states no real-world use of its own findings, only implications for understanding journal visibility and publishing.

Pathway

Researchers, librarians and research funders deciding where to publish or whether to pay article processing charges could use these findings to weigh gold OA against subscription journals.

Barrier

The observational design does not control for article quality or selection bias, and the findings cover only 2009-2014, so causal claims about open access value remain contested.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Suspected distortion of citations in high-impact cancer journals

    Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications

    Primary claim

    These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.

    Tentative
    Evidence Score
    3.5±0.1
    Reliability
    Caveats
  2. The citation trap: Papers published at year-end receive systematically fewer citations

    Chao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics

    Primary claim

    papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year

    Tentative
    Evidence Score
    3.0±0.2
    Reliability
    Caveats
  3. Quantitative Analysis of the Open Access Citation Advantage

    Masashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences

    Primary claim

    日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

    Tentative
    Evidence Score
    2.9±0.2
    Reliability
    Caveats

How the rubric works →