# Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009-2014

- **DOI:** [10.1007/s11192-017-2422-y](https://doi.org/10.1007/s11192-017-2422-y)
- **Rating:** Sound (3.0 out of 5)
- **Verdict:** A broad multidisciplinary map challenges a universal gold-OA citation advantage, but unadjusted comparisons cannot separate access from selection and journal prestige.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-29
- **Evaluation page:** https://www.nabu.science/paper/10.1007%2Fs11192-017-2422-y

## Key claims

1. there is no generalizable gold OA citation advantage, neither at article nor at journal level
   - Support: Supported
   - Type: Primary finding
   - Basis: broad unadjusted category comparisons support the descriptive pattern but cannot identify the effect of OA itself
   - Location: Abstract; Conclusions, p. 9
2. the percentage of OA articles has increased in the time period 2009-2014 in all three indexes
   - Support: Well-supported
   - Type: Secondary
   - Basis: direct 2009 and 2014 prevalence measurements consistently increase across SCIE, SSCI, and AHCI
   - Location: Conclusions, pp. 8–9; Table 2
3. Although there are scientific disciplines where the average impact of an article is higher in the case of OA (36 categories), in most disciplines the opposite happens (173 categories)
   - Support: Supported
   - Type: Secondary
   - Basis: Table 4 directly reports the category counts, though category aggregation limits interpretation of underlying article-level effects
   - Location: Conclusions, p. 9; Table 4

## Strengths

- **Unusually broad multidisciplinary empirical coverage** The analysis includes 1,137,634 articles from the 2009 Web of Science cohort and reports results across 249 subject categories, substantially broadening the evidence base beyond individual fields.
  - Dimension: contribution
  - Location: Abstract; Methodology; Table 1
- **Transparent definitions and descriptive calculations** The paper defines fully gold OA, fixes a six-year citation window, provides the OACA formula, and illustrates its interpretation with a worked example.
  - Dimension: methodological rigour
  - Location: Methodology, pp. 3–4; Table 3
- **Balanced framing of contested literature** The Introduction discusses studies both supporting and questioning the OA citation advantage and explicitly distinguishes open-access, early-view, and selection-bias explanations.
  - Dimension: positioning
  - Location: Introduction, pp. 2–3

## Limitations

- **No control for known confounding** The article compares unadjusted OA and non-OA averages without controlling for journal prestige, article quality, author characteristics, or selection into fully OA journals, although selection bias is identified as necessary to consider.
  - Dimension: methodological rigour
  - Location: Introduction, p. 3; Methodology, p. 4
- **Aggregation may conceal important heterogeneity** Results are aggregated at subject-category level, and the Conclusions acknowledge that opposing journal- or article-level effects may create misleading similarity without quantifying that risk.
  - Dimension: positioning
  - Location: Conclusions, final paragraph
- **Limited pathway from evidence to action** The paper identifies no specific policy process, institutional decision, or implementation pathway, and its descriptive design cannot isolate the effect of OA itself.
  - Dimension: application pathway
  - Location: Methodology; Conclusions

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Noted. The principal totals and reported correlations are internally coherent, but one large unexplained category discontinuity reduces confidence in comparisons of subject-category prevalence over time. It does not directly affect the 2009 citation comparison underlying the main descriptive result.
- **Research conduct:** Clean. The bibliometric design does not require human- or animal-subject approval, funding is disclosed, and no visible conflict, registration, or availability claim creates a conduct concern.
- **Reference integrity:** Clean. 20 of 20 checkable references verified
  - 21 references in manuscript
  - 1 have no canonical index record — counted, but not index-checkable
  - 1 reference confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
