# An empirical analysis of open access citation advantages in library and information science

- **DOI:** [10.47989/ir31iconf64133](https://doi.org/10.47989/ir31iconf64133)
- **Rating:** Limited (2.6 out of 5)
- **Verdict:** A useful field-specific map of OA citation patterns whose unadjusted observational design cannot establish that OA choices produce the reported differences.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-28
- **Evaluation page:** https://www.nabu.science/paper/10.47989%2Fir31iconf64133

## Key claims

1. Non-OA articles received slightly more citations (mean 18.83) than OA articles (mean 17.9), though the difference was minimal.
   - Support: Supported
   - Type: Primary finding
   - Basis: the reported means and tiny effect agree, but the aggregate comparison is unadjusted for temporal composition and other confounders
   - Location: Abstract; Results, Tables 2–3
2. Green OA showed the largest citation advantage (28.55 average).
   - Support: Supported
   - Type: Secondary
   - Basis: OA-type means and pairwise tests agree, but age, self-selection, and OA-designation error remain uncontrolled
   - Location: Abstract; Results, Tables 4–6
3. OA citation advantages declined from 9.75 citations (2001–2004) to 0.74 (2020–2024).
   - Support: Supported
   - Type: Secondary
   - Basis: period-specific means show the stated decline, although citation exposure is not age-normalised within periods
   - Location: Abstract; Results, Table 8 and Figure 6
4. Interdisciplinary articles benefitted more from OA
   - Support: Tentative
   - Type: Secondary
   - Basis: unadjusted subgroup differences do not establish an OA benefit or formally test the claimed moderation
   - Location: Conclusion, p. 1748

## Strengths

- **Large field-specific longitudinal evidence base** The analysis covers 109,759 WoS-indexed LIS articles from 2001–2024 and separates results by OA type, period, disciplinary scope, and journal quartile.
  - Dimension: contribution
  - Location: Methods, pp. 1736–1738; Tables 4 and 7–9
- **Effect sizes temper significance claims** Welch tests are paired with nonparametric checks, and Cohen’s d is used to show that several statistically significant contrasts are practically very small.
  - Dimension: methodological rigour
  - Location: Methods, p. 1738; Tables 3, 8, and 9
- **Aggregate contradiction addressed openly** The paper explicitly contrasts the overall non-OA mean advantage with the within-period OA advantages and explains the weighting and citation-accrual pattern behind them.
  - Dimension: reporting
  - Location: Time-series analysis, pp. 1744–1745; Figure 5

## Limitations

- **Central comparisons leave confounding uncontrolled** Separate stratification by period, quartile, and disciplinary scope does not jointly control article age, author and journal characteristics, topic, or self-selection into OA routes.
  - Dimension: methodological rigour
  - Location: Methods, pp. 1736–1738; Tables 2 and 4–9
- **Benefit language exceeds observational design** The Conclusion states that interdisciplinary articles “benefitted more from OA,” although Table 7 reports unadjusted subgroup contrasts and no formal interaction or causal identification.
  - Dimension: reporting
  - Location: Table 7, p. 1743; Conclusion, p. 1748
- **Consequential limitations remain underdeveloped** The paper does not trace its MIS-category caveat, large Library Journal exclusion, JCR restriction, or OA-classification uncertainty through to the affected conclusions.
  - Dimension: positioning
  - Location: Methods, pp. 1736–1737; Discussion and Conclusion, pp. 1747–1748

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Noted. The tabulated results are broadly internally consistent, but the Discussion misstates the statistical status of the late-period temporal result. This affects interpretation rather than the reported database values themselves.
- **Research conduct:** Clean. The study uses secondary bibliometric records, declares institutional funding, and makes no data- or code-availability claim requiring verification. No human-subjects ethics declaration or preregistration is required for the reported design.
- **Reference integrity:** Clean. 17 of 17 checkable references verified
  - 19 references in manuscript
  - 2 have no canonical index record — counted, but not index-checkable
  - 2 references confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
