# Quantitative Analysis of the Open Access Citation Advantage

- **DOI:** [10.2964/jsik_2022_019](https://doi.org/10.2964/jsik_2022_019)
- **Rating:** Limited (2.9 out of 5)
- **Verdict:** A useful Japanese OA-type comparison that isolates institutional repositories, but observational identification cannot support its causal interpretation.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-10-05
- **Evaluation page:** https://www.nabu.science/paper/10.2964%2Fjsik_2022_019

## Key claims

1. 日本の機関リポジトリによるオープンアクセス論文の数は限られるものの，その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは，日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった．
   - Support: Tentative
   - Type: Primary finding
   - Basis: 限定的な横断比較で標本規模と信頼区間が示されず，意味のある優位性を除外できない
   - Location: Abstract / Discussion §4
2. OAステータスをクローズドからグリーンOA（機関）にすることによる被引用数の変化率は0.99倍
   - Support: Tentative
   - Type: Secondary
   - Basis: 横断的回帰はOAステータス変更による因果的変化を識別しない
   - Location: Discussion §4
3. ハイブリッドOA，グリーンOA（分野），ブロンズOA，グリーンOA（機関），ゴールドOAの順に係数が高い
   - Support: Supported
   - Type: Secondary
   - Basis: 報告された点推定値の順序とは一致するが，群間差の検定は示されていない
   - Location: Results §3; Discussion §4

## Strengths

- **Distinct institutional and disciplinary green OA** The analysis separates institutional-repository green OA from disciplinary green OA, directly addressing the gap stated in the introduction. This creates a more policy-relevant comparison for Japanese repository managers.
  - Dimension: contribution
  - Location: Introduction §1; Methods §2.2
- **Large sample with suitable count model** The study analyzes 87,359 Japanese-affiliated 2017 articles using negative-binomial regression and a stated set of bibliometric controls. The model family fits the count nature of citation outcomes.
  - Dimension: methodological rigour
  - Location: Methods §§2.2–2.3
- **Concrete repository stakeholder pathway** The paper links its question to Japanese libraries seeking author deposits and identifies institutional-repository communities as the audience for action. The approximately 50% request-success figure makes the operational problem visible.
  - Dimension: application pathway
  - Location: Introduction §1; Discussion §4

## Limitations

- **Causal interpretation exceeds observational design** Methods §2.1 claims the coefficients isolate differences caused by OA type, and §§3–4 describe citation changes resulting from switching OA status. The cross-sectional regression supports adjusted associations, not those interventional interpretations.
  - Dimension: methodological rigour
  - Location: Methods §2.1; Results §3; Discussion §4
- **Null estimate lacks reported precision** The institutional-green estimate is 0.99 and nonsignificant, but the paper acknowledges that the group is limited without reporting its size or a confidence interval in the supplied text. This prevents assessment of whether a meaningful advantage was excluded.
  - Dimension: contribution
  - Location: Abstract; Results §3; Discussion §4
- **Decisive limitations remain unintegrated** The discussion does not address self-selection into repository deposit, residual confounding, or OA-classification error before recommending urgent repository action. The policy conclusion therefore carries greater certainty than the limitations support.
  - Dimension: positioning
  - Location: Methods §2.3; Discussion §4

## Reliability checks

Caveats (3 of 4 checks).

- **Internal coherence:** Noted. The reported model and numerical results are broadly consistent, but the interpretation exceeds what the cross-sectional regression identifies. The institutional-green null is also presented without the group size or confidence interval needed to assess precision.
- **Research conduct:** Clean. The study uses bibliometric metadata and does not present a human-subject ethics issue. No suspicious ethics, registration, availability, or conflict claim was identified.
- **Reference integrity:** Not checked. Reference integrity check could not run: no references section detected in extracted text.
  - 0 references in manuscript

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
