nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-4BA4F820·Framework v5.9·Pipeline v0.4·Evaluated 05 Oct 2026·OECD: 5.8 Other social sciences·Subfield: Statistics, Probability and Uncertainty·Basis: Full text·Type: Cross-sectional study

Quantitative Analysis of the Open Access Citation Advantage

Masashi Kawai et al.Masashi Kawai, Koichi Ojiro, Makoto Asaoka et al.·2022·Joho Chishiki Gakkaishi·10.2964/jsik_2022_019 ↗

Primary claim

日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

Tentative · 限定的な横断比較で標本規模と信頼区間が示されず,意味のある優位性を除外できない
In brief

A useful Japanese OA-type comparison that isolates institutional repositories, but observational identification cannot support its causal interpretation.

ReliabilityCaveats3 of 4 checks completeRead the entry ↓
Fragile — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract

日本の機関リポジトリによるオープンアクセスを推進するため,図書館は研究者に対して論文の提供依頼をおこなってきたが,そのメリットは不明確であり,提供依頼の成功率は低迷している.こうした現状を踏まえ,本研究では被引用数に着目することにより,日本の機関リポジトリによるオープンアクセスのメリットの存否について検証した.日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

Key Claims

Primary finding · Tentative

日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

Fragile — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

限定的な横断比較で標本規模と信頼区間が示されず,意味のある優位性を除外できない

Abstract / Discussion §4
Secondary · Tentative

OAステータスをクローズドからグリーンOA(機関)にすることによる被引用数の変化率は0.99倍

横断的回帰はOAステータス変更による因果的変化を識別しない

Discussion §4
Quote verified
Secondary · Supported

ハイブリッドOA,グリーンOA(分野),ブロンズOA,グリーンOA(機関),ゴールドOAの順に係数が高い

報告された点推定値の順序とは一致するが,群間差の検定は示されていない

Results §3; Discussion §4
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Distinct institutional and disciplinary green OA

The analysis separates institutional-repository green OA from disciplinary green OA, directly addressing the gap stated in the introduction. This creates a more policy-relevant comparison for Japanese repository managers.

↳ Introduction §1; Methods §2.2

#methodological rigour

Large sample with suitable count model

The study analyzes 87,359 Japanese-affiliated 2017 articles using negative-binomial regression and a stated set of bibliometric controls. The model family fits the count nature of citation outcomes.

↳ Methods §§2.2–2.3

#application pathway

Concrete repository stakeholder pathway

The paper links its question to Japanese libraries seeking author deposits and identifies institutional-repository communities as the audience for action. The approximately 50% request-success figure makes the operational problem visible.

↳ Introduction §1; Discussion §4

Limitations

#methodological rigour

Causal interpretation exceeds observational design

Methods §2.1 claims the coefficients isolate differences caused by OA type, and §§3–4 describe citation changes resulting from switching OA status. The cross-sectional regression supports adjusted associations, not those interventional interpretations.

↳ Methods §2.1; Results §3; Discussion §4

#contribution

Null estimate lacks reported precision

The institutional-green estimate is 0.99 and nonsignificant, but the paper acknowledges that the group is limited without reporting its size or a confidence interval in the supplied text. This prevents assessment of whether a meaningful advantage was excluded.

↳ Abstract; Results §3; Discussion §4

#positioning

Decisive limitations remain unintegrated

The discussion does not address self-selection into repository deposit, residual confounding, or OA-classification error before recommending urgent repository action. The policy conclusion therefore carries greater certainty than the limitations support.

↳ Methods §2.3; Discussion §4

Does this match your read? Add your assessment ↓

Nabu Commentary

The paper’s main advance is the separation of institutional and disciplinary green OA in a large Japanese bibliometric sample. Its negative-binomial model and control set support a descriptive adjusted comparison, but Methods §2.1 and §§3–4 interpret the OA coefficients as changes caused by switching status. The 0.99 institutional-green estimate is nonsignificant, yet the acknowledged limited group is not accompanied by its size or confidence interval, so absence of an advantage is not established. The thin limitations discussion and untested repository recommendations keep both quality and translation potential in the preliminary range.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
2.9±0.2

Contribution
3.1

The study adds a specific distinction between institutional and disciplinary green OA in a large Japanese bibliometric sample. The advance is narrow, and the institutional-green null has unreported precision and limited reach beyond the sampled setting.

Introduction §1; Methods §2.3; Results §3

OACAの序列におけるグリーンOA(機関)の位置付けは明らかになっていない

Methodological Rigour
2.8

Negative-binomial regression and several citation-related controls provide a reasonable descriptive model. The analysis nevertheless interprets adjusted associations causally and does not examine deposit selection or OA-classification error.

Methods §§2.1–2.3; Results §3; Discussion §4

OAタイプの違いに起因する被引用数の差の正確な把握が可能になる

Reporting
3.5

The paper follows a compact motivation–methods–results–discussion structure and reports the principal estimate directly. Reporting is reduced by switching between the hedged conclusion that an advantage was not confirmed and the stronger statement that no OACA exists.

Abstract; Results §3; Discussion §4

日本のグリーンOA(機関)のOACAはないといえる

Positioning
2.7

The introduction identifies prior OACA comparisons and the institutional-versus-disciplinary repository gap. The seven-reference framing does not engage selection and confounding concerns, and the discussion moves from a limited null result to urgent action without integrating those uncertainties.

Introduction §1; Discussion §4; References

機関リポジトリコミュニティには,早急なアクションが期待される

Reliability

Caveats3 of 4 checks


Internal CoherenceNoted

The reported model and numerical results are broadly consistent, but the interpretation exceeds what the cross-sectional regression identifies. The institutional-green null is also presented without the group size or confidence interval needed to assess precision.

Research ConductClean

The study uses bibliometric metadata and does not present a human-subject ethics issue. No suspicious ethics, registration, availability, or conflict claim was identified.

Flags: 0 declared / 5 total

Reference IntegrityNot checked

Reference integrity check could not run: no references section detected in extracted text.

0 references in manuscript

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice · SDG 16
Type of advanceEmpirical
Route to useNamed
AdvanceExtends
CitationsFWCI 0.0
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessPiloted
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The claim rests on a single observational regression over one year of real bibliometric data covering 87,359 articles, with the authors themselves noting the limited number of institutional green OA papers.

From the paper
“機関リポジトリコミュニティには,OACAの創出か,異なるメリットの提示が求められる”

The discussion names the institutional repository community and libraries as actors who must respond to the findings by creating a citation advantage or presenting alternative benefits.

Pathway

Libraries and the institutional repository community would use the null result to redesign repository services, such as unified search with field clustering, or to present different benefits when soliciting articles from researchers.

Barrier

The null finding comes from a single-year observational dataset with few institutional green OA articles, and the repository community lacks a proven method to create a citation advantage or a demonstrated alternative benefit to offer.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Suspected distortion of citations in high-impact cancer journals

    Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications

    Primary claim

    These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.

    Tentative
    Evidence Score
    3.5±0.1
    Reliability
    Caveats
  2. The citation trap: Papers published at year-end receive systematically fewer citations

    Chao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics

    Primary claim

    papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year

    Tentative
    Evidence Score
    3.0±0.2
    Reliability
    Caveats
  3. Impact of Open Access Models on Citation Metrics

    Irene K. Razumova, А.В. Кузнецов · 2019 · Other social sciences

    Primary claim

    We report the higher values and growth rates of the citation metrics: citation impact and %Cited, in the OA reference groups over the Paywall group.

    Supported
    Evidence Score
    2.5±0.1
    Reliability
    Caveats

How the rubric works →