Specific and identifiable research question
The paper distinguishes database dependence from the broader OA citation-advantage debate and operationalises it through the Google Scholar-to-Scopus citation ratio.
↳ Abstract; Methodological setting
The relationship takes place in two out of the three analyzed case studies, while it is essentially absent in the other case study.
the descriptive pattern appears across three cases, though purposive selection limits inference beyond them
Statistically significant evidence can be achieved only by setting low to medium citation thresholds, thus the relationship fades away when looking at the documents that accrue many cites.
the threshold tables show this pattern, though shrinking samples and repeated testing temper certainty
While focusing on the Gold OA route leads to inconclusive evidence, the joint consideration of Gold and Green OA provides some confirmation of the tested hypothesis.
the three-case design is limited and confirmation relies on multiple unadjusted threshold-specific tests
Derived from the full evaluation — not a separate score.
Strengths
The paper distinguishes database dependence from the broader OA citation-advantage debate and operationalises it through the Google Scholar-to-Scopus citation ratio.
↳ Abstract; Methodological setting
Search queries, matching procedures, OA classification, and the complete threshold series are reported, including null and conflicting results rather than only favourable comparisons.
↳ Data gathering process; Appendix Tables 4–9
The background separately organises research supporting and questioning the OA citation advantage, then connects self-selection, early-view effects, and database quality to the study's interpretation.
↳ Background studies; Tables 1–2; Conclusions
Limitations
The OA and non-OA comparisons are not matched or adjusted for known citation drivers such as self-selection, field, article age, or author prominence, limiting interpretation of the observed ratio differences.
↳ Related issues of the citation advantage: open access definition; Methodological setting
The analysis covers one journal, one topic in one publication year, and one highly prolific author. The data-gathering section acknowledges that the limited, non-random sample reduces generalisability.
↳ Case studies; Data gathering process
Tables 4–9 report many nested threshold-specific p-values without a stated multiplicity approach, reducing confidence in isolated significant thresholds and Gold-versus-Green contrasts.
↳ Results; Appendix Tables 4–9
The paper earns its strongest scores for a clear inferential chain and balanced treatment of the contested OA citation literature. Its contribution is narrower: the GS-to-Scopus ratio offers a useful framing, but findings vary across the journal, topic, and author cases and between Gold-only and combined OA definitions. Methodological Rigour is constrained by the lack of adjustment for known citation drivers, the purposive sample, and unquantified database errors. The complete reporting of Tables 4–9 supports transparency, although the many nested significance tests lack a stated multiplicity strategy.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
The paper isolates a specific database-dependence hypothesis within the broader OA citation debate and compares Gold-only with Gold-plus-Green definitions. The advance remains incremental because confirmation is mixed across three purposively selected cases.
The relationship takes place in two out of the three analyzed case studies
Log-transformed citation ratios, explicit threshold sweeps, detailed queries, and full result tables provide a transparent descriptive analysis. The OA-group comparison lacks adjustment for self-selection and other citation drivers, while non-random selection and database measurement errors remain analytically unresolved.
it is not randomly chosen and it has a limited size
The paper visibly connects its hypothesis, ratio definition, threshold analyses, and mixed conclusions, with language calibrated to the reported uncertainty. Dense exposition and repeated threshold inference modestly reduce precision without obscuring the central argument.
the hypothesized relationship is neither so strong as to be generally accepted nor so weak as to be neglected
The background presents both supportive and skeptical OA-citation studies and discusses self-selection, early-view effects, OA subtypes, and database quality. The conclusion carries these limitations into the scope and certainty of its interpretation.
The results presented in the above-referenced studies do not converge.
Lower confidence on Contribution, Methodological Rigour — domain match limited.
Caveats4 of 4 checks
The reported numerical series is internally coherent and includes all examined thresholds, but inferential emphasis across numerous nested tests lacks a stated multiplicity strategy. This affects the weight placed on threshold-specific significance rather than indicating fabricated or contradictory results.
The study uses public bibliometric records, describes manual matching and OA classification, and acknowledges database errors and missing raw-data availability. No ethics requirement, availability misrepresentation, or other conduct concern is established.
Flags: 0 declared / 5 total
102 of 102 checkable references verified
113 references in manuscript 11 have no canonical index record — counted, but not index-checkable 9 references confirmed by manual review
References not verified automatically are resolved manually within 24 hours.
No retraction or expression of concern found in Crossref (includes Retraction Watch).
Sources: Crossref (incl. Retraction Watch) ✓
The authors themselves demonstrate the relationship with ANOVA on three small, non-random samples, with no independent replication of the finding.
The conclusion frames the findings as open questions deserving further consideration rather than naming any concrete real-world use.
Research evaluators and bibliometric analysts could weigh database openness and open access definitions when using citation metrics in assessment and publishing policy.
The relationship appeared in only two non-random case studies and may stem from Google Scholar's duplicate records and citation errors.
Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3
AI-generated, human-governed. Something look off? Contact us to request a review.
Keep reading
Other papers Nabu has evaluated blind, starting with the same field.
Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications
These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.
TentativeChao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics
papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year
TentativeMasashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences
日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.
Tentative