Specific and identifiable research question
The paper distinguishes database dependence from the broader OA citation-advantage debate and operationalises it through the Google Scholar-to-Scopus citation ratio.
↳ Abstract; Methodological setting
Abstract not available — view at DOI
Key Claims
Primary findingSupported
The relationship takes place in two out of the three analyzed case studies, while it is essentially absent in the other case study.
Fragile — the claim's weakest requirement is that the effect exists at all. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
the descriptive pattern appears across three cases, though purposive selection limits inference beyond them
Conclusions
SecondarySupported
Statistically significant evidence can be achieved only by setting low to medium citation thresholds, thus the relationship fades away when looking at the documents that accrue many cites.
the threshold tables show this pattern, though shrinking samples and repeated testing temper certainty
Conclusions
SecondaryTentative
While focusing on the Gold OA route leads to inconclusive evidence, the joint consideration of Gold and Green OA provides some confirmation of the tested hypothesis.
the three-case design is limited and confirmation relies on multiple unadjusted threshold-specific tests
Conclusions
Derived from the full evaluation — not a separate score.
Strengths · Limitations
Strengths
Transparent reporting across all thresholds
Search queries, matching procedures, OA classification, and the complete threshold series are reported, including null and conflicting results rather than only favourable comparisons.
↳ Data gathering process; Appendix Tables 4–9
Balanced engagement with contested evidence
The background separately organises research supporting and questioning the OA citation advantage, then connects self-selection, early-view effects, and database quality to the study's interpretation.
↳ Background studies; Tables 1–2; Conclusions
Limitations
Confounding remains analytically uncontrolled
The OA and non-OA comparisons are not matched or adjusted for known citation drivers such as self-selection, field, article age, or author prominence, limiting interpretation of the observed ratio differences.
↳ Related issues of the citation advantage: open access definition; Methodological setting
Non-random cases restrict generalisation
The analysis covers one journal, one topic in one publication year, and one highly prolific author. The data-gathering section acknowledges that the limited, non-random sample reduces generalisability.
↳ Case studies; Data gathering process
Repeated tests lack multiplicity strategy
Tables 4–9 report many nested threshold-specific p-values without a stated multiplicity approach, reducing confidence in isolated significant thresholds and Gold-versus-Green contrasts.
↳ Results; Appendix Tables 4–9
Nabu Commentary
The paper earns its strongest scores for a clear inferential chain and balanced treatment of the contested OA citation literature. Its contribution is narrower: the GS-to-Scopus ratio offers a useful framing, but findings vary across the journal, topic, and author cases and between Gold-only and combined OA definitions. Methodological Rigour is constrained by the lack of adjustment for known citation drivers, the purposive sample, and unquantified database errors. The complete reporting of Tables 4–9 supports transparency, although the many nested significance tests lack a stated multiplicity strategy.
Check another paper
Author Note / Field Feedback
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Dimension breakdown
Study Quality
Sound3.1
Confidence highContribution
3.0
The paper isolates a specific database-dependence hypothesis within the broader OA citation debate and compares Gold-only with Gold-plus-Green definitions. The advance remains incremental because confirmation is mixed across three purposively selected cases.
Abstract; Methodological setting; Conclusions
The relationship takes place in two out of the three analyzed case studies
Methodological Rigour
2.5
Log-transformed citation ratios, explicit threshold sweeps, detailed queries, and full result tables provide a transparent descriptive analysis. The OA-group comparison lacks adjustment for self-selection and other citation drivers, while non-random selection and database measurement errors remain analytically unresolved.
Methodological setting; Data gathering process; Appendix Tables 4–9
it is not randomly chosen and it has a limited size
Reporting
4.2
The paper visibly connects its hypothesis, ratio definition, threshold analyses, and mixed conclusions, with language calibrated to the reported uncertainty. Dense exposition and repeated threshold inference modestly reduce precision without obscuring the central argument.
Abstract; Methodological setting; Results; Conclusions
the hypothesized relationship is neither so strong as to be generally accepted nor so weak as to be neglected
Positioning
4.1
The background presents both supportive and skeptical OA-citation studies and discusses self-selection, early-view effects, OA subtypes, and database quality. The conclusion carries these limitations into the scope and certainty of its interpretation.
Background studies; Tables 1–2; Data gathering process; Conclusions
The results presented in the above-referenced studies do not converge.
Lower confidence on Contribution, Methodological Rigour — domain match limited.
Reliability
Caveats4 of 4 checks
Internal CoherenceNoted
The reported numerical series is internally coherent and includes all examined thresholds, but inferential emphasis across numerous nested tests lacks a stated multiplicity strategy. This affects the weight placed on threshold-specific significance rather than indicating fabricated or contradictory results.
Research ConductClean
The study uses public bibliometric records, describes manual matching and OA classification, and acknowledges database errors and missing raw-data availability. No ethics requirement, availability misrepresentation, or other conduct concern is established.
Flags: 0 declared / 5 total
Reference IntegrityNoted
101 of 110 checkable references verified
113 references in manuscript 3 are books, websites or datasets — counted, but not index-checkable
Post-Publication RecordClean
No retraction notice found in Retraction Watch.
Last checked: 28 Sep 2026
Sources: Retraction Watch ✓
Readiness
Where this paper’s evidence sits on the path from initial observation to real-world use.
Mechanistic
The study offers an exploratory observation rather than an operational recommendation, validated workflow, or decision tool. Its own conclusion presents the relationship as controversial and conditional.
Abstract; Conclusions
the hypothesized relationship remains controversial
AI-generated, human-governed. Something look off? Contact us to request a review.