nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Readiness
Report #NBU-788C79FA·Framework v5.9·Pipeline v0.4·Evaluated 11 Sept 2026·OECD: 1.2 Computer and Information Sciences·Subfield: Statistics, Probability and Uncertainty·Basis: Full text·Type: Cross-sectional study

Exploring the Citation and Impact Advantages of Open Access Papers in Hybrid Journals: A Case Study of Biochemistry Publications

Zhu et al.Zhu, Li, Chen et al.·2025·Publications·10.3390/publications13040064 ↗

Primary claim

OA publications in biochemistry exhibit notable citation and impact advantages, which are positively correlated with the degree of openness

Tentative · causal-sounding advantage language exceeds the confounded observational design and rests on inconsistently reported regression statistics
In brief

A large hybrid-journal analysis documents OA citation associations, but unreliable regression inference prevents causal interpretation.

ReliabilityConcerns4 of 4 checks completeRead the 2 entries ↓
Unlikely to hold — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract

Open Access (OA) has emerged as a pivotal driver shaping the dissemination scope and academic impact of research findings. To clarify the impact of publishing models such as open access on the citation performance of biochemical papers, this study selects 177,745 biochemistry professional papers included in the core collection of the Web of Science (WoS CC) as the research data; we conduct an analysis of citation and impact advantages in biochemistry research. Employing correlation analysis, baseline regression modeling, and two-way ANOVA, our analysis indicates that: OA publications in biochemistry exhibit notable citation and impact advantages, which are positively correlated with the degree of openness, and the key determinants of the OA advantage encompass funding sources, reference count, and publication region. At present, China accounts for a disproportionately small proportion of OA papers in this field. In the context of the open-science paradigm, Chinese academic journals must systematically address their developmental bottlenecks and formulate publication innovation strategies to enhance the quality of academic publishing.

Key Claims

Primary finding · Tentative

OA publications in biochemistry exhibit notable citation and impact advantages, which are positively correlated with the degree of openness

Unlikely to hold — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

causal-sounding advantage language exceeds the confounded observational design and rests on inconsistently reported regression statistics

Abstract; Sections 4.1–4.3
Quote verified
Secondary · Tentative

the key determinants of the OA advantage encompass funding sources, reference count, and publication region

observational covariates cannot establish determinants, and region is treated inconsistently across the regression and ANOVA analyses

Abstract; Tables 5–8
Quote verified
Secondary · Supported

China accounts for a disproportionately small proportion of OA papers in this field

Table 9 directly reports lower Chinese gold-OA uptake than several comparator countries within the selected sample

Abstract; Section 4.4, Table 9
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#methodological rigour

Large, explicitly screened article sample

Section 3.1 reports 177,745 articles drawn from 287 selected hybrid journals and provides a screening flowchart. This scale supports detailed descriptive comparisons across OA categories.

↳ Section 3.1 and Figure 1

#contribution

Hybrid design reduces journal-level differences

Comparing OA and non-OA articles within hybrid journals addresses some differences in journal quality, subject scope, and review process that affect cross-journal comparisons.

↳ Introduction and Section 2.1

#positioning

Conflicting literature is acknowledged

Section 2.1 presents studies reporting positive, absent, and negative OA citation patterns rather than treating the field as settled.

↳ Section 2.1

Limitations

#methodological rigour

Regression statistics are internally incompatible

Tables 5–7 report values labelled as t-statistics whose signs and magnitudes cannot be reconciled with the coefficients and p-values. This prevents reliable interpretation of the main inferential results.

↳ Tables 5–7, pp. 9–10

#methodological rigour

Self-selection remains causally uncontrolled

The regressions adjust for observed bibliometric variables but do not address why authors select OA or differences in article and author quality. The Discussion nevertheless recommends greater OA as a route to higher citations.

↳ Section 3.3 and Discussion, p. 13

#positioning

Scope and recommendations do not align

The sample is restricted to Q1 hybrid journals in one field-labelled category, and Section 6 cautions against broader generalisation. The policy recommendations on APCs and journal governance extend beyond what this design directly evaluates.

↳ Section 3.1; Discussion; Summary

Does this match your read? Add your assessment ↓

Nabu Commentary

The hybrid-journal design and large sample provide useful descriptive evidence that OA categories differ in citations and journal-level impact measures. The central regression evidence is substantially weakened by Tables 5–7, where the reported t-statistics cannot be reconciled with coefficients and p-values. The models also leave author and article self-selection into OA unresolved, despite the Discussion framing OA adoption as a route to higher citations. The paper is therefore most informative as a field-specific descriptive study rather than as causal or implementation-ready evidence.

Check another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Study Quality

Limited2.4

Confidence medium
Contribution
2.8

Restricting the comparison to hybrid Q1 journals provides a field-specific refinement over cross-journal OA comparisons. The advance remains incremental because the design does not resolve article- and author-level selection into OA.

Introduction; Sections 2.1 and 3.1

These papers exhibit high comparability in aspects such as journal quality, subject scope, and review process

Methodological Rigour
2.0

The paper reports selection rules, covariates, regression equations, ANOVA, and VIF checks, but observed-covariate adjustment does not identify an OA effect under self-selection. The stacked methodological ceiling also reflects causal conclusions unsupported by this observational design.

Sections 3.1–3.3; Tables 4–8; Discussion

researchers... can attempt to achieve higher citations for their papers through a higher degree of OA

Reporting
2.8

The research questions and descriptive-to-regression sequence are generally followable. Precision is reduced by contradictory variable roles and causal language that is stronger than the associative evidence.

Sections 3.2–3.3; Abstract; Discussion

statistically significant positive effects of OA adoption

Positioning
2.7

The literature review presents positive, negative, and uncertain findings on OA citation advantage. Section 6 acknowledges omitted variables and unresolved distributional issues, but Section 5 does not carry those qualifications into its practical conclusions.

Section 2.1; Discussion; Summary

it is possible that key variables were overlooked

Reliability

Concerns4 of 4 checks


Internal CoherenceConcern

The principal regression tables contain test-statistic labels or values that cannot be reconciled with the coefficients and significance levels. Several additional contradictions affect the stated model specification and interpretation.

Research ConductNoted

Ethics and consent are appropriately declared not applicable, and funding is disclosed. The data-availability statement does not describe access to the article-level dataset or analysis code needed to reproduce the regressions.

Flags: 2 declared / 5 total

Reference IntegrityClean

46 of 46 checkable references verified

47 references in manuscript 1 are books, websites or datasets — counted, but not index-checkable

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Readiness

Where this paper’s evidence sits on the path from initial observation to real-world use.

Mechanistic

The evidence consists of retrospective bibliometric associations and does not test an OA intervention or policy implementation. The recommendations therefore require substantial validation before operational use.

Sections 3–5

Employing correlation analysis, baseline regression modeling, and two-way ANOVA

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Suspected distortion of citations in high-impact cancer journals

    Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications

    Primary claim

    These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.

    Tentative
    Study quality
    Sound3.5
    Reliability
    Caveats
  2. The citation trap: Papers published at year-end receive systematically fewer citations

    Chao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics

    Primary claim

    papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year

    Tentative
    Study quality
    Sound3.0
    Reliability
    Caveats
  3. Quantitative Analysis of the Open Access Citation Advantage

    Masashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences

    Primary claim

    日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

    Tentative
    Study quality
    Limited2.9
    Reliability
    Caveats

How the rubric works →