nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-B29C1BB3·Framework v5.9·Pipeline v0.4·Evaluated 29 Sept 2026·OECD: 5.8 Library, Information and Museum Studies·Subfield: Statistics, Probability and Uncertainty·Basis: Full text·Type: Cross-sectional study

Self-selection and the citation advantage of open access articles

Jingfeng Xia et al.Jingfeng Xia, Katie Nakanishi·2012·Online Information Review·10.1108/14684521211206953 ↗

Primary claim

The results reveal that open access articles in general receive more citations.

Tentative · cross-sectional association with uncontrolled confounding and unknown OA timing
In brief

A useful tier-based anthropology study adds evidence on open-access citations, but its observational design cannot sustain its causal rejection of self-selection.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Fragile — the claim's weakest requirement is that the effect exists at all. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract

Purpose This research seeks to examine the relationship between the open access availability of journal articles in anthropology and their citation conditions. Design/methodology/approach The paper applies a statistical logistic regression model to explore this relationship, and compares two groups of articles, those published in high‐ranked journals and those in low‐ranked journals based on journal impact factor, to examine the likelihood that open access status is correlated to scholarly impact. Findings The results reveal that open access articles in general receive more citations. Moreover, this research finds that articles in high‐ranked journals do not have a higher open access rate, and articles in lower‐ranked journals have a greater increase rate of citations if they are freely accessible. Originality/value The findings are contrary to the existing theory that a higher citation rate of open access articles is caused by authors posting their best articles online. It is hoped that the research discoveries can help electronic publishers and digital project managers to adjust their strategies in open access advocacy.

Key Claims

Primary finding · Tentative

The results reveal that open access articles in general receive more citations.

Fragile — the claim's weakest requirement is that the effect exists at all. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

cross-sectional association with uncontrolled confounding and unknown OA timing

Abstract; Findings, p. 40
Quote verified
Secondary · Supported

Articles in high-ranked journals do not have a higher open access rate.

journal-tier coefficient is non-significant, though the result does not establish equivalence

Abstract, p. 40; Table III
Quote verified
Secondary · Tentative

Articles in lower-ranked journals have a greater increase rate of citations if they are freely accessible.

small lower-tier OA subgroup and cross-sectional model cannot identify citation increases after OA

Abstract, p. 40; Table VI
Quote verified
Secondary · Tentative

The findings are contrary to the existing theory that a higher citation rate of open access articles is caused by authors posting their best articles online.

journal rank does not identify article-level self-selection or rule out quality-related confounding

Abstract, Originality/value, p. 40
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Distinctive comparison across journal tiers

The study compares OA and non-OA patterns separately in ten high-ranked and ten low-ranked anthropology journals, producing a defined tier-specific result rather than only repeating the overall OA association.

↳ Methods, pp. 43–45; Table VI

#positioning

Balanced engagement with contested evidence

The background discusses studies favoring self-selection, studies rejecting it, a randomized trial reporting no citation advantage, and a critique of that trial.

↳ Background, pp. 41–43

#methodological rigour

Transparent sampling and search procedure

The article reports journal-selection criteria, article exclusions, OA search methods, citation sourcing, and subtraction of self-citations, making the data-collection process readily traceable.

↳ Methods, pp. 43–45

Limitations

#methodological rigour

Confounding remains central and uncontrolled

The regression includes citation count and journal tier but does not adjust for author prominence, article quality, topic, co-authorship, or other factors that could influence both OA selection and citations.

↳ Methods, p. 45

#methodological rigour

Exposure timing cannot be established

OA status and citations were collected in early 2010 for articles published in 2007, without determining when each article became freely available. The analysis therefore cannot establish that OA preceded the observed citations.

↳ Methods, pp. 44–45

#reporting

Regression reporting contains inconsistencies

The displayed equation gives 0.74 rather than Table III’s 0.074, the Table III constant statistics are incompatible, and Table VI’s prose gives an odds ratio inconsistent with its coefficient.

↳ Results, pp. 46–47; Tables III and VI

Does this match your read? Add your assessment ↓

Nabu Commentary

The high- versus low-ranked journal comparison provides a specific addition to the OA citation literature, but journal rank is an indirect proxy for article quality. The principal methodological constraint is that the cross-sectional model neither controls major article-level confounders nor establishes when OA availability preceded citations. This makes the abstract’s rejection of self-selection and the discussion’s statement that OA “affected” citation frequency stronger than the evidence permits. Broad engagement with competing literature supports the contextual assessment, while the omission of these central identification limits from the limitations section constrains it.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
2.5±0.1

Contribution
3.0

The high- versus low-ranked journal comparison provides a defined, field-specific addition to the open-access citation literature. Its advance remains narrow because journal rank is only a coarse proxy for paper quality and does not resolve article-level self-selection.

Introduction, p. 41; Background, p. 43; Table VI

“articles in lower-ranked journals have a greater increase rate of citations if they are freely accessible”

Methodological Rigour
2.0

The sample, search procedure, citation source, and regression specification are reported, but the analysis does not control major article- and author-level confounders or establish when OA exposure preceded citations. Point-in-time OA classification and causal interpretation trigger a stacked methodological ceiling.

Methods, pp. 43–45; Results and Discussion, pp. 46–48

“The data was collected in early 2010.”

Reporting
3.1

The hypotheses, methods, results, and tables follow a readable sequence. The abstract and discussion nevertheless turn a cross-sectional association into claims that OA affected citations and contradicted self-selection, creating a material language-evidence mismatch.

Abstract; Discussion, pp. 47–48

“OA status has indeed affected the frequency of citations”

Positioning
2.8

The background engages studies supporting and contesting the OA advantage, including null and randomized evidence. The limitations section discusses sample size and scope but omits the central inability to separate OA effects from article-level confounding and reverse temporal ordering.

Background, pp. 41–43; Discussion, p. 48

“This research has its limitations.”

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

Several regression quantities are inconsistent between the prose and tables, although the principal tabled citation coefficient and its reported test statistics are mutually consistent. The issues reduce confidence in numerical interpretation without establishing that the main association was fabricated.

Research ConductClean

The bibliometric study uses published article and citation records and does not require human-subjects approval. No text-visible research-conduct concern was identified, while absent data, code, funding, and conflict statements were treated as era-typical rather than suspicious.

Flags: 0 declared / 5 total

Reference IntegrityClean

29 of 29 checkable references verified

38 references in manuscript 9 have no canonical index record — counted, but not index-checkable 6 references confirmed by manual review

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice · SDG 9
Type of advanceEmpirical
Route to useNamed
AdvanceAdvances
CitationsFWCI 5.4
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessFoundational
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The claim is supported only by one small observational regression on a single discipline and year, with no independent or controlled confirmation.

From the paper
“It is hoped that the research discoveries can help electronic publishers and digital project managers to adjust their strategies in open access advocacy”

The abstract names who would act on the findings (electronic publishers and digital project managers) and for what purpose, but not a specific decision or setting.

Pathway

Electronic publishers, digital project managers and OA advocates could use the finding that low-ranked journal articles gain most to target open access advocacy toward peripheral journals.

Barrier

The evidence rests on a small single-year, single-discipline observational sample and contradicts prior randomised trial evidence, so causation and generalisability remain unestablished.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Suspected distortion of citations in high-impact cancer journals

    Baptiste Scancar, Jennifer Anne Byrne, David Causeur, et al. · 2026 · Media and communications

    Primary claim

    These findings suggest that paper mills inflate the citation metrics of supported publications and affected journals at scale.

    Tentative
    Evidence Score
    3.5±0.1
    Reliability
    Caveats
  2. The citation trap: Papers published at year-end receive systematically fewer citations

    Chao Ma, Yiwei Li, Feng Guo, et al. · 2019 · Economics

    Primary claim

    papers published between October and December on average get as much as 18.5% fewer citations than those published in the other months in the year

    Tentative
    Evidence Score
    3.0±0.2
    Reliability
    Caveats
  3. Quantitative Analysis of the Open Access Citation Advantage

    Masashi Kawai, Koichi Ojiro, Makoto Asaoka, et al. · 2022 · Other social sciences

    Primary claim

    日本の機関リポジトリによるオープンアクセス論文の数は限られるものの,その被引用数と様々なタイプのオープンアクセス論文の被引用数の比較からは,日本の機関リポジトリによるオープンアクセスのメリットは確認できなかった.

    Tentative
    Evidence Score
    2.9±0.2
    Reliability
    Caveats

How the rubric works →