nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-10351BDD·Framework v5.8·Pipeline v0.4·Evaluated 14 Aug 2026·OECD: 5.8 Other social sciences·Subfield: Information Systems·Basis: Full text·Type: Cross-sectional study

The citation advantage of linking publications to research data.

Colavizza et al.Colavizza, Hrynaszkiewicz, Staden et al.·2020·PloS one·10.1371/journal.pone.0230416 ↗

Primary claim

We also find an association between articles that include statements that link to data in a repository and up to 25.36% (± 1.07%) higher citation impact on average, using a citation prediction model.

Supported · adjusted observational models consistently support the direction, but residual confounding prevents causal interpretation
In brief

A large, reproducible bibliometric analysis links repository-based data statements to higher citations, with residual confounding limiting causal and policy interpretation.

ReliabilityCaveats4 of 4 checks completeRead the entry ↓
Possible — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.
Abstract

Efforts to make research results open and reproducible are increasingly reflected by journal policies encouraging or mandating authors to provide data availability statements. As a consequence of this, there has been a strong uptake of data availability statements in recent literature. Nevertheless, it is still unclear what proportion of these statements actually contain well-formed links to data, for example via a URL or permanent identifier, and if there is an added value in providing such links. We consider 531, 889 journal articles published by PLOS and BMC, develop an automatic system for labelling their data availability statements according to four categories based on their content and the type of data availability they display, and finally analyze the citation advantage of different statement categories via regression. We find that, following mandated publisher policies, data availability statements become very common. In 2018 93.7% of 21,793 PLOS articles and 88.2% of 31,956 BMC articles had data availability statements. Data availability statements containing a link to data in a repository-rather than being available on request or included as supporting information files-are a fraction of the total. In 2017 and 2018, 20.8% of PLOS publications and 12.2% of BMC publications provided DAS containing a link to data in a repository. We also find an association between articles that include statements that link to data in a repository and up to 25.36% (± 1.07%) higher citation impact on average, using a citation prediction model. We discuss the potential implications of these results for authors (researchers) and journal publishers who make the effort of sharing their data in repositories. All our data and code are made available in order to reproduce and extend our results.

Key Claims

Primary finding · Supported

We also find an association between articles that include statements that link to data in a repository and up to 25.36% (± 1.07%) higher citation impact on average, using a citation prediction model.

Possible — the claim's weakest requirement is that the effect exists at all. Based on how the study was designed and conducted, not on statistics extracted from the paper. Experimental. Every point below is traceable to a quoted passage, but this forecast has not yet been validated against known replication outcomes.

adjusted observational models consistently support the direction, but residual confounding prevents causal interpretation

Abstract; Results, Citation Prediction
Quote verified
Secondary · Well-supported

In 2018 93.7% of 21,793 PLOS articles and 88.2% of 31,956 BMC articles had data availability statements.

direct article counts support the reported publisher-specific uptake rates

Abstract; Results, The Presence of Data Availability Statements Over Time
Quote verified
Secondary · Well-supported

In 2017 and 2018, 20.8% of PLOS publications and 12.2% of BMC publications provided DAS containing a link to data in a repository.

validated DAS classification directly supports the reported repository-link proportions

Abstract; Results, The Presence of Data Availability Statements Over Time
Quote verified

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Large cross-publisher evidence base

The study analyzes 531,889 PLOS and BMC articles, extending earlier discipline-specific evidence across multiple journals and research areas.

↳ Abstract; Methods, Data; Introduction, final paragraphs

#methodological rigour

Validated automated DAS classification

The SVM classifier achieved 0.99 accuracy, precision, recall, and weighted F1 on the held-out set, with results reported by category in Table 2.

↳ Methods, Data Availability Statements: Classification; Table 2

#methodological rigour

Multiple robustness and validation checks

The citation finding was checked across several model families, two-, three-, and five-year windows, journal controls, and a Web of Science comparison reporting r=0.83.

↳ Results, Citation Prediction, Model and Dependent Variable sections; Table 6

Limitations

#methodological rigour

Residual confounding remains unresolved

Article quality, research resources, and group visibility may influence both repository sharing and citations. These alternatives are acknowledged in the Conclusion but are not addressed through formal sensitivity or causal-identification analysis.

↳ Conclusion, final paragraph

#methodological rigour

OA-only selection limits inference

The sample is limited to PLOS and BMC articles in PubMed OA. The Discussion acknowledges limited coverage but does not test whether this selection changes the estimated DAS–citation relationship.

↳ Methods, Data; Discussion, limitations paragraph

#reporting

Policy language exceeds causal evidence

The title and policy discussion describe a citation “advantage,” “benefit,” and “incentive,” while the underlying analysis establishes correlation rather than causal gain.

↳ Title; Discussion, stakeholder implications; Conclusion

Does this match your read? Add your assessment ↓

Nabu Commentary

The descriptive findings are directly supported by large-scale article counts and a DAS classifier reporting 0.99 held-out accuracy. The citation analysis adjusts for publication timing, article characteristics, author H-index, publisher, policy, field, and journal, and alternative model specifications corroborate the reported association. The conclusion also acknowledges that article quality and research-group resources may explain part of the relationship, so the evidence supports association rather than causal benefit. The strongest remaining methodological limitation is the restriction to PLOS and BMC articles in PubMed OA without testing how that selection affects the association itself.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
3.8±0.2

Contribution
3.8

The study meaningfully extends discipline-specific evidence through a 531,889-article, two-publisher analysis and an automated DAS classification system. Its main citation finding remains an observational extension of an existing association rather than a qualitatively new result.

Abstract; Introduction, final paragraphs; Methods, Data Availability Statements: Classification

“We also find an association between articles that include statements that link to data in a repository”

Methodological Rigour
3.7

The regression adjusts for publication timing, authorship, references, author H-index, publisher, policy, field, and journal, with multiple alternative models and citation-count validation. Restriction to PLOS and BMC articles in PubMed OA is disclosed but its possible influence on the DAS–citation association is not directly tested.

Results, Citation Prediction, Independent Variables and Model; Discussion, limitations paragraph

“While the PubMed OA collection is sizable, it includes only a fraction of all published literature.”

Reporting
4.0

The research questions, classification procedure, regression analysis, and findings form a readily traceable argument, and the central statistical result is usually described as an association or correlation. The title and policy discussion use “advantage” and “benefit,” which can suggest greater causal certainty than the design provides.

Introduction, research questions; Abstract; Discussion, paragraph beginning “There are several potential implications”; Conclusion

“Are different DAS categories correlated with an article’s citation impact?”

Positioning
3.8

The paper connects its analysis to prior discipline-specific citation studies and discusses OA coverage, citation measurement, DAS extraction, and the absence of repository-content verification. It acknowledges article quality and research-group resources as alternative explanations, although engagement with complicating or null findings is limited.

Introduction, paragraphs discussing prior studies; Discussion, limitations paragraph; Conclusion, final paragraph

“More efforts and resources are put into papers sharing data”

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

Reported headline numbers and methods–results alignment are internally consistent. Prominent benefit-oriented wording and minor production errors warrant a noted status but do not invalidate the descriptive or associational results.

Research ConductClean

Data and code are claimed available through a persistent Zenodo DOI, and the bibliometric design does not require human-subject ethics approval. No conduct concern is evident from the supplied text.

Flags: 2 declared / 5 total

Reference IntegrityClean

61 of 61 checkable references verified

78 references in manuscript 17 have no canonical index record — counted, but not index-checkable 8 references confirmed by manual review

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaPolicy and practice · SDG 9
Type of advanceEmpirical
Route to useNamed
AdvanceExtends
CitationsFWCI 62.8
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessValidated
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The citation association is estimated on real-world data covering 531,889 articles across two publishers and many journals, corroborated by multiple alternative regression models.

From the paper
“requests for strengthened and consistent research data policies, from research funders, publishers and institutions, can be better supported, enforced and accepted”

The paper names the actors (research funders, publishers, institutions) who would use the citation-benefit evidence to justify and enforce stronger data sharing policies.

Pathway

Journal publishers and research funders could use the citation-benefit evidence to strengthen, enforce and mandate data sharing policies requiring repository deposit.

Barrier

The finding is an observational association, so unmeasured article quality or author resources could confound it, weakening its value as a policy incentive.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Artificial intelligence in language learning: biometric feedback and adaptive reading for improved comprehension and reduced anxiety

    Hang Yuan · 2025 · Educational sciences

    Primary claim

    Quantitative results revealed significant improvements in reading comprehension, motivation, anxiety reduction, and cognitive load management among participants using the AI platform compared to the control group.

    Tentative
    Evidence Score
    2.2±0.2
    Reliability
    Concerns
  2. Blind spots in AI-assisted healthcare evidence search: multiplatform evaluation of clinical retrieval gaps and risk-of-bias

    Farrag, Soliman, Azubuike, et al. · 2026 · Computer and information sciences

    Primary claim

    Median formulation-level recall ranged from 7.2% to 42.2%, while pooled platform recall ranged from 45.8% to 72.3%.

    Well-supported
    Evidence Score
    3.9±0.2
    Reliability
    No concerns
  3. Writing Code vs. Shipping Code: Productivity Effects Across Generations of AI Coding Tools

    Mert Demirer, Leon Musolff, Liyuan Yang · 2026 · Mechanical engineering

    Evidence Score
    3.9±0.2
    Reliability
    Caveats

How the rubric works →