# The relationship between bioRxiv preprints, citations and altmetrics

- **DOI:** [10.1162/qss_a_00043](https://doi.org/10.1162/qss_a_00043)
- **Rating:** Strong (3.8 out of 5)
- **Verdict:** A careful matched bibliometric study establishes a persistent bioRxiv visibility advantage, but unresolved author self-selection prevents causal attribution.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-28
- **Evaluation page:** https://www.nabu.science/paper/10.1162%2Fqss_a_00043

## Key claims

1. bioRxiv-deposited journal articles had sizably higher citation and altmetric counts compared to nondeposited articles.
   - Support: Supported
   - Type: Primary finding
   - Basis: matched observational comparisons support the association, but unmeasured self-selection prevents stronger attribution
   - Location: Abstract; Results §§3.2.1, 3.3–3.4
2. the strength of the citation advantage increases over time: At 12 months postpublication, articles deposited to bioRxiv cumulatively receive 1.62 times more citations than those not deposited, which increases to 1.74 times more citations by 36 months postpublication.
   - Support: Well-supported
   - Type: Secondary
   - Basis: monthly trajectories and the citation-interval interaction directly support the observed 36-month pattern
   - Location: Results §3.4
3. bioRxiv preprints themselves are being directly cited in journal articles, regardless of whether the preprint has subsequently been published in a journal.
   - Support: Well-supported
   - Type: Secondary
   - Basis: direct citation records include both subsequently published and unpublished preprints
   - Location: Abstract; Results §3.2.2
4. bioRxiv preprints are also shared widely on Twitter and in blogs, but remain relatively scarce in mainstream media and Wikipedia articles, in comparison to peer-reviewed journal articles.
   - Support: Well-supported
   - Type: Secondary
   - Basis: indicator-specific Altmetric.com comparisons directly show contrasting coverage across sharing channels
   - Location: Abstract; Results §3.3, Figure 6
5. this advantage is not explained by multiple explanatory variables related to the articles’ publication venues and authorship.
   - Support: Supported
   - Type: Secondary
   - Basis: adjusted models retain the association, though measured covariates do not exhaust plausible confounding
   - Location: Abstract; Results §3.4, Table 3

## Strengths

- **Clear extension of prior bioRxiv evidence** The Introduction delineates four additions to earlier studies: longitudinal citation analysis, direct preprint citations, indicator-specific altmetrics, and regression adjustment. This establishes a concrete incremental contribution rather than a first-study claim.
  - Dimension: contribution
  - Location: Introduction, final two paragraphs
- **Matched modeling suits the association question** Articles are paired within journal and publication month, with subject-category matching for multidisciplinary journals. Negative-binomial models include matched-pair random effects and observed venue and authorship covariates.
  - Dimension: methodological rigour
  - Location: Methods §§2.2 and 2.6
- **Causal limits remain explicit throughout** The Abstract, Introduction, Results §3.4, and Conclusions repeatedly distinguish the observed advantage from a demonstrated causal effect. This qualification is linked to acknowledged self-selection and unmeasured quality.
  - Dimension: reporting
  - Location: Abstract; Introduction; Results §3.4; Conclusions

## Limitations

- **Self-selection remains causally unresolved** Matching and regression address observed differences but cannot determine whether authors preferentially deposit stronger or more visible work. The impact-factor interaction is an indirect proxy rather than a direct sensitivity analysis for this threat.
  - Dimension: methodological rigour
  - Location: Methods §2.6; Results §3.4; Conclusions
- **Publication linkage lacks bias analysis** Only 12,755 of 18,841 preprints were linked to journal articles, and the unmatched fraction is not examined for systematic differences. This limits interpretation of analyses centered on subsequently published articles.
  - Dimension: methodological rigour
  - Location: Methods §2.1; Results §3.1
- **Generalization is platform and period bound** The analysis treats bioRxiv as a whole, does not decompose individual biological subject areas, and follows a 2013–2017 cohort for no more than 36 months. Transfer to other repositories or mature preprint environments therefore remains uncertain.
  - Dimension: application pathway
  - Location: Methods §§2.1–2.4; Results §3.4

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Noted. The reported sample construction and principal findings are internally consistent, but main-text presentation of the longest citation windows is incomplete. The issue does not materially change interpretation of the central association.
- **Research conduct:** Clean. Competing interests and funding are disclosed, and data and code are claimed available through a persistent Zenodo DOI. Ethics approval is not applicable to the bibliographic and platform metadata design.
- **Reference integrity:** Clean. 37 of 37 checkable references verified
  - 43 references in manuscript
  - 5 have no canonical index record — counted, but not index-checkable
  - 1 could not be checked — not the same as no match found
  - 1 reference confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
