# Free online availability substantially increases a paper's impact

- **DOI:** [10.1038/35079151](https://doi.org/10.1038/35079151)
- **Rating:** Limited (2.7 out of 5)
- **Verdict:** A foundational large-scale association between online availability and citations whose causal framing exceeds what its cross-sectional design can establish.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-29
- **Evaluation page:** https://www.nabu.science/paper/10.1038%2F35079151

## Key claims

1. Free online availability substantially increases a paper’s impact
   - Support: Tentative
   - Type: Primary finding
   - Basis: causal wording is not identified by the cross-sectional comparison
   - Location: Title
2. The mean number of citations to offline articles is 2.74, and the mean number of citations to online articles is 7.03, an increase of 157%.
   - Support: Well-supported
   - Type: Secondary
   - Basis: directly reported descriptive means from the analysed article sample
   - Location: Full text, headline results paragraph
3. Averaging the percentage increase across 1,494 venues containing at least five offline and five online articles results in an average of 336% (median 158%) more citations to online computer-science articles
   - Support: Supported
   - Type: Secondary
   - Basis: within-venue comparison supports the direction, though its percentage convention and confounding limit interpretation
   - Location: Full text, paragraph beginning “We analysed differences within publication venues”
4. Restricting our analysis to the top 20 publication venues by average citation rate gives an increase of 286% (median 284%) in the citation rate for online articles.
   - Support: Supported
   - Type: Secondary
   - Basis: reported top-venue comparison tests venue quality but not article-level selection
   - Location: Full text, paragraph beginning “If we assume”

## Strengths

- **Large early bibliometric evidence base** The analysis covers 119,924 conference articles and reports citation differences between online and offline papers, providing a substantial descriptive evidence base for the e-access debate.
  - Dimension: contribution
  - Location: Full text, paragraph beginning “We analysed 119,924”
- **Within-venue comparison tests one alternative** Comparing online and offline papers within 1,494 publication venues partially reduces broad venue-level quality differences, with a further restriction to the top 20 venues.
  - Dimension: methodological rigour
  - Location: Full text, paragraphs beginning “We analysed differences within publication venues” and “If we assume”
- **Clear relevance to access decisions** The final paragraph identifies authors and publishers as actors who can make research easier to access, giving the findings a visible scholarly-communications pathway.
  - Dimension: application pathway
  - Location: Full text, final paragraph

## Limitations

- **Causal framing exceeds observational evidence** The title states that free availability increases impact, but the reported analysis establishes correlation and makes causal interpretation conditional on an untested quality assumption.
  - Dimension: methodological rigour
  - Location: Title; full text, paragraph beginning “If we assume”
- **Selection and timing remain unresolved** The analysis does not separate accessibility effects from author self-selection, article-level prominence, or the possibility that citation accumulation preceded online detection.
  - Dimension: methodological rigour
  - Location: Full text, methods and within-venue analysis paragraphs
- **Evidence is narrowly field-specific** The sample is limited to computer-science and related conference articles, whose publication and indexing environment may not represent disciplines centered on journal literature.
  - Dimension: application pathway
  - Location: Full text, paragraph beginning “We analysed 119,924”

## Reliability checks

Caveats (3 of 4 checks).

- **Internal coherence:** Noted. The descriptive citation figures are internally coherent, but the unconditional causal framing exceeds the observational analysis and its stated assumptions. The venue-level percentage convention is disclosed, although its implications for the mean are not examined.
- **Research conduct:** Clean. The bibliometric study did not require human-participant ethics review, and the supplied text presents no location-referenced conduct concern. Named databases and acknowledged coverage limitations provide basic source transparency.
- **Reference integrity:** Not checked. Reference integrity check could not run: no references section detected in extracted text.
  - 0 references in manuscript

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
