Loading evaluation data…
The volume of scientific literature far exceeds the ability of scientists to identify and use all relevant information. The ability to locate relevant research quickly will dramatically improve communication and scientific progress. Although availability varies greatly by discipline, more than a million research articles are now freely available on the web.
Free online availability substantially increases a paper’s impact
causal wording is not identified by the cross-sectional comparison
The mean number of citations to offline articles is 2.74, and the mean number of citations to online articles is 7.03, an increase of 157%.
directly reported descriptive means from the analysed article sample
Averaging the percentage increase across 1,494 venues containing at least five offline and five online articles results in an average of 336% (median 158%) more citations to online computer-science articles
within-venue comparison supports the direction, though its percentage convention and confounding limit interpretation
Restricting our analysis to the top 20 publication venues by average citation rate gives an increase of 286% (median 284%) in the citation rate for online articles.
reported top-venue comparison tests venue quality but not article-level selection
Derived from the full evaluation — not a separate score.
Strengths
The analysis covers 119,924 conference articles and reports citation differences between online and offline papers, providing a substantial descriptive evidence base for the e-access debate.
↳ Full text, paragraph beginning “We analysed 119,924”
Comparing online and offline papers within 1,494 publication venues partially reduces broad venue-level quality differences, with a further restriction to the top 20 venues.
↳ Full text, paragraphs beginning “We analysed differences within publication venues” and “If we assume”
The final paragraph identifies authors and publishers as actors who can make research easier to access, giving the findings a visible scholarly-communications pathway.
↳ Full text, final paragraph
Limitations
The title states that free availability increases impact, but the reported analysis establishes correlation and makes causal interpretation conditional on an untested quality assumption.
↳ Title; full text, paragraph beginning “If we assume”
The analysis does not separate accessibility effects from author self-selection, article-level prominence, or the possibility that citation accumulation preceded online detection.
↳ Full text, methods and within-venue analysis paragraphs
The sample is limited to computer-science and related conference articles, whose publication and indexing environment may not represent disciplines centered on journal literature.
↳ Full text, paragraph beginning “We analysed 119,924”
The large sample and within-venue comparison make the paper a meaningful early descriptive contribution to the e-access debate. The analysis nevertheless remains cross-sectional: online status, citation accumulation, author self-selection, and article-level prominence are not separated. That limitation is decisive because the title and discussion attribute higher citation rates to easier availability rather than retaining associational language. The presentation is concise and the numerical comparisons are easy to locate, but the single-field setting and unresolved causal identification constrain translation and transferability.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Limited2.7
Confidence highThe analysis adds a large early empirical comparison of citation rates across 119,924 computer-science conference articles, including within-venue and top-venue summaries. Its contribution is meaningful as descriptive evidence but does not resolve whether access itself causes higher citation counts.
“The mean number of citations to offline articles is 2.74, and the mean number of citations to online articles is 7.03”
Within-venue comparisons partially address venue-level differences, but author self-selection, article-level quality, and exposure-outcome ordering remain uncontrolled. The title and discussion then attribute the citation difference to easier availability, activating stacked serious methodological ceilings.
“the analysis by venue suggests that online articles are more highly cited because of their easier availability”
The letter moves concisely from data sources to pooled, venue-level, and top-venue results, and it states its similar-quality assumption explicitly. Precision is reduced because the title converts the observed association into an unconditional causal conclusion.
“Free online availability substantially increases a paper’s impact”
The study is situated in the contemporary e-access debate and tests one stated quality-comparability assumption through a top-20-venue restriction. It does not discuss self-selection into online posting or reverse causation, alternatives decisive for the causal interpretation.
“This assumption is likely to be more valid for top-tier conferences”
Lower confidence on Contribution, Positioning — domain match limited.
Caveats3 of 4 checks
The descriptive citation figures are internally coherent, but the unconditional causal framing exceeds the observational analysis and its stated assumptions. The venue-level percentage convention is disclosed, although its implications for the mean are not examined.
The bibliometric study did not require human-participant ethics review, and the supplied text presents no location-referenced conduct concern. Named databases and acknowledged coverage limitations provide basic source transparency.
Flags: 0 declared / 5 total
Reference integrity check could not run: no references section detected in extracted text.
0 references in manuscript
No retraction notice found in Retraction Watch.
Sources: Retraction Watch ✓
Where this paper’s evidence sits on the path from initial observation to real-world use.
The large observational dataset reflects real publication conditions, but the evidence remains preliminary for intervention or policy because it cannot isolate an access effect. Additional causal validation would be required before treating the reported percentages as expected benefits of implementation.
“If we assume that articles published in the same venue are of similar quality”
AI-generated, human-governed. Something look off? Contact us to request a review.