# Citing and reading behaviours in high-energy physics

- **DOI:** [10.1007/s11192-009-0111-1](https://doi.org/10.1007/s11192-009-0111-1)
- **Rating:** Limited (2.8 out of 5)
- **Verdict:** A valuable HEP-wide account of preprint citation and readership patterns whose causal conclusions exceed its uncontrolled observational design.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-28
- **Evaluation page:** https://www.nabu.science/paper/10.1007%2Fs11192-009-0111-1

## Key claims

1. Articles submitted to an Open Access subject repository, arXiv, receive 5 times more citations than articles which are not.
   - Support: Tentative
   - Type: Primary finding
   - Basis: unadjusted comparison leaves acknowledged author and article selection as competing explanations
   - Location: Section 7, finding 1; Section 3, Figure 2
2. The citation advantage of articles appearing in a repository is connected to their dissemination prior to publication, 20% of citations of HEP articles over a two-year period occur before publication.
   - Support: Supported
   - Type: Secondary
   - Basis: time-aligned curves establish pre-publication accumulation but do not isolate dissemination as the causal mechanism
   - Location: Section 7, finding 2; Section 4, Figure 4
3. No discernable citation advantage can yet be observed in the statistically-limited sample of articles published in “gold” Open Access journals.
   - Support: Supported
   - Type: Secondary
   - Basis: controlled institutional comparison supports the qualified null within a short and statistically limited sample
   - Location: Section 7, finding 3; Section 5, Figure 5
4. HEP scientists are between four and eight times more likely to download an article in its preprint form from arXiv rather than its final published version on a journal web site.
   - Support: Supported
   - Type: Secondary
   - Basis: single-month SPIRES clickstream has unequal access paths and only approximates community-wide downloads
   - Location: Section 7, finding 4; Section 6, Figure 6

## Strengths

- **Multiple evidence streams address one debate** Sections 3–6 combine citation comparisons, temporal accumulation curves, a gold-OA analysis, and clickstream behavior rather than relying on a single bibliometric outcome.
  - Dimension: contribution
  - Location: Sections 3–6; Figures 2–6
- **Citation timing is directly characterized** Figures 3 and 4 align citations to publication time and show that arXiv papers already hold 20% of their two-year citations at publication.
  - Dimension: methodological rigour
  - Location: Section 4; Figures 3–4
- **Specific policy users are identified** The Introduction names librarians, policymakers, publishers, and scientists, while Section 7 connects the findings to SCOAP3.
  - Dimension: application pathway
  - Location: Introduction; Section 7

## Limitations

- **Headline comparison leaves selection uncontrolled** Section 3 identifies influential adopters and selective posting of higher-quality work as alternative explanations but does not match, stratify, or adjust for them.
  - Dimension: methodological rigour
  - Location: Section 3, discussion after Figure 2
- **Conclusions exceed observational identification** The Abstract says dissemination “creates” the citation advantage, and Section 7 attributes faster discourse to free circulation despite the unresolved selection explanation.
  - Dimension: reporting
  - Location: Abstract; Section 7, general conclusion 1
- **Click paths complicate reading inference** SPIRES links directly to arXiv full text but commonly sends publisher clicks to a splash page, so Figure 6 does not isolate format preference from access friction.
  - Dimension: methodological rigour
  - Location: Section 6, Figure 6 and following discussion

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Noted. The numerical findings are mutually consistent, but the causal synthesis is stronger than the acknowledged uncertainty permits. The unresolved selection explanation in Section 3 is not carried into the Abstract or general conclusions.
- **Research conduct:** Clean. No ethics, conflict, protocol, or suspicious availability concern is evident for the aggregate bibliometric and clickstream analyses. The absence of a replication package is consistent with the study's era and was not treated as a reliability defect.
- **Reference integrity:** Clean. 17 of 17 checkable references verified
  - 25 references in manuscript
  - 8 have no canonical index record — counted, but not index-checkable
  - 2 references confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
