# The Hybrid Open Access Citation Advantage: How Many More Cites is a $3,000 Fee Buying You?

- **DOI:** [10.2139/ssrn.2391692](https://doi.org/10.2139/ssrn.2391692)
- **Rating:** Sound (3.4 out of 5)
- **Verdict:** A distinctive pilot-agreement study shows hybrid-access citation estimates collapsing under richer controls, but its decisive null rests on a heavily reduced sample.
- **Framework version:** v5.9
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-09-28
- **Evaluation page:** https://www.nabu.science/paper/10.2139%2Fssrn.2391692

## Key claims

1. Once we additionally control for institution quality and citations to RePEc pre-prints, the marginal HOA citation advantage turns out to insignificant and drops to 0.4%.
   - Support: Supported
   - Type: Primary finding
   - Basis: the reported estimate is consistent across models but depends on a heavily reduced complete-case sample
   - Location: Abstract; Table 4, specification 7
2. Our empirical evidence therefore suggests that HOA does not constitute a significant advantage in the competition for citations.
   - Support: Tentative
   - Type: Secondary
   - Basis: the observational affiliation-based comparison and substantial complete-case attrition limit inference from the null estimate
   - Location: Conclusion, §4
3. HOA turns out to be a significant predictor of citations with marginal effects ranging between 22% and 26%.
   - Support: Tentative
   - Type: Secondary
   - Basis: the estimate comes from specifications later attenuated by institution and preprint controls
   - Location: Abstract; Tables 3–4, specifications 1–5
4. the coefficient for citations to OA pre-prints on RePec is positive and significant at the 1% level
   - Support: Supported
   - Type: Secondary
   - Basis: the conditional association is directly reported in specification 7, though based on the reduced subsample
   - Location: §3.1, p. 15; Table 3, specification 7

## Strengths

- **Distinctive pilot-agreement research setting** The analysis uses institutional pilot agreements under which eligible articles were generally made openly available without authors paying from their own research budgets, reducing the author-choice selection problem motivating prior critiques.
  - Dimension: contribution
  - Location: Introduction, pp. 2–4; Analysis, pp. 7–8
- **Transparent progression across model specifications** Tables 3–6 show how the positive HOA coefficient attenuates after institution quality and RePEc preprint citations are added. Reporting both PQML and negative-binomial results makes this sensitivity visible.
  - Dimension: methodological rigour
  - Location: Tables 3–6; §§3.1–3.2
- **Concrete policy and payment question** The paper ties citation outcomes to an approximately $3,000 hybrid-open-access fee and identifies authors, universities, funders, and publishers as stakeholders in the underlying decision.
  - Dimension: application pathway
  - Location: Title; Introduction, pp. 1–3

## Limitations

- **Decisive model uses reduced sample** The PQML analysis falls from 1,295 observations in specification 1 to 246 in specification 7, while the negative-binomial analysis retains 249. The paper does not assess whether this complete-case subsample is representative.
  - Dimension: methodological rigour
  - Location: Tables 2, 3, and 5
- **Residual institutional confounding remains** Pilot eligibility is linked to institutional affiliation rather than randomized assignment. Institution rank and author-quality controls address part of this concern but do not establish comparability on other institution-, author-, or article-level citation determinants.
  - Dimension: methodological rigour
  - Location: Introduction, pp. 2–3; Analysis, pp. 7–12
- **Limitations not traced into conclusion** The conclusion presents the fully adjusted null as evidence of no significant HOA advantage without discussing the severe sample reduction or narrowing the inference around residual confounding.
  - Dimension: positioning
  - Location: Tables 3 and 5; Conclusion, §4

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Noted. The numerical results are coherent across Tables 2–6, but some headline language gives the institution-linked observational coefficients a stronger causal interpretation than the design securely supports.
- **Research conduct:** Noted. Funding is acknowledged and the bibliometric analysis raises no evident ethics issue, but the ancillary email survey lacks an explicit ethics or consent statement.
- **Reference integrity:** Clean. 17 of 17 checkable references verified
  - 23 references in manuscript
  - 6 have no canonical index record — counted, but not index-checkable
  - 2 references confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
