# On focusing statistical power for searches and measurements in particle physics

- **DOI:** [10.1140/epjc/s10052-026-16023-1](https://doi.org/10.1140/epjc/s10052-026-16023-1)
- **Rating:** Strong (4.2 out of 5)
- **Verdict:** A strong HEP statistics method that focuses power effectively, but full-analysis validation remains its main constraint.
- **Framework version:** v5.5
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-07-27
- **Evaluation page:** https://www.nabu.science/paper/10.1140%2Fepjc%2Fs10052-026-16023-1

## Key claims

1. FTS with a narrow, well-specified focus function yields 22% smaller 68% confidence intervals than LRS for the Higgs measurement and 65% smaller intervals for the dark matter search
   - Support: Supported
   - Type: Primary finding
   - Basis: directly shown in proof-of-concept simulations, with simplified LZ setup limiting generality
   - Location: Discussion §4; Table 1
2. Our proposed approach yields frequentist valid tests and confidence intervals, which have optimal power with respect to the focus function.
   - Support: Supported
   - Type: Secondary
   - Basis: optimality is proved, while validity is conditional on perfectly estimated quantile regression
   - Location: Section 2.4; Appendix D
3. We also employ machine learning to efficiently calibrate critical values for a family of tests
   - Support: Supported
   - Type: Secondary
   - Basis: Figure 3 reports lower MSE for quantile regression at matched simulation budgets
   - Location: Abstract; Section 3.1.2; Figure 3
4. the FTS can enhance discovery potential and physics sensitivities across many experiments
   - Support: Tentative
   - Type: Secondary
   - Basis: plausible from two examples but not validated in full experimental pipelines
   - Location: Discussion §4

## Strengths

- **Formal power-allocation result is explicit** Appendix D proves that FTS confidence sets minimize expected interval length under the focus-induced marginal while maintaining coverage constraints. This connects the proposed statistic to a clear optimality target rather than only empirical performance.
  - Dimension: methodological rigour
  - Location: Appendix D, Theorem 1
- **Case studies match HEP use cases** The experiments cover a Higgs signal-strength measurement and an LZ-inspired WIMP search, both framed as composite-testing problems central to particle-physics practice. Tables 1–3 and Figures 2–4 show the proposed statistic against the standard likelihood-ratio baseline.
  - Dimension: contribution
  - Location: Sections 3.1–3.2; Figures 2–4; Tables 1–3
- **Limitations and bias are discussed directly** The paper explains that FTS deliberately reallocates power and may be technically biased without compromising nominal coverage. It also discusses focus selection, double-dipping risk, empty confidence sets, and the tradeoff between narrow and broad focus functions.
  - Dimension: reporting
  - Location: Sections 2.5–2.6; Discussion §4

## Limitations

- **Finite-sample calibration remains conditional** The validity statement depends on perfect quantile-regression estimation, and the paper provides empirical calibration evidence rather than a formal finite-sample coverage analysis under QR error. This limits certainty about practical coverage in harder settings.
  - Dimension: methodological rigour
  - Location: Section 2.4; Figure 3; Appendix C
- **LZ demonstration is deliberately simplified** The dark-matter case uses synthetic data designed to mimic LZ signal and background structure rather than official LZ simulation samples or a full experimental likelihood. That limits how directly the reported 47% and 65% interval-length reductions translate to the actual experiment.
  - Dimension: application pathway
  - Location: Section 3.2; Appendix A.2; Table 1
- **Nuisance parameters are not tested** Real HEP analyses commonly involve nuisance parameters, but the main demonstrations focus on one-dimensional signal-strength settings and point to complementary work rather than testing nuisance-parameter performance here. This is the main barrier to routine adoption.
  - Dimension: application pathway
  - Location: Section 2.3; Discussion §4; Reference 37

## Reliability checks

No concerns (4 of 4 checks).

- **Internal coherence:** Clean. The paper’s methods, theorem statements, and main tabulated numerical results are internally coherent. A Figure 2 caption percentage discrepancy relative to Table 1 and Section 3.2.2 is treated as a minor presentation issue rather than a reliability concern.
- **Research conduct:** Clean. No research-conduct concerns are apparent for this theoretical/computational paper. Funding is disclosed, ethics approval is not applicable on the supplied text, and a public code repository is named in the Data Availability Statement.
- **Reference integrity:** Clean. 50 of 50 checkable references verified
  - 61 references in manuscript
  - 11 have no canonical index record — counted, but not index-checkable
  - 11 references confirmed by manual review
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
