# Applications of the experience sampling method (ESM) in paediatric healthcare: a systematic review

- **DOI:** [10.1038/s41390-023-02918-2](https://doi.org/10.1038/s41390-023-02918-2)
- **Rating:** Sound (3.5 out of 5)
- **Verdict:** First systematic map of ESM in paediatric chronic illness provides a useful field baseline constrained by the descriptive scope of its synthesis.
- **Framework version:** v5.0
- **Pipeline version:** v0.4
- **Evaluation date:** 2026-05-20
- **Evaluation page:** https://www.nabu.science/paper/10.1038%2Fs41390-023-02918-2

## Strengths

- **Pre-registered design with systematic multi-database search** The review was prospectively registered in PROSPERO, searched five databases from inception with a research librarian, and reported interrater agreement at each screening stage (96.82%, 94.88%, 87.41%). Data extraction materials and quality assessments are deposited on OSF.
  - Dimension: methodological rigour
  - Location: Methods — Search strategy, Study selection, Data extraction; Data Availability section
- **Transparent study-level quality assessment revealing field gaps** All 48 included studies were assessed using the van Roekel checklist, with results reported at the individual study level in Table 3. The finding that 56.25% of studies were rated poor quality and none achieved good quality is a substantive contribution to quality benchmarking in this subfield.
  - Dimension: contribution
  - Location: Results — Quality of ESM data and studies; Table 3
- **Clear presentation with comprehensive reference tables** Tables 1, 2, and 3 provide detailed, well-organized study-level information on purpose, sample characteristics, ESM design parameters, and quality scores. This creates a usable reference resource for researchers and clinicians planning ESM implementations in paediatric settings.
  - Dimension: reporting
  - Location: Tables 1, 2, 3; Fig. 1

## Limitations

- **Data extraction lacks full independent dual extraction** Each of the two researchers extracted data from 50% of selected articles and cross-checked the other 50%. This 50/50 split with cross-checking is a weaker approach than full independent dual extraction and reduces confidence in extraction accuracy, particularly given the complexity of the ESM-specific data points extracted.
  - Dimension: methodological rigour
  - Location: Methods — Data extraction
- **Missing inter-rater reliability for quality assessment** While interrater agreement is reported for all title/abstract and full-text screening stages, no inter-rater reliability statistics are provided for the quality assessment using the van Roekel checklist. Given that quality assessment results are a primary outcome of the review, this is a notable methodological gap.
  - Dimension: methodological rigour
  - Location: Methods — Quality and risk of bias; Table 3
- **Non-standard upper age limit weakens paediatric framing** The inclusion of studies with participants up to age 25 extends beyond standard paediatric definitions. Several included studies feature mean participant ages above 20 years, complicating the review's framing as specifically paediatric. The methodological justification for this age boundary is limited.
  - Dimension: positioning
  - Location: Methods — Eligibility criteria; Table 1 (e.g., Gevonden et al., mean age 26.5; Campbell et al., mean age 23)

## Reliability checks

Caveats (4 of 4 checks).

- **Internal coherence:** Clean. The paper is internally consistent across abstract, full text, tables, and PRISMA flow diagram. Numbers (47 papers, 48 studies, 1726 participants) are coherent throughout. No statistical impossibilities, methods-results mismatches, or selective reporting signs were identified.
- **Research conduct:** Noted. The study is prospectively registered in PROSPERO (CRD42022268954), declares PRISMA 2020 and AMSTAR 2 compliance, and deposits data on OSF with a specific URL and view-only token. No ethics approval is expected for a systematic review. A formal conflict of interest statement is not visible in the provided text, which is noted as a minor gap.
- **Reference integrity:** Clean. All 17 cited references resolved to real publications via PubMed, Crossref, or OpenAlex.
  - References not verified automatically are resolved manually within 24 hours.

## Post-publication record

- **Status:** Clean
- **Summary:** No retraction or expression of concern found in Crossref (includes Retraction Watch).
- **Last checked:** 2026-10-17
