Loading evaluation data…
The anti-stigma program improved the knowledge and attitudes, but not the behavioural intentions of participants towards their peers with autism.
class-level pseudo-randomisation and null between-condition attitude contrasts limit the causal claim
Replication outlook: fragile
Knowledge and attitudinal changes were maintained at follow-up.
follow-up comparisons use reduced complete-case samples without transparent missing-data handling
Replication outlook: uncertain
There were no spill-over effects of the program to non-targeted students.
a null finding from limited comparison groups cannot exclude smaller spill-over effects
These results provide some preliminary evidence for the effectiveness of multi-session anti-stigma programs incorporating combined information for adolescent students in inclusive educational environments.
the appropriately hedged claim rests on one narrowly sampled, pseudo-randomised school study
Derived from the full evaluation — not a separate score.
Strengths
Knowledge increased markedly in the intervention condition and remained higher than both comparison conditions at post-test and follow-up, with large reported effect sizes.
↳ Results, Knowledge About HFA, pp. 13–14
The abstract, results, and discussion all state that behavioural intentions did not improve, rather than treating knowledge and attitude findings as universal success.
↳ Abstract, p. 2; Results, p. 15; Discussion, pp. 15–18
The appendix specifies each session's goals, learning outcomes, classroom activities, online reflections, and discussion prompts, providing a concrete basis for adaptation or replication.
↳ Appendix, pp. 26–27
Limitations
Repeated-measures denominators and paired-test sample sizes are far below the recruited sample, but participant flow, condition-specific missingness, imputation, and sensitivity analyses are not reported. Differential complete-case loss could materially alter the intervention and maintenance estimates.
↳ Methods, Data Analysis, pp. 11–12; Results, pp. 13–15
A class with a high proportion of HFA students was excluded from intervention randomisation, only two classes received the intervention, and the individual-level analyses do not account for class clustering.
↳ Methods, Participants, p. 8; Discussion, p. 19
Although attitudes changed within the intervention group and the time-by-condition interaction was significant, between-condition differences at post-test and follow-up were not significant. The abstract and conclusion do not preserve that distinction.
↳ Abstract, p. 2; Results, Attitudes Towards Peers with HFA, p. 14; Conclusion, pp. 19–20
The most credible result is the large knowledge gain, which was evident both over time and against the comparison conditions at post-test and follow-up. Evidence for attitude improvement is less secure because the controlled post-test and follow-up contrasts were non-significant despite a significant interaction and within-intervention change. The paper's acknowledged pseudo-randomisation is compounded by individual-level analyses that do not account for class assignment and by substantial unexplained reductions in repeated-measures sample sizes. Its detailed intervention appendix and candid reporting of the behavioural-intentions null make it useful for designing a stronger multisite evaluation, but not sufficient for routine implementation.
Nabu’s assessment, alongside the field’s view.
Are you an author of this paper?
Limited2.0
The study meaningfully extends a small HFA anti-stigma literature through a six-session intervention, follow-up assessment, directive information, and spill-over testing. Its contribution is substantially constrained by class-level assignment without clustering adjustment and less secure controlled evidence for attitude change.
“These results provide some preliminary evidence for the effectiveness of multi-session anti-stigma programs”
The design includes pre-, post-, and follow-up measures, manipulation checks, effect sizes, and stated multiplicity and sphericity procedures. Pseudo-randomisation, unmodelled class assignment, subjective unblinded outcomes, and unexplained complete-case loss produce an uncapped score of 2.3, which is capped at 1.5 by the Red reliability flag.
“the randomisation may be better referred to as a ‘pseudo-randomisation’ process”
The hypotheses, results, and discussion follow a readily traceable structure, and the null behavioural-intentions finding is reported directly. The abstract nevertheless describes attitudes as improved without disclosing that post-test and follow-up between-condition attitude contrasts were non-significant.
“The anti-stigma program improved the knowledge and attitudes”
The paper engages directly with prior HFA interventions and provides a detailed limitations discussion that traces several threats to interpretation. The closing recommendation that such programs should be used undercuts that caution and exceeds the single-school, self-report, pseudo-randomised evidence.
“should be used with adolescent boys”
Lower confidence on Contribution — domain match limited.
Concerns4 of 4 checks
Core repeated-measures analyses use substantially fewer observations than the recruited sample without a transparent missing-data account, creating material uncertainty about the intervention estimates. The directive-information manipulation check also reports a lower post-test score while interpreting the result as improvement.
Written parent and student consent is reported, but the supplied article contains no explicit ethics-committee approval or conflict-of-interest declaration. Registration and data/code statements are also absent, although their absence is consistent with the publication era and field.
Flags: 0 declared / 5 total
37 of 42 checkable references verified
50 references in manuscript 5 are books, websites or datasets — counted, but not index-checkable 3 could not be checked — not the same as no match found
No retraction notice found in Retraction Watch.
Sources: Retraction Watch ✓
Low2.7
Schools, educators, and inclusion staff are identifiable users, and the appendix gives a session-by-session program that could inform curriculum development. The pathway is concrete but remains tied to one intervention and demographic.
“Understanding Our Peers”
The intervention was delivered in an operating school through six specified sessions, placing it beyond a purely conceptual proposal. It remains an early-efficacy study because behavioural intentions did not improve and actual behaviour was not observed.
“had no effect on participants’ or non-participants’ intentions to engage”
Generalizability is narrow because the sample came from one independent Catholic all-boys school in a predominantly middle-class suburb. The study reports no multisite replication or demographic sensitivity analysis.
“the generalizability of the results is restricted by the sample”
The study directly develops prior HFA anti-stigma work by adding multiple sessions, directive information, direct contact, follow-up, and spill-over assessment. Its role in a cumulative trajectory is limited by the design and analytic constraints requiring stronger replication.
“future research should also compare the combined effects”
AI-generated, human-governed. Something look off? Contact us to request a review.