#methodological rigourDiagnostic inclusion conflates exact and near matches
The reported 90% diagnostic inclusion combines 80 exact and eight near matches among 98 cases. Exact matching is 81.6%, and exact top-three accuracy cannot be recovered from the reported counts.
↳ Abstract; Section 3.9.2; Tables A.6–A.7
#methodological rigourShared AI information compromises clinical comparisons
PCPs received AMIE's transcript and differential before their visits, and non-significant tests do not establish equivalent quality. This exposure also weakens the independence of presumptive chart diagnoses, an implication not fully traced in the discussion.
↳ Sections 3.4, 3.9.2–3.10, 4.5.1, and 6.4; Conclusion
#methodological rigourPooled results obscure mid-study model changes
The base model changed from Gemini 2.5 Pro to Flash after 50 encounters, but outcomes are not stratified by model. Compensation and interview timing also changed during the study, complicating interpretation of pooled experience measures.
↳ Sections 3.3, 3.6, and 3.8