nabu.science
MethodologyAboutContact

 

Reliability concern: This paper was retracted on 2020-06-05. See notice: 10.1016/s0140-6736(20)31324-6.

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-3F9A3454·Framework v5.0·Pipeline v0.4·Evaluated 08 Jun 2026·OECD: 3.1 Clinical medicine·Subfield: Infectious Diseases·Basis: Full text·Type: Observational cohort study

RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis.

Mehra et al.Mehra, Desai, Ruschitzka et al.·2020·Lancet (London, England)·10.1016/s0140-6736(20)31180-6 ↗

In brief

A large, methodologically polished observational analysis answering an urgent COVID-19 treatment question, fatally constrained by a proprietary single-source dataset that cannot be independently verified.

ReliabilityConcerns4 of 4 checks completeErratum published 30 May 2020Read the 3 entries ↓
Abstract

BACKGROUND: Hydroxychloroquine or chloroquine, often in combination with a second-generation macrolide, are being widely used for treatment of COVID-19, despite no conclusive evidence of their benefit. Although generally safe when used for approved indications such as autoimmune disease or malaria, the safety and benefit of these treatment regimens are poorly evaluated in COVID-19.

METHODS: We did a multinational registry analysis of the use of hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19. The registry comprised data from 671 hospitals in six continents. We included patients hospitalised between Dec 20, 2019, and April 14, 2020, with a positive laboratory finding for SARS-CoV-2. Patients who received one of the treatments of interest within 48 h of diagnosis were included in one of four treatment groups (chloroquine alone, chloroquine with a macrolide, hydroxychloroquine alone, or hydroxychloroquine with a macrolide), and patients who received none of these treatments formed the control group. Patients for whom one of the treatments of interest was initiated more than 48 h after diagnosis or while they were on mechanical ventilation, as well as patients who received remdesivir, were excluded. The main outcomes of interest were in-hospital mortality and the occurrence of de-novo ventricular arrhythmias (non-sustained or sustained ventricular tachycardia or ventricular fibrillation).

FINDINGS: 96 032 patients (mean age 53·8 years, 46·3% women) with COVID-19 were hospitalised during the study period and met the inclusion criteria. Of these, 14 888 patients were in the treatment groups (1868 received chloroquine, 3783 received chloroquine with a macrolide, 3016 received hydroxychloroquine, and 6221 received hydroxychloroquine with a macrolide) and 81 144 patients were in the control group. 10 698 (11·1%) patients died in hospital. After controlling for multiple confounding factors (age, sex, race or ethnicity, body-mass index, underlying cardiovascular disease and its risk factors, diabetes, underlying lung disease, smoking, immunosuppressed condition, and baseline disease severity), when compared with mortality in the control group (9·3%), hydroxychloroquine (18·0%; hazard ratio 1·335, 95% CI 1·223-1·457), hydroxychloroquine with a macrolide (23·8%; 1·447, 1·368-1·531), chloroquine (16·4%; 1·365, 1·218-1·531), and chloroquine with a macrolide (22·2%; 1·368, 1·273-1·469) were each independently associated with an increased risk of in-hospital mortality. Compared with the control group (0·3%), hydroxychloroquine (6·1%; 2·369, 1·935-2·900), hydroxychloroquine with a macrolide (8·1%; 5·106, 4·106-5·983), chloroquine (4·3%; 3·561, 2·760-4·596), and chloroquine with a macrolide (6·5%; 4·011, 3·344-4·812) were independently associated with an increased risk of de-novo ventricular arrhythmia during hospitalisation.

INTERPRETATION: We were unable to confirm a benefit of hydroxychloroquine or chloroquine, when used alone or with a macrolide, on in-hospital outcomes for COVID-19. Each of these drug regimens was associated with decreased in-hospital survival and an increased frequency of ventricular arrhythmias when used for treatment of COVID-19.

FUNDING: William Harvey Distinguished Chair in Advanced Cardiovascular Medicine at Brigham and Women's Hospital.

Strengths · Limitations

Strengths

#application pathway

Urgent question with named decision-makers

The paper directly addresses whether hydroxychloroquine and chloroquine should be used for hospitalised COVID-19, a decision being actively made by clinicians, regulators, and trialists, with the clinical setting and mechanism of impact named explicitly.

↳ Introduction; Discussion

#methodological rigour

Appropriate analytic design on paper

The study applies Cox proportional hazards regression, propensity-score matching with standardised mean differences under 10%, continent-stratified analyses, and a tipping-point sensitivity analysis suited to the observational question.

↳ Methods: Statistical Analysis; Results, Sensitivity Analyses

#reporting

Clear structure and explicit statistical caveats

The argument flows logically with consistent tabulation, and figure captions explicitly note that confidence intervals are unadjusted for multiple testing and should not infer definitive effects.

↳ Tables 1-2; Figures 2-3 captions

Limitations

#methodological rigour

Unverifiable proprietary single-source data

The entire analysis rests on a proprietary registry whose governance, certification, and validation claims cannot be independently confirmed from the manuscript, and no data or code is shared. This is the most fundamental reliability concern for an observational study and caps the Craft score.

↳ Methods: Registry Features and Data Acquisition

#methodological rigour

Problematic missing-data assumption

Absent diagnostic codes are treated as confirmed absence of the condition, a strong assumption for electronic-health-record data that can bias cohort composition and covariate measurement and is acknowledged but not formally assessed.

↳ Methods: Statistical Analysis

#contribution

Implausibly large arrhythmia effect sizes

Reported hazard ratios for ventricular arrhythmia of roughly 2.4 to 5.1 are large and surprising relative to contemporaneous literature, and no explanation is offered for the magnitude.

↳ Results, Figure 3

Does this match your read? Add your assessment ↓

Withdrawn — shown for reference only

Nabu Commentary

The evaluation converged on a polished observational analysis built on a foundation that cannot be inspected. The design elements visible in the methods and sensitivity analyses are appropriate to the question, but the missingness rule that equates absent codes with absent conditions, inadequately addressed residual confounding, and effect sizes for arrhythmia that are large relative to prior literature all weigh against full credit. The decisive issue is that the core findings depend on a proprietary single-source registry whose data governance and validation claims cannot be independently verified, which caps the Methodological Rigour assessment and discounts the contribution. Where the evaluation diverged most was how much credit the claimed multinational scope and the realized policy influence should receive, and the adjudicated scores hold those to the evidence the paper actually presents rather than to outcomes after publication.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
2.5±0.2

Contribution
2.2

The paper targets a maximally urgent clinical question and claims the largest real-world comparison of hydroxychloroquine and chloroquine regimens to date, but the entire contribution is contingent on a dataset that cannot be independently verified. The score credits the genuine importance and formally appropriate framing while discounting heavily for the unverifiable data substrate.

Research in context; Methods: Registry Features and Data Acquisition

these findings provide the most comprehensive evidence of the use of hydroxychloroquine and chloroquine

Methodological Rigour
2.0

On the merits the design is appropriate, with Cox proportional hazards regression, propensity-score matching achieving standardised mean differences under 10%, continent-stratified analyses, and a tipping-point sensitivity analysis, but the missingness rule that treats absent codes as absent conditions and inadequately addressed residual confounding temper the merit-based assessment to 3.0. The Red reliability flag for the unverifiable single-source registry caps the editorial Methodological Rigour score at 2.0 regardless of merit.

Methods: Statistical Analysis; Results, Sensitivity Analyses

if the patient's electronic health record did not include information on a clinical characteristic, it was assumed that the characteristic was not present

Reporting
3.7

The argument flows logically from introduction through methods, results, and discussion, with consistent tabulation and explicit figure caveats about unadjusted multiple testing. Precision is slightly reduced by a prescriptive conclusion that reads more interventionist than an observational design supports.

Tables 1-2; Figures 2-3 captions; Discussion / Conclusion

The 95% CIs have not been adjusted for multiple testing and should not be used to infer definitive effects

Positioning
3.4

The paper engages relevant contemporaneous evidence including the Veterans Affairs cohort, the French observational study, and the Borba randomised trial, and offers a plausible arrhythmia mechanism. Positioning as the most robust real-world evidence overstates what the design supports, and there is no declared observational reporting standard.

Research in context; Discussion

provides the most robust real-world evidence to date on the usefulness of these treatment regimens

Lower confidence on Methodological Rigour — domain match limited.

Reliability

Concerns4 of 4 checks


Internal CoherenceNoted

The paper's internal arithmetic is consistent across abstract, tables, and figures, but several features carry plausibility tensions: a prospective globally comprehensive registry is reconciled with exclusion of patients without a completed hospital course and a missingness rule that treats absent codes as absent conditions, and the strong prescriptive conclusion sits against the Discussion's own non-causal caveat.

Research ConductConcern

Core findings rest on a proprietary single-source registry (Surgisphere) whose provenance and validation claims cannot be independently verified from the manuscript, with no public data or code, and a declared-but-unverifiable ethics exemption. Combined with large, surprising effect sizes, this meets the unverifiable single-source data threshold.

Flags: 1 declared / 5 total

Reference IntegrityClean

All 34 cited references resolved to real publications via PubMed, Crossref, or OpenAlex.

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordConcern

This paper was retracted on 2020-06-05. See notice: 10.1016/s0140-6736(20)31324-6.

Erratum published 30 May 2020 · listed in Crossref

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaHealth · Infection · COVID-19
Type of advanceEmpirical
Route to useNamed
AdvanceAdvances
BeneficiariesLarge
CitationsFWCI 30.7
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessValidated
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The primary claim is tested on real-world population data from 96,032 hospitalised patients across 671 hospitals on six continents, an independent multi-site setting.

From the paper
“These findings suggest that these drug regimens should not be used outside of clinical trials and urgent confirmation from randomised clinical trials is needed.”

The conclusion tells clinicians treating hospitalised COVID-19 patients to stop using these regimens outside trials, and calls on trial teams for urgent randomised confirmation.

Pathway

Hospital clinicians treating COVID-19 patients, and regulators and guideline bodies issuing emergency use authorisations, would stop using these drug regimens outside clinical trials.

Barrier

The observational design cannot exclude unmeasured confounding, so the authors themselves say randomised clinical trials are required before any conclusion on benefit or harm.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Dexamethasone in Hospitalized Patients with Covid-19

    RECOVERY Collaborative Group, Horby, Lim, et al. · 2020 · Clinical medicine

    Primary claim

    Overall, 482 patients (22.9%) in the dexamethasone group and 1110 patients (25.7%) in the usual care group died within 28 days after randomization (age-adjusted rate ratio, 0.83; 95% confidence interval [CI], 0.75 to 0.93; P<0.001).

    Well-supported
    Evidence Score
    4.3±0.2
    Reliability
    Caveats
  2. Cognitive outcome in relation to cerebrospinal fluid markers of neuronal and glial cell damage: A prospective study of tick-borne encephalitis

    2026 · Clinical medicine

    Primary claim

    CSF GFAP showed the strongest association with long-term cognitive outcome and may reflect astrocytic activation related to persistent cognitive impairment.

    Tentative
    Evidence Score
    3.2±0.2
    Reliability
    Caveats
  3. C9ORF72 repeat expansion causes vulnerability of motor neurons to Ca2+-permeable AMPA receptor-mediated excitotoxicity

    Selvaraj, Livesey, Zhao, et al. · 2018 · Basic medicine

    Primary claim

    increased expression of GluA1 AMPA receptor (AMPAR) subunit occurs in MNs with C9ORF72 mutations that leads to increased Ca2+-permeable AMPAR expression and results in enhanced selective MN vulnerability to excitotoxicity.

    Tentative
    Evidence Score
    3.1±0.2
    Reliability
    Caveats

How the rubric works →