nabu.science
MethodologyAboutContact

 

Reliability concern: This paper was retracted on 2020-06-05. See notice: 10.1016/s0140-6736(20)31324-6.

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Readiness
Report #NBU-3F9A3454·Framework v5.0·Pipeline v0.4·Evaluated 08 Jun 2026·OECD: 3.1 Clinical medicine·Subfield: Infectious Diseases·Basis: Full text·Type: Observational cohort study

RETRACTED: Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis.

Mehra et al.Mehra, Desai, Ruschitzka et al.·2020·Lancet (London, England)·10.1016/s0140-6736(20)31180-6 ↗

In brief

A large, methodologically polished observational analysis answering an urgent COVID-19 treatment question, fatally constrained by a proprietary single-source dataset that cannot be independently verified.

ReliabilityConcerns4 of 4 checks completeErratum published 30 May 2020Read the 3 entries ↓
Abstract

BACKGROUND: Hydroxychloroquine or chloroquine, often in combination with a second-generation macrolide, are being widely used for treatment of COVID-19, despite no conclusive evidence of their benefit. Although generally safe when used for approved indications such as autoimmune disease or malaria, the safety and benefit of these treatment regimens are poorly evaluated in COVID-19.

METHODS: We did a multinational registry analysis of the use of hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19. The registry comprised data from 671 hospitals in six continents. We included patients hospitalised between Dec 20, 2019, and April 14, 2020, with a positive laboratory finding for SARS-CoV-2. Patients who received one of the treatments of interest within 48 h of diagnosis were included in one of four treatment groups (chloroquine alone, chloroquine with a macrolide, hydroxychloroquine alone, or hydroxychloroquine with a macrolide), and patients who received none of these treatments formed the control group. Patients for whom one of the treatments of interest was initiated more than 48 h after diagnosis or while they were on mechanical ventilation, as well as patients who received remdesivir, were excluded. The main outcomes of interest were in-hospital mortality and the occurrence of de-novo ventricular arrhythmias (non-sustained or sustained ventricular tachycardia or ventricular fibrillation).

FINDINGS: 96 032 patients (mean age 53·8 years, 46·3% women) with COVID-19 were hospitalised during the study period and met the inclusion criteria. Of these, 14 888 patients were in the treatment groups (1868 received chloroquine, 3783 received chloroquine with a macrolide, 3016 received hydroxychloroquine, and 6221 received hydroxychloroquine with a macrolide) and 81 144 patients were in the control group. 10 698 (11·1%) patients died in hospital. After controlling for multiple confounding factors (age, sex, race or ethnicity, body-mass index, underlying cardiovascular disease and its risk factors, diabetes, underlying lung disease, smoking, immunosuppressed condition, and baseline disease severity), when compared with mortality in the control group (9·3%), hydroxychloroquine (18·0%; hazard ratio 1·335, 95% CI 1·223-1·457), hydroxychloroquine with a macrolide (23·8%; 1·447, 1·368-1·531), chloroquine (16·4%; 1·365, 1·218-1·531), and chloroquine with a macrolide (22·2%; 1·368, 1·273-1·469) were each independently associated with an increased risk of in-hospital mortality. Compared with the control group (0·3%), hydroxychloroquine (6·1%; 2·369, 1·935-2·900), hydroxychloroquine with a macrolide (8·1%; 5·106, 4·106-5·983), chloroquine (4·3%; 3·561, 2·760-4·596), and chloroquine with a macrolide (6·5%; 4·011, 3·344-4·812) were independently associated with an increased risk of de-novo ventricular arrhythmia during hospitalisation.

INTERPRETATION: We were unable to confirm a benefit of hydroxychloroquine or chloroquine, when used alone or with a macrolide, on in-hospital outcomes for COVID-19. Each of these drug regimens was associated with decreased in-hospital survival and an increased frequency of ventricular arrhythmias when used for treatment of COVID-19.

FUNDING: William Harvey Distinguished Chair in Advanced Cardiovascular Medicine at Brigham and Women's Hospital.

Strengths · Limitations

Strengths

#application pathway

Urgent question with named decision-makers

The paper directly addresses whether hydroxychloroquine and chloroquine should be used for hospitalised COVID-19, a decision being actively made by clinicians, regulators, and trialists, with the clinical setting and mechanism of impact named explicitly.

↳ Introduction; Discussion

#methodological rigour

Appropriate analytic design on paper

The study applies Cox proportional hazards regression, propensity-score matching with standardised mean differences under 10%, continent-stratified analyses, and a tipping-point sensitivity analysis suited to the observational question.

↳ Methods: Statistical Analysis; Results, Sensitivity Analyses

#reporting

Clear structure and explicit statistical caveats

The argument flows logically with consistent tabulation, and figure captions explicitly note that confidence intervals are unadjusted for multiple testing and should not infer definitive effects.

↳ Tables 1-2; Figures 2-3 captions

Limitations

#methodological rigour

Unverifiable proprietary single-source data

The entire analysis rests on a proprietary registry whose governance, certification, and validation claims cannot be independently confirmed from the manuscript, and no data or code is shared. This is the most fundamental reliability concern for an observational study and caps the Craft score.

↳ Methods: Registry Features and Data Acquisition

#methodological rigour

Problematic missing-data assumption

Absent diagnostic codes are treated as confirmed absence of the condition, a strong assumption for electronic-health-record data that can bias cohort composition and covariate measurement and is acknowledged but not formally assessed.

↳ Methods: Statistical Analysis

#contribution

Implausibly large arrhythmia effect sizes

Reported hazard ratios for ventricular arrhythmia of roughly 2.4 to 5.1 are large and surprising relative to contemporaneous literature, and no explanation is offered for the magnitude.

↳ Results, Figure 3

Does this match your read? Add your assessment ↓

Withdrawn — shown for reference only

Nabu Commentary

The evaluation converged on a polished observational analysis built on a foundation that cannot be inspected. The design elements visible in the methods and sensitivity analyses are appropriate to the question, but the missingness rule that equates absent codes with absent conditions, inadequately addressed residual confounding, and effect sizes for arrhythmia that are large relative to prior literature all weigh against full credit. The decisive issue is that the core findings depend on a proprietary single-source registry whose data governance and validation claims cannot be independently verified, which caps the Methodological Rigour assessment and discounts the contribution. Where the evaluation diverged most was how much credit the claimed multinational scope and the realized policy influence should receive, and the adjudicated scores hold those to the evidence the paper actually presents rather than to outcomes after publication.

Check another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Study Quality

Limited2.5

Confidence medium
Contribution
2.2

The paper targets a maximally urgent clinical question and claims the largest real-world comparison of hydroxychloroquine and chloroquine regimens to date, but the entire contribution is contingent on a dataset that cannot be independently verified. The score credits the genuine importance and formally appropriate framing while discounting heavily for the unverifiable data substrate.

Research in context; Methods: Registry Features and Data Acquisition

these findings provide the most comprehensive evidence of the use of hydroxychloroquine and chloroquine

Methodological Rigour
2.0

On the merits the design is appropriate, with Cox proportional hazards regression, propensity-score matching achieving standardised mean differences under 10%, continent-stratified analyses, and a tipping-point sensitivity analysis, but the missingness rule that treats absent codes as absent conditions and inadequately addressed residual confounding temper the merit-based assessment to 3.0. The Red reliability flag for the unverifiable single-source registry caps the editorial Methodological Rigour score at 2.0 regardless of merit.

Methods: Statistical Analysis; Results, Sensitivity Analyses

if the patient's electronic health record did not include information on a clinical characteristic, it was assumed that the characteristic was not present

Reporting
3.7

The argument flows logically from introduction through methods, results, and discussion, with consistent tabulation and explicit figure caveats about unadjusted multiple testing. Precision is slightly reduced by a prescriptive conclusion that reads more interventionist than an observational design supports.

Tables 1-2; Figures 2-3 captions; Discussion / Conclusion

The 95% CIs have not been adjusted for multiple testing and should not be used to infer definitive effects

Positioning
3.4

The paper engages relevant contemporaneous evidence including the Veterans Affairs cohort, the French observational study, and the Borba randomised trial, and offers a plausible arrhythmia mechanism. Positioning as the most robust real-world evidence overstates what the design supports, and there is no declared observational reporting standard.

Research in context; Discussion

provides the most robust real-world evidence to date on the usefulness of these treatment regimens

Lower confidence on Methodological Rigour — domain match limited.

Reliability

Concerns4 of 4 checks


Internal CoherenceNoted

The paper's internal arithmetic is consistent across abstract, tables, and figures, but several features carry plausibility tensions: a prospective globally comprehensive registry is reconciled with exclusion of patients without a completed hospital course and a missingness rule that treats absent codes as absent conditions, and the strong prescriptive conclusion sits against the Discussion's own non-causal caveat.

Research ConductConcern

Core findings rest on a proprietary single-source registry (Surgisphere) whose provenance and validation claims cannot be independently verified from the manuscript, with no public data or code, and a declared-but-unverifiable ethics exemption. Combined with large, surprising effect sizes, this meets the unverifiable single-source data threshold.

Flags: 1 declared / 5 total

Reference IntegrityClean

All 34 cited references resolved to real publications via PubMed, Crossref, or OpenAlex.

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordConcern

This paper was retracted on 2020-06-05. See notice: 10.1016/s0140-6736(20)31324-6.

Erratum published 30 May 2020 · listed in Crossref

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Readiness

Where this paper’s evidence sits on the path from initial observation to real-world use.

Validated

The findings evaluate outcomes in hospitalised patients across many sites and are close to clinical decision-making, but remain non-randomised and depend on a proprietary registry, so they inform rather than settle treatment policy. The score reflects genuine proximity to practice tempered by the non-randomised, unverifiable substrate.

Methods; Results

Randomised clinical trials will be required before any conclusion can be reached regarding benefit or harm

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. Dexamethasone in Hospitalized Patients with Covid-19

    RECOVERY Collaborative Group, Horby, Lim, et al. · 2020 · Clinical medicine

    Primary claim

    Overall, 482 patients (22.9%) in the dexamethasone group and 1110 patients (25.7%) in the usual care group died within 28 days after randomization (age-adjusted rate ratio, 0.83; 95% confidence interval [CI], 0.75 to 0.93; P<0.001).

    Well-supported
    Study quality
    Strong4.3
    Reliability
    Caveats
  2. Cognitive outcome in relation to cerebrospinal fluid markers of neuronal and glial cell damage: A prospective study of tick-borne encephalitis

    2026 · Clinical medicine

    Primary claim

    CSF GFAP showed the strongest association with long-term cognitive outcome and may reflect astrocytic activation related to persistent cognitive impairment.

    Tentative
    Study quality
    Sound3.2
    Reliability
    Caveats
  3. Pain as an assault on the self: An interpretative phenomenological analysis of the psychological impact of chronic benign low back pain

    Jonathan Ashley Smith, Mike Osborn · 2006 · Psychology and cognitive sciences

    Primary claim

    The notion of the self emerged in this study as an important aspect of the participants’ experience of chronic pain sensation, distress and disability.

    Supported
    Study quality
    Sound3.5
    Reliability
    No concerns

How the rubric works →