Why the old signals fail

Can you trust a paper because it's in a top journal?

No, journal rank predicts an individual paper's quality weakly, and higher-impact journals actually carry higher retraction rates.

A prestigious venue is a signal about the journal, not a guarantee about the paper in front of you. Journal rank is a poor predictor of the reliability or quality of any individual article, and chasing rank has measurable downsides for the literature (Brembs, Button & Munafò 2013). More pointedly, the frequency of retraction rises with impact factor: a journal's "retraction index" correlates strongly with its impact factor, so the most prestigious venues are, if anything, more prone to retracted work — not less (Fang & Casadevall 2011). Nabu's own blind reads bear this out in both directions: a treatment paper in a top-quartile journal with thousands of citations scored 1.7/5.0 and was later retracted, while a five-citation preprint scored 4.2/5.0. The venue told you the opposite of what the work did. Read the paper, not the masthead.

See it in practice

Sources

Frequently asked

Do top journals have fewer retractions?

The opposite — retraction frequency correlates positively with impact factor (Fang & Casadevall 2011).

So is publishing in a top journal meaningless?

No, but it's a weak proxy for an individual paper's soundness, which has to be read from the paper.

Related

Last updated