Responsible assessment

What is responsible research assessment?

Judging research on its own merits with transparent, contestable criteria — rather than on journal rank or raw citation counts.

Responsible research assessment is the principle that evaluation should reflect what research is and does, not where it was published. Its evidence base is the responsible-metrics literature: the Leiden Manifesto sets out ten principles — quantitative measures should support expert judgement, not replace it; indicators should be transparent, contestable, and matched to the goal of the assessment (Hicks et al. 2015). The Metric Tide review reached a similar conclusion for national systems, coining "responsible metrics" and cautioning against letting convenient numbers drive high-stakes decisions (Wilsdon et al. 2015). In practice this means article-level rather than journal-level judgement (DORA), criteria that are written down and open to challenge, and evaluation applied consistently across fields and seniority. Nabu is built to those constraints: a fixed, published rubric; blind scoring; every judgement traceable to the text, so it can be inspected and overruled rather than taken on faith.

Sources

Frequently asked

What are the Leiden Manifesto's core ideas?

Metrics should support (not replace) expert judgement, stay transparent and contestable, and fit the assessment's purpose (Hicks et al. 2015).

How is this different from just "using metrics responsibly"?

It's the same idea — the emphasis is on transparent, contestable, criteria-based judgement over convenient proxies.

Related

Last updated