Evaluation Policy

Why Nabu evaluations are public

Nabu evaluates published research. A published paper is a public contribution to the scholarly record, and open discussion of published work — in reviews, journal clubs, cited critiques, post-publication commentary — is a foundation of how science corrects and improves itself. Nabu operates in that tradition.

For this reason, Nabu does not require author consent to evaluate a published paper, in the same way that a book review, a citation critique, or a PubPeer discussion does not require it. Any reader may request an evaluation of any published article.

What we owe authors instead is fairness. Every Nabu evaluation is:

• About the work, not the person. We evaluate the methodological quality of a specific paper against a published, versioned framework. We do not evaluate character, competence, or careers.
• Evidence-chained. Every score is supported by a traceable chain of evidence drawn from the paper itself. There are no unexplained judgements.
• Transparent about its own limits. Evaluations state the framework version used, whether they were produced from full text or abstract only, and what could not be assessed.
• Open to reply, dispute, and correction — see below.

What an evaluation contains

A Nabu evaluation is attached to a paper, identified by its DOI, title, and standard bibliographic metadata as published. Author names appear only as part of that already-public bibliographic record. Nabu does not add commentary about authors as individuals, and evaluations never speculate about intent, integrity, or ability.

Quality scores describe the paper as published and are frozen at the framework version used. Post-publication developments — retractions, corrections, replication evidence — are tracked separately and never silently alter a quality score.

Evaluations of published research form part of Nabu’s public evaluation record. The public record exists independently of the account that requested an evaluation: if the requesting user deletes their account, their personal data is removed, but the evaluation itself remains part of the record.

Right of reply

Any listed author of an evaluated paper may publish a response, displayed alongside the evaluation with equal prominence. A reply may address anything: disagreement with the assessment, context the evaluation missed, constraints that shaped the work, or planned follow-up.

Replies are attributed and verified (via ORCID or institutional email), are not edited by Nabu, and may be updated or withdrawn by the author at any time.

Disputes

Where an author believes an evaluation contains an error — a misreading of the paper, a factual mistake in the evidence chain, or a misapplied criterion — they may file a dispute.

• Disputes are reviewed against the evaluation framework and the paper itself.
• If the dispute is upheld, the evaluation is corrected and the correction is noted on the evaluation page.
• Original scores are preserved in the evaluation’s dispute history. We do not silently overwrite records; the trail of what changed and why is part of the evaluation.
• Dispute outcomes and reasoning are visible on the evaluation page.

A dispute challenges the evidence, not the existence of the evaluation. “I disagree with the score” without a specific evidential claim is better served by the right of reply.

Corrections

We correct factual errors — wrong metadata, misattributed papers, errors in the evidence chain — as soon as they are verified, whether raised by an author, a reader, or our own checks. Corrections are timestamped and noted on the evaluation page.

Removal

Because a public evaluation record is only trustworthy if it is complete, we do not remove evaluations because an author or institution disagrees with them. Selective removal would bias the record towards favourable assessments and defeat the purpose of the platform.

An evaluation is removed or amended only where:

• the paper was misidentified or the evaluation was attached to the wrong work;
• the evaluation is found to contain an error that cannot be remedied by correction;
• we are subject to a legal obligation to remove it; or
• the underlying content was evaluated in breach of our own content-access rules (see below), in which case it is re-issued on a compliant basis (for example, abstract-only) rather than deleted.

Retracted papers are not removed. Retraction is critical information for readers, and retracted papers remain visible with their retraction status prominently displayed.

How Nabu accesses papers

Nabu evaluates full text only where the paper is open access under a licence that permits this use. Where full text is not lawfully available to us, evaluations are produced from the abstract and public metadata only, and are clearly labelled as abstract-based, with correspondingly limited scope. We respect publisher text-and-data-mining reservations.

Users may also submit papers for evaluation where they hold the rights to do so, warranted at upload (see our Terms of Service). Uploaded files are processed to produce the evaluation, are never published, displayed, or redistributed, and are deleted along with their extracted text within 7 days of upload.

Authors’ data and your rights

Nabu processes a limited set of personal data in connection with evaluations: author names, ORCID iDs, and affiliations as they appear in the public bibliographic record (sourced from the publisher and OpenAlex).

• Lawful basis. We process this data on the basis of legitimate interest (Article 6(1)(f) GDPR): enabling public, evidence-based assessment of published research. Our legitimate interest assessment is available on request.
• Right to object. Under Article 21 GDPR, you may object to this processing. We will consider every objection individually through the balancing test the law requires, taking into account that the data concerned is limited to the public bibliographic record of published work. An objection is not an automatic takedown, and outcomes may include data minimisation measures rather than removal of the evaluation.
• Other rights. You may request access to, or rectification of, personal data we hold about you, and you may lodge a complaint with the Autoriteit Persoonsgegevens or your local supervisory authority.

To exercise any of these rights, contact privacy@nabu.science. See our Privacy Policy for how we handle personal data generally.

Contact

Questions about this policy, disputes, corrections, or replies: hello@nabu.science. Data protection requests: privacy@nabu.science.

This policy is versioned. Material changes will be announced in advance, and prior versions remain available.