nabu.science
MethodologyAboutContact

 

  • Snapshot
  • Key Claims
  • Strengths & Limitations
  • Commentary
  • From the Authors
  • Author Note / Field Feedback
  • Dimension breakdown
  • Impact Profile
Free · About 5 minutes
Report #NBU-A9CEDBF2·Framework v5.5·Pipeline v0.4·Evaluated 25 Jul 2026·OECD: 5.8 Other Social Sciences·Subfield: Education·Basis: Full text·Type: Narrative review

Towards a methodologically congruent framework for GenAI use in nonpositivist qualitative research

Kien Nguyen‐Trung et al.Kien Nguyen‐Trung, Susanne Friese·2026·10.1080/13645579.2026.2703248 ↗

Primary claim

We propose a shift from ‘AI as coder’ to ‘AI as interlocutor’.

Supported · coherent conceptual proposal grounded in critique, without empirical validation
In brief

A timely conceptual framework for dialogic GenAI use in qualitative research, constrained by selective evidence and limited operational guidance.

ReliabilityCaveats4 of 4 checks completeRead the 2 entries ↓
Abstract

GenAI is increasingly used in qualitative research, yet much current practice remains methodologically incongruent. Attempts to make LLMs replicate qualitative coding often create a mismatch between underlined qualitative values (e.g. depth, context, and reflexivity) and actual AI-supported analytic practices (e.g. surface-level extraction and automated coding). This article distinguishes between technological incongruence, where GenAI is asked to perform tasks it is not designed to handle, and qualitative methodological incongruence, where AI workflows reproduce the surface procedures of qualitative analysis while neglecting its interpretive and reflexive commitments. We propose a shift from ‘AI as coder’ to ‘AI as interlocutor’. We outline key tenets for methodologically congruent GenAI use in non-positivist qualitative research: relational epistemology, ethical, responsible and rigorous use, researcher’s lead role, and abductive dialoguing. GenAI can support qualitative analysis by surfacing, retrieving, comparing, and suggesting material for interpretation, but meaning-making remains the responsibility of the human researcher.

Key Claims

Primary finding · Supported

We propose a shift from ‘AI as coder’ to ‘AI as interlocutor’.

coherent conceptual proposal grounded in critique, without empirical validation

Abstract; §3
Secondary · Supported

This article distinguishes between technological incongruence... and qualitative methodological incongruence

the distinction is defined and illustrated across Sections 2.1 and 2.2

Abstract; §§2.1–2.2
Secondary · Supported

Attempts to make LLMs replicate qualitative coding often create a mismatch between... qualitative values... and actual AI-supported analytic practices

multiple examples support the direction, though representativeness is not systematically established

Abstract; §§2.1–2.2
Secondary · Supported

GenAI can support qualitative analysis by surfacing, retrieving, comparing, and suggesting material for interpretation, but meaning-making remains the responsibility of the human researcher.

consistent with the researcher-led framework and ethical workflow discussion

Abstract; §§4.2–4.4
Secondary · Tentative

Coding is a human crutch – a scaffold built to support our limited processing power.

provocative conceptual framing that is argued plausibly but not empirically demonstrated

§3

Derived from the full evaluation — not a separate score.

Strengths · Limitations

Strengths

#contribution

Clear incongruence framework for GenAI use

The distinction between technological incongruence and qualitative methodological incongruence gives the debate a structured vocabulary. It helps separate tool-capability mismatches from deeper conflicts between automated workflows and nonpositivist qualitative values.

↳ Abstract; §§2.1–2.2

#methodological rigour

Concrete prompt-level diagnostic analysis

Table 1 grounds the critique in a detailed deconstruction of a one-turn thematic-analysis prompt. This makes the methodological argument more concrete than a purely abstract rejection of AI-assisted coding.

↳ Table 1; §2.1

#application pathway

Constructive alternative to binary rejection

Rather than simply rejecting GenAI, the article proposes researcher-led, dialogic use through relational epistemology, ethical practice, researcher leadership, and abductive dialoguing. This gives the paper a visible pathway into methodological discussion and tool design.

↳ §§4.1–4.4

Limitations

#positioning

Selective narrative evidence supports broad claims

The article makes field-level claims about the replication approach and LLM suitability from a narrative review without transparent search or inclusion procedures. This leaves uncertainty about how representative the cited failures and examples are.

↳ Introduction; §§2.1–3

#methodological rigour

Preferred framework remains lightly operationalised

The four tenets are useful as principles, but they do not yet provide detailed decision rules, validation evidence, or clear failure-case handling for practitioners. The article itself describes them as value-based principles rather than prescriptions.

↳ §4

#positioning

Commercial conflict requires interpretive caution

The disclosure identifies a commercial connection to QInsights.ai, while the article discusses commercial qualitative AI platforms and advocates AI-supported qualitative workflows. The disclosure is transparent, but the relationship is relevant to how readers interpret the framework endorsements.

↳ Introduction; end matter / disclosure statement

Does this match your read? Add your assessment ↓

Nabu Commentary

The scores are driven by the article’s strong conceptual organization and its concrete analysis of prompt-level failures in Table 1. The contribution is meaningful because it gives the field a vocabulary for separating technological limitations from methodological misalignment, and it proposes a constructive alternative to outright rejection. The main constraints are the narrative, non-systematic evidence base and the fact that the proposed tenets remain broad principles rather than a tested workflow. The disclosed commercial connection to QInsights.ai is handled transparently, but it remains relevant because the article discusses commercial AI-supported QDA tools and author-adjacent frameworks.

Evaluate another paper

Free · About 5 minutes · Research preview

Author Note / Field Feedback

Nabu’s assessment, alongside the field’s view.

Are you an author of this paper?

Dimension breakdown

Evidence Score

Out of 5
012345
3.6±0.1

Contribution
3.7

The score reflects a genuine conceptual contribution: the article distinguishes technological from qualitative methodological incongruence and advances the “AI as interlocutor” framing. The contribution is mainly synthetic and normative rather than a new empirical or formally validated framework.

Abstract; §§2–4

We propose a shift from ‘AI as coder’ to ‘AI as interlocutor’.

Methodological Rigour
3.6

The argument proceeds in a clear sequence from defining incongruence, to diagnosing examples, to proposing broad tenets for congruent GenAI use. Methodological Rigour is limited by reliance on illustrative examples, limited operational decision rules, and less critical scrutiny of the preferred CAAI, NITA, and QBA approaches.

Table 1; §§3–4

These tenets are not doctors’ prescription; they are value-based principles

Reporting
3.9

The article is clearly organized around memorable distinctions and labels that make the reasoning easy to follow. Some phrasing about what LLMs or chatbots cannot do is more categorical than the implementation-dependent technical issue warrants.

Abstract; Table 1; §§2.1–4

technological incongruence... qualitative methodological incongruence

Positioning
3.5

The article engages current debates over rejection versus responsible integration of GenAI and connects them to Big Q, small q, and medium Q traditions. Contextual positioning is moderated by the narrative review format, partial treatment of more successful GenAI-coding evidence, and limited explicit discussion of author-adjacent frameworks.

Introduction; §§2.2 and 4.1

a parallel position has emerged in support of the responsible and critical integration

Lower confidence on Positioning — domain match limited.

Reliability

Caveats4 of 4 checks


Internal CoherenceNoted

The conceptual argument is broadly coherent, but the paper sometimes moves from selected narrative examples to broad statements about current practice and LLM capability. These are watch-outs about claim proportionality rather than contradictions that undermine the paper’s thesis.

Research ConductNoted

The paper transparently discloses a commercial conflict of interest and GenAI proofreading use. The disclosed COI is relevant because the article discusses commercial AI-supported QDA tools and endorses frameworks adjacent to the authors’ work.

Flags: 1 declared / 5 total

Reference IntegrityClean

64 references verified via PubMed, Crossref, or OpenAlex.

References not verified automatically are resolved manually within 24 hours.

Post-Publication RecordClean

No retraction or expression of concern found in Crossref (includes Retraction Watch).

Last checked: 17 Oct 2026

Sources: Crossref (incl. Retraction Watch) ✓

Impact Profile

Impact areaResearch capability
Type of advanceConceptual
Route to useNamed
AdvanceAdvances
CitationsToo early
Policy · patentNot yet traced
ReachedNot reachedNot assessable or unverified
ReadinessFoundational
Foundational
Controlled
Piloted
Validated
Implementable
FoundationalImplementable

The primary claim is a conceptual proposal supported by critique of others' studies and argument; this paper itself demonstrates no pilot or trial of the interlocutor framework working.

From the paper
“we propose a set of key criteria for nonpositivist researchers to ensure their GenAI application is methodological congruence”

The paper explicitly names nonpositivist qualitative researchers as the actors who would apply its tenets to keep GenAI-assisted analysis methodologically congruent, while framing those tenets as broad principles rather than one specified decision protocol.

Pathway

Qualitative researchers and methodology teachers would adopt these tenets to guide congruent GenAI-assisted analysis in their own studies.

Barrier

The framework is argued conceptually with no demonstrated application, and contested epistemological divides plus evolving AI tools leave its congruence criteria unresolved.

Evaluated 13 Nov 2026 · GBD 2023 · glm_v1_3_3 · impact_profile_v1_3_3

Report an issue →

AI-generated, human-governed. Something look off? Contact us to request a review.

Keep reading

Related evaluations

Other papers Nabu has evaluated blind, starting with the same field.

  1. What is an interpretative phenomenological analysis case study?

    Daniel Rodger, Jonathan Ashley Smith · 2025 · Health sciences

    Primary claim

    While IPA is frequently used with small samples, single-participant IPA case studies can offer unique insights into deeply personal or rare experiences.

    Tentative
    Evidence Score
    3.1±0.1
    Reliability
    Caveats
  2. Phones impede learning: Evidence from a massive phone-free classroom experiment

    Alp Sungu, Pradeep Kumar Choudhury, Andreas Bjerre-Nielsen · 2026 · Education

    Primary claim

    Restricting student access to smartphones is associated with significantly higher academic performance

    Supported
    Evidence Score
    3.7±0.2
    Reliability
    Caveats
  3. Research Methodology

    Dr. P. Ponmurugan, Dr. J. Philip Robinson and Dr. S. Poornima · Plant production and plant biotechnology

    Evidence Score
    2.6±0.2
    Reliability
    Caveats

How the rubric works →