Artificial Intelligence and Qualitative Data Analysis: Epistemological Incongruences and the Future of the Human Experience

Introduction

Artificial intelligence (AI) is changing industries and occupations and the way we think about a range of human activities, including qualitative research. Recent research has highlighted the capabilities of AI tools to enhance the efficiency and, arguably, the robustness of the research process, but also the threats to research integrity and the critical thinking ability of researchers (Anis & French, 2023; Christou, 2023a, 2023b). This paper offers an exploration of AI use across the constructivist-interpretivist paradigm, and its implications for human centred, text-based research.

Focusing specifically on the core stages of qualitative data analysis – from data coding to its end point of inductive/abductive theory development (Saldaña, 2021) - this paper reports on a qualitative experiment in inter-coder reliability (ICR) between human researchers and a human-AI collaboration. Raw data from an existing qualitative project is used to test the efficacy of AI as a short-cut to the laborious process of human-based qualitative data analysis. The topic of the original study is immaterial to the experiment itself as it is the process of data analysis rather than the data per se that represents the focus of this paper. However, for context, the original research project which generated the raw data focussed upon shocks and disruptions in the Australian cattle grazing industry between 2022-2025. The empirical phase included 19 recorded field interviews with pastoral graziers in the Central Queensland Region of Australia. As a completed qualitative research project, from research problem through to publication (see Richards et al., 2025), it offers an opportunity to compare traditional human-based data analysis with AI enabled approaches.

The novel contribution of this paper lies in its qualitative experimental assessment of the efficacy of AI programs as data analytical tools. This extends the established norms of inter-coder reliability used by teams of qualitative researchers to that of non-human platforms operated by researchers, and in doing so, provides a pathway for the assessment of the confidence (or otherwise) of generative AI tools within human-AI collaborations. ICR is claimed to be good practice in qualitative research, enabling systematicity, communicability, consistency and transparency within research teams (O’Connor & Joffe, 2020). When ICR is systematically applied to data sets coded separately via human researchers and human-AI collaborations as is the case with this study, the usefulness of engaging with AI tools in textual data analysis can be established.

This paper is not a ‘how-to’ paper designed to improve researchers’ skills of using AI to better accomplish specific research tasks, nor does it offer a comprehensive performance test of all available AI applications and capabilities. Rather, this paper reflects on the experience of qualitative researchers engaging with AI in human centred research and on the related epistemological questions it raises. Qualitative research is directed at comprehending human experience and meaning, and it does so through specific approaches, including the constructivist-interpretive paradigm, that seeks to understand social reality through interactions between the researcher and researched (Crotty, 1998; Neuman, 2014). As such, this paper poses the following research question: How does human-based data analysis compare with human-AI based data analysis in qualitative research?

This paper is structured as follows: A review on recent and relevant publications on AI and qualitative data analysis provides background information, exploring key debates and research gaps in this emerging field. This is followed by an overview of the role of human experience within qualitative research epistemologies and inductive/abductive data analysis that leads to its natural endpoint of theory development. The methodology outlines the key steps undertaken, highlighting the ways that AI was ‘coaxed’ by human researchers prompting the AI platform to perform deeper and more comprehensive analyses. The subsequent section describes findings from the research process to illustrate the researchers’ experience of using AI tools. The paper ends with a discussion and conclusion of broader implications of AI use in qualitative, human centred research and the constructivist-interpretive approach more broadly and the proposal of a three-step framework to establish rigour in human-AI qualitative research.

Background: AI and the Human Experience

AI has entered the scholarly world with gusto. Even if we so desired, it would not be possible to put the genie back in the bottle. Students have embraced AI platforms powered by machine learning models such as Grammarly and ChatGPT to assist with assignment writing, and a number of AI platforms are available to search literature and generate literature reviews by analysing scholarly papers and identifying key themes. Despite concerns about ethics, integrity and authorship, AI platforms are proliferating, altering the direction of education and research (Hosseini et al., 2023).

Within the burgeoning literature on AI and how it transforms traditional human activities and occupations, research on the implications of AI for qualitative analysis and inductive/abductive theory development has also begun to surface (Christou, 2023b; Hosseini et al., 2023; Tabone & De Winter, 2023; Van Manen, 2023). In terms of its application in scholarly research, AI is still considered a novelty, and numerous papers have explored the benefits and shortcomings of its use. An important expected benefit is that of efficiency. Qualitative research is considered highly labour intensive and repetitive, and AI is seen as expediting specific tasks such as transcription, translation, coding, and organising of data, which can reduce the effort and resources required in research (Christou, 2023a, 2023b; Davidson, 2024; Gohil, 2023; Jiang et al., 2021; Pattyn, 2024; Rietz & Maedche, 2021). AI capability to process data faster and more efficiently also enables research to process larger data sets, including publicly available online and free-text data as well as non-textual data such as images, video, or visualisations (Anis & French, 2023; Ciechanowski et al., 2020; Player et al., 2024).

Arguably, AI’s ability to access and process large sets of data may enhance generalisability, objectivity and robustness of qualitative research as some have proposed (Ciechanowski et al., 2020; Davidson, 2024; Tschisgale et al., 2023). Human-based data coding is often criticised as unreliable, ad-hoc and subjective, whereas proponents of AI enabled tools welcome the prospect of a more consistent and reliable coding process - particularly by reducing human errors and so-called researcher bias (Jiang et al., 2021). Furthermore, automated coding could represent an opportunity to increase trustworthiness by applying multiple data analysis methods (Gohil, 2023) and traceability by creating an audit trail that can facilitate verification and reproducibility of qualitative analytical outcomes (Davidson, 2024; Tschisgale et al., 2023). However, as we argue later, these claimed benefits are at odds with the constructivist epistemological and interpretivist theoretical basis of much qualitative human-centred research, which embraces researcher subjectivities and bias through well-established reflexive models of research (for example, see Crotty, 1998). Rather, claims of enhanced robustness and generalisability layer a more positivistic epistemological approach which presumes ‘verifiable, objective truths’ rather than socially constructed ‘realities’ which is intrinsically interpretive.

Despite the chat box interface and dialogue style which promotes personification and anthropomorphisation of many AI tools (Anis & French, 2023; Davidson, 2024; Van Manen, 2023), AI is not analogous to humans with dispositional character traits, personal concerns and a unity of experience and purpose that bestow a unique and relatively stable identity (MacAdams, 1995). Rather, AI programs could be described as exceptionally large aggregation of data offering a vast array of predefined statistical and algorithmic patterns that can be activated within a wider human-machine interaction (Christou, 2023a; 2023b). Accordingly, AI cannot be considered an author or co-author for the purpose of scientific publications or research ethics (Van Manen, 2023).

Even so, research in this field has emphasised that AI models are not impersonal, objective and unprejudiced as they are aggregated in non-random ways that are likely to reflect ideas and structures that are prevalent in society and hence embedded in their underlying training data. This causes AI models to exhibit structural bias relating to race, colour and gender (Anis & French, 2023; Christou, 2023a). The issue of inherent bias is further aggravated by a general lack of transparency around sources used to train AI, algorithms, and the way that AI models produce outputs, which researchers refer to as “black box effects” (Jiang et al., 2021; Rai, 2020; Tschisgale et al., 2023; Van Eschenbach, 2021). Indeed, it is considered impossible to fully inspect the information construction process and conceive of an unbiased state or raw default assumptions of an AI model (Bommasani et al., 2023; Van Manen, 2023). Due to the dynamic and continuous aggregation of training data underlying the model and the intransparent instructions of different algorithms, the output from AI models is unpredictable and it is not foreseeable when and how it will produce confabulations or hallucinations not supported by ‘real’ data (Barrasi, 2024; Davidson, 2024; Player et al., 2024).

While AI responses may appear as the result of human-like cognition, their generation is based entirely on predictive probability of language use rather than meaningfulness (Gigerenzer, 2023; Van Manen, 2023). Yet meaning reflects the very basis of qualitative research. For example, researchers have raised doubts on the ability of AI models to understand words in their contextual and tacit meaning, which may include cultural nuances, indexical meanings and contextual speech acts (Anis & French, 2023; Christou, 2023b). This raises the epistemological question how human meaning can be represented through probabilistic and predictive language generation rather than interpretation based on actual embodied and lived experience (Frank et al., 2024; Sandelowski, 2002), and how machine interpretation impacts the authenticity, trustworthiness and reliability of qualitative theory development.

Recent research on AI and qualitative analysis has concluded that the utility of AI is best realised within human-AI collaborations that complement rather than substitute human interpretation capability (Hamilton et al., 2023; Lieder & Schäffer, 2024; Morgan, 2023; Pattyn, 2024). This collaborative view of AI tools, however, requires further investigation of a formal context of epistemological justification how AI use meets and aligns with specific research paradigms and objectives (Christou, 2023a, 2023b; van Dis et al., 2023). Addressing this important research direction this paper explores qualitative ‘interpretation’ not as a generic human ability but as a set of specific research tasks within a coherent epistemology, which are completed in parallel by human and non-human researchers.

The next section offers a brief overview of qualitative research paradigms and the role of human experience in qualitative research.

Constructivist-Interpretive Epistemology and the Human Experience in Data Analysis for Theory Development

Drawing on extant literature, this section presents key characteristics of qualitative research in relation to data analysis and the generation of theory from that data (see Bingham, 2023). While quantitative research, and the objectivist epistemology within which it is grounded, presents a homogenous and uniform reality of natural and social phenomena based on quantifiable relations and variation, qualitative research aims to elicit in-depth understanding of socially constructed reality/realities and the human lived experience. Due to the diversity of multiple philosophical stances and epistemologies, discussions on qualitative research must account for specific epistemological paradigms that differ in their degree of emphasis on the human lived experience and meaning (Creswell, 2007; Crotty, 1998; Layder, 2014; Mackenzie & Knipe, 2006; Sandelowski, 2002).

Qualitative social research aims to understand human experience within the multiple realities and social contexts of an everyday lived world or “life world” (Brinkmann & Kvale, 2019, p. 2), which are experienced through authentic human interaction (Messner, 2021, p. 47; also see Creswell & Poth, 2018). Rather than controlling for the complex relationships that give rise to a diverse social reality, qualitative inquiry seeks to comprehend the irreducible presence, authenticity and diversity of human experiences and engage with them exhaustively (Crotty, 1998; Layder, 2018). This has been referred to as the ‘constructivist-interpretive’ research paradigm (Crotty, 1998). Epistemologically, constructivist research does not perceive of data as existing out there to be discovered as a singular objective reality (Sandelowski, 2002), rather it proposes a process of inquiry that is fundamentally dependent on the presence and involvement of researchers, who “construct meanings as they engage with the world they are interpreting” (Crotty, 1998, p. 43). The objective of the constructivist paradigm is to elicit a maximum of diverse perspectives and observations, and to ensure they are analytically significant as empirical and conceptual indicators of the phenomenon under research (O’Connor & Joffe, 2020).

The empirical data generated through interaction fundamentally depends on prior human experience of the researcher and the researched and on the nature of the interaction itself. It is therefore a critical aspect of qualitative research to reflect on the positionality and relation of the observer and the status of the data, especially for research aimed at precise and rich experiential content (Borrego et al., 2009, p. 56). This concept has been termed ‘researcher reflexivity’ (Crotty, 1998).

Methodologically, the constructivist paradigm involves interactive research procedures, including theoretical sampling, data collection adjustment in line with emerging insights, iterative and abductive analysis in line with emerging theory, and researcher reflexivity (Layder, 2018; Messner, 2021). The steps of the research process are iteratively and purposefully continued until empirical data redundancy occurs, which means a maximum of observations has been recorded, and theoretical propositions have clearly emerged (Figure 1).OPEN IN VIEWER

Constructivist procedures of the purposive collection of empirical data, as outlined earlier, are designed to establish clear linkages between data and theory. Human directed interpretive analysis further reinforces these linkages as it does not only include an integration and conceptualisation of codes that are descriptive and manifest in the data, but also codes that are implicitly or latently present and relate to meaning, claims or presumptions (Adu, 2019, p. 28). Analytical coding is thus not equivalent to simply reducing, tagging or excerpting data but represents an interpretive act (Saldaña, 2021).

Qualitative theorising can be described as sensemaking that includes identifying and explaining phenomena and making judgements and more general assertions about social reality (Byron & Thatcher, 2016; Langley, 1999). There is a strong emphasis in the literature that inductive theory development must maintain clear linkages to empirical data. For instance, Sandelowski (2002, p. 111) calls for “full bodied qualitative work” that generates theory grounded in a body of relevant empirical data, while others see clear empirical indicators in the data as “support for interpretation of explicit and implicit meaning” (Adu, 2019, p. 27) and an “evidentiary warrant” to support and illustrate theoretical propositions (Saldaña, 2021, p. 20). Thus, a key aspect of qualitative theorising is the conceptual engagement with the empirical data. As described earlier, the constructivist-interpretive research paradigm perceives of theory development as the result of a process of conceptual engagement at all stages of the inquiry, which Layder (1998) has referred to as ‘data analysis with theory in mind’ (also see Figure 1). Constructivist approaches purposefully generate empirical data to offer a more general account of social reality based on the interplay of empirical data, a priori theory and emerging theory (Corley & Gioia, 2011; Layder, 2018).

Methodology

This research extends scholarship on the use of AI technology in qualitative data analysis and theory development and the broader implications for epistemological robustness. The guiding research question is posed as: How does human-based data analysis compare with human-AI based data analysis in qualitative research? To answer this question, this study utilised an existing research project on sustainable pastoral grazing management. The research undertook a program of qualitative inquiry in Central Queensland, Australia, and explored the relationship between producer agency and the use of digital technology in the face of climate shocks and disruptions. Primary data collection via 19 qualitative interviews was undertaken in 2022-2023 and some findings were presented in a recent publication (Richards et al., 2025).

During the data analysis phases, two qualitative researchers collaborated with a computer scientist to explore the efficacy of AI assisted coding and analysis. Following Bingham (2023), the methodological design is systematic, organised and iterative and detailed below to meet the multiple criteria of credibility, dependability, consistency, and confirmability. The key steps of this process are as follows:

(1) Voice to text. Recorded interviews were uploaded into a voice to text transcription program, Trint. This stage does not form part of our analysis but highlights points along the research process that intersect with AI. The output text of automated transcription required researchers to ‘clean’ the data to accurately match the voice of interviewees with the text. In comparison, fully AI based transcription using OpenAI whisper improved the accuracy of output text substantially, reducing the human data editing to a minimum, yet required some user knowledge of Python (a programming language with dynamic semantics) to achieve this result. This process resulted in a set of 19 transcription files, one per interview session, to be used in the process of comparing human coding with human-AI coding.

This overall approach to human-AI inter-coder reliability aims toward broad alignment regarding how the data is classified and synthesised toward conceptual or theoretical categories whilst allowing for interpretive flexibility in accordance with the epistemological norms of social constructivism (O’Connor & Joffe, 2020). Using ICR to examine the congruence between human and human-AI data analytical output offers a pragmatic approach to assessing what human-AI collaboration really offers to researchers. In practical terms, it involves a step-by-step process of comparing each iteration of human-AI analysis with the previously generated human output, followed by further coding, prompting and ‘coaxing’ to establish the degree of agreement between the two sets of output. This process does not involve quantitative measurements of reliability as is the case with objectivist-based research (Cofie et al., 2022), rather it is an exercise in ‘researcher interpretation’, reflecting on the status of the data and the researchers’ confidence in the process of construction and interpretation of experiential content (Borrego et al., 2009; Crotty, 1998).

Findings

The findings describe three points of comparison (see Methodology point 7) that may impact researcher confidence in the status of data, analysis, and the credibility of conceptualisation given the constructivist epistemology that underpins the original research. The findings must be considered from a viewpoint of researcher reflection on trustworthiness and credibility of the analytical process and emerging theory (Crotty, 1998).

Discussion: Humans Working With Dis-Experienced AI in Qualitative Analysis

Earlier, we asked: How does human-based data analysis compare with human-AI based data analysis in qualitative research? The short answer is that human qualitative researchers are unlikely to be replaced by AI due to the centrality of the human experience in constructivist-interpretivist analysis. We argue that AI’s efficacy in data analysis, even at the most basic level of organising descriptive codes is highly reliant on human intervention and direction. This is due to AI tools, as natural language processing models, operating on a principle of language probability rather than human-like cognition (Gigerenzer, 2023; Van Manen, 2023). AI analysis could conceivably be exhaustive in relation to its training data or even to a set of empirical data, yet it requires human researcher experience to understand whether human participant experience has been analysed appropriately and exhaustively (Christou, 2023b; Frank et al., 2024).

At present, AI may operate as a research assistant under close supervision, particularly in assisting with literature reviews, transcribing voice to text (although with many inaccuracies) and supporting spelling and grammar. The technological evolution, visible even within the short duration of our research, indicates that the capabilities of AI based research tools are improving fast and will almost certainly become inseparable from the work flows of normal research. Indeed, in relation to the qualitative research process (see Figure 1) there are AI tools available to support human researchers at every single stage, in terms of general discovery, literature review, designing interview questions, coding, and writing. Some universities endorse specific tools such as Semantic Scholar, Grammarly or Copilot, and beyond that, there is a vast and fast-growing selection of AI instruments available to researchers (e.g. Ithaka S+R, 2025) for their evaluation, including in terms of capability, usefulness, economy and ethics. This means that technological limitations currently experienced may soon be removed, especially in line with growing computational power, wider adoption, and a greater researcher skill base, which will all drive higher performance of research focused AI.

The core argument of our paper, however, concerns limitations related to epistemology that are not automatically dispelled by technological development. The findings reveal an uncertainty whether AI sufficiently explores and references all specified empirical data and only the empirical data to generate analytical responses. This is a critical concern as only concepts grounded in specific empirical evidence can promote the development of credible new insights and ideas deriving from fresh empirical data. As Layder (2018, p. 85) states, “theory development must consider all data within the analysis to ensure comprehensive and exhaustive explanation of social phenomena is achieved”. This echoes longstanding debates in the philosophy of science on the significance of comprehensive empirical diversity rather than reductive uniformity as a basis for inductive/abductive reasoning (e.g. Godfrey-Smith, 2003, p. 55).

Another critical aspect in relation to the interpretation of empirical data are explicit linkages between empirical observations to the lived human experience inherent in the data. To highlight the central importance of the human experience in constructivist-interpretivist data analysis, we propose the recognition of “Human Experiential Content” (HEC) when considering the support of AI tools within different disciplines of qualitative research. HEC cannot be decoupled from the whole analytical process and serves as an indicator of in-depth engagement with human experience through researcher involvement in the data collection process and the human experience inherent in empirical data and their interpretation. To elaborate further, qualitative methodologies of high HEC are suited to comprehend lived experience in its natural context with a focus on authenticity and data depth rather than quantity and data breadth. As complete experiential authenticity is arguably not achievable through research (Sandelowski, 2002, p. 106), the concept of HEC suggests that qualitative epistemologies and methodologies contain variable levels of human experiential content in terms of data depth, focus on exhaustive and most relevant description of lived experience, and researcher involvement in data collection and interpretation. As such, publicly available, generic data or quantitative data still contain lived human experience at least as a residual property, however, their distance from empirical data and its inherent human experience can undermine the authenticity and experiential depth of the analytical process (Fossey et al., 2002, p. 729). At the same time, the low level of HEC could make the data more suited to AI based dis-experienced analysis.

This paper argues that the uncertainties related to the direct engagement with empirical data equate to an uncertainty of engagement with lived human experience. As such, it will become critical for social researchers to consider and reflect on their research methodology and objectives and provide justifications of the epistemological appropriateness of AI use for qualitative data analysis and theory building. Figure 2 provides a conceptual frame that indicates diminishing utility of AI based tools for highly interactive and experiential research:OPEN IN VIEWER

AI training data further differs from publicly available generic data not just due to its lower experiential content and greater distance between researcher and data, but it represents an entirely separate ‘computational ontology’ (Frank et al., 2024, p. 175) that is statistically derived from authentic and embodied human experience. As such, AI tools support general propositions about social reality based on a derivative empirical evidence base of the model input data. In regard to human-AI collaboration, this paper maintains that authentic human experiential content and support from empirical data are critical necessities for good qualitative research.

Doubts exist within this research and the literature more broadly whether AI based tools are adequate to reliably comprehend human experience (Anis & French, 2023; Christou, 2023b). Analysis and conceptualisation of experiential data can be partially outsourced to AI within a methodology of human-AI collaboration (Lieder & Schäffer, 2024; Morgan, 2023) but require in-depth or holistic human reflection and justification (Bommasani et al., 2023). Furthermore, interactively constructed data offer a high degree of authenticity, credibility and trustworthiness (Crotty, 1998; Sandelowski, 2002; Shenton, 2004). If AI indeed fails to draw directly on relevant empirical data, as this research has experienced, and AI training data continuously dilutes the empirical base, the result would be an undifferentiable blend of human and artificial data in social life and research. As the distinction between AI generated and ‘real human data’ gets blurred, high levels of HEC may provide the only tangible basis of verification of AI generated research propositions. Without a coherent method of observational and conceptual verification of evidence and propositions based on lived and embodied human experience, nothing prevents social research from starting to “confuse words and images with things” (Sandelowski, 2002, p. 112). Future research may focus on evaluating human-AI generated outputs comparatively across research paradigms and methodologies that contain various levels of HEC with a focus on developing commensurate methodologies of verification.

Research on Large Language Modelling has indicated that continued injection of fresh human experience-based data is indispensable. Research has proposed that Large Language Models that rely on recursively fed AI generated data have shown significant decline of coherence and intelligibility, potentially resulting in an AI collapse or, at least, a vastly diminished usefulness for scientific research (Shumailov et al., 2024; Snoswell, 2024). As AI models apparently do not have the ability to self-perpetuate open learning without the supply of fresh human experiential data the human experience, for now, is bound to stay. However, it is the very nature of researchers to explore new grounds and new methodologies and AI ‘tinkering’ (see Higgins et al., 2023) and experimentation will continue.

Following insights from this in-depth experiment that AI requires skills in ‘coaxing’ and produces output based on a limited sub-section of data /or unrecognised external sources, researchers need to exercise caution when determining whether to use AI tools in their work. Our findings illustrate that AI whilst output may appear ‘analogous with greater efficiency’ compared to human analysis, it is embedded with hidden pitfalls, omissions and errors. These may only become apparent with extensive human intervention, which is counter-logical to using AI as an ‘efficiency tool’. To overcome this, researcher training must ensure the skills development to critically evaluate AI tools. The incorporation of AI technology into research will also have practical implications for research institutions, training, and publishing, for example in terms of new skill training curricula and research protocols and policies. Several institutions such as universities, governments and publishers have established guidelines for the use of AI in research.

Typically, these raise concerns around ethics, copyright and disclosure, but focus mostly on manuscripts, such as the use of Generative AI, or Large Language Models for manuscript preparation (see for example, Singapore Management University, 2024). Institutional guidelines for data analysis are more obscure and fragmented across various methods websites and the more recent academic papers (e.g. Morgan, 2023). To address this gap, we propose a three-step framework to guide researchers in applying their own HEC to establish rigour in practice where AI is used for data analysis in qualitative research.

(1) Transparency through Disclosure – Disclosure of the use of AI is important not only to manuscript development, but also to data analytical methods employed when using AI. Direct, written disclosures that outline the components of the research would extend currently accepted practices on reporting on scientific rigour, allowing the reader to draw conclusions about the quality and trustworthiness of the data analysis and its interpretation.

Conclusion

This paper aims to elevate understandings of human-AI collaboration within the continuum of qualitative data analysis, from descriptive coding and categorising, the development of themes and inductive/abductive theory development. With a focus on inter-coder reliability in human-AI data analysis, this novel multi-disciplinary qualitative experimental study draws attention to the epistemological implications of using ‘dis-experienced’ AI technology for human experiential research. The AI output revealed fundamental uncertainties related to the ability of AI tools to relate to specific empirical evidence, in terms of data generation, data boundaries, the clarity of empirical-conceptual indicator links, as well as the persistent tendency to default to training data. Despite this, guidelines for the use of AI in institutions have largely focused on the development of manuscripts, and clear author statements. Addressing the gap regarding clear guidelines, the authors have shared their observations regarding the need for responsible disclosure and sound justification of AI use within research, as well as outlining the method of verification of AI assisted research output.

A key shortfall of AI assisted analysis was found to relate to the necessary de-coupling of authentic human experience. Specifically, that the quality of qualitative research does not depend on an AI based ability to process larger data sets more quickly, but on a transparent understanding of how AI processes construct knowledge – a significant epistemological problem. In response, this paper has proposed the concept of “human experiential content (HEC)” to highlight and frame epistemological incongruences in the use of AI, especially in relation to constructivist-interpretive analysis and theorising. It has foregrounded the importance of human researcher reflexivity extending into the space of AI as a non-human actant that constructs ‘knowledge’ from dis-experienced algorithms. ‘Coaxing’ via ‘inverted induction’ emerged as an important strategy for the assertion of HEC in the human-AI collaboration, illustrating how AI use, rather than representing a plug-and-play solution, still fundamentally depends on human interaction and interpretation. However, the disposition of this interaction may change with non-familiar datasets where the potential richness to be mined is entirely unknown to the researcher, and where context and authenticity will require new methodologies of verification.

The epistemological findings were drawn from a qualitative experiment of human-AI collaboration, conducted at a specific point in time, which cannot fully account for the dynamic and exponential development of AI capabilities. The findings represent a specific perspective based on the experience of the researchers involved, not an ultimate verdict on the use of AI. Qualitative researchers will use AI according to their own knowledge, goals, skills and priorities and we acknowledge that other justified perspectives on AI use exist.

While the authors note the value of AI as a ‘research assistant’, this paper has highlighted the lack of epistemological confidence regarding the use of AI in qualitative data analysis. Our research institutions will have to reflect on evidence of AI related impacts and develop policies to safeguard foundational epistemological and ethical concepts of research in the age of AI, including reliability, authenticity and originality. In a world of increasingly indistinguishable provenance of data generation, creation and derivation, human experience will retain a critical epistemological role as the privileged and possibly only way to comprehend human social reality and to ensure verifiability of AI based research evidence and outcomes. We conclude that natural language AI platforms provide a novel space for data experimentation, but, for now, not a replacement for the interpretive skills of human data analysts.