An artificial intelligence (AI)-assisted scoping review of emerging uses of ai in qualitative research and its ethical considerations
DOI:
https://doi.org/10.33361/RPQ.2024.v.12.n.30.729Keywords:
Qualitative Research with Artificial Intelligence, Qualitative data analysis, Large language models, Ethics in Qualitative ResearchAbstract
The aim of this article is to conduct a scoping review of academic materials that discuss the application of artificial intelligence (AI) based on large language models to support qualitative research, as well as the ethical considerations involved in such applications. To this end, a scoping review of 31 articles published between 2018 and 2023 in journals and conferences indexed in SCOPUS and Web of Science, and available on preprint servers due to the novelty of the topic, was conducted based on relevant terms. To demonstrate this potential, we decided to experiment with ChatPDF, an AI tool based on natural language processing, to support the review. The results of the review indicate more consolidated uses of AI for summaries, abstracts, and code generation, but there are indications of uses for topic generation, sentiment analysis, and data extraction and processing. The ethical discussion takes on a more normative and cautious dimension in the use of AI for qualitative research.
Downloads
Metrics
References
ABBAS, N.; PICKARD, T.; ATWELL, E.; WALKER, A. University Student Surveys Using Chatbots: Artificial Intelligence Conversational Agents. In: HCI INTERNATIONAL CONFERENCE, 23, evento virtual, jul. 24-29, 2021. Learning and Collaboration Technologies: Games and Virtual Environments for Learning. New York: Springer Cham, 2021. p. 155-169. DOI: https://doi.org/10.1007/978-3-030-77943-6_10 DOI: https://doi.org/10.1007/978-3-030-77943-6_10
ALKAISSI, H.; MCFARLANE, S. I. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus, [S. l.], v. 15, n. 2, p. e35179, 2023. DOI: https://doi.org/10.7759/cureus.35179
ALMEIDA, V.; MENDONÇA, R. F.; FILGUEIRAS, F. ChatGPT: tecnologia, limitações e impactos. Ciência Hoje, Rio de Janeiro, p. 1–11, 2024. Disponível em: https://cienciahoje.org.br/artigo/chatgpt-tecnologia-limitacoes-e-impactos/#. Acesso em: 17 mar. 2024.
ALZAABI, A.; ALAMRI, A.; ALBALUSHI, H.; ALJABRI, R.; AALABDULSALAM, A. ChatGPT applications in Academic Research: A Review of Benefits, Concerns, and Recommendations. bioRxiv The Preprint server for biology, [S. l.], 2023. Disponível em: http://biorxiv.org/content/early/2023/08/18/2023.08.17.553688.abstract. Acesso em: 17 mar. 2024.
BANO, M.; ZOWGHI, D.; WHITTLE, J. Exploring Qualitative Research Using LLMs. arXiv, [S. l.], p. 1–16, 2023. Disponível em: http://arxiv.org/abs/2306.13298. Acesso em: 17 mar. 2024.
BICUDO, M. A. V.; COSTA, A. P. (org.). Leituras em pesquisa qualitativa. São Paulo: Livraria da Física, 2019.
BISWAS, S. ChatGPT and the Future of Medical Writing. Radiology, Chicago, United States, v. 307, n. 2, p. e223312, 2023. DOI: 10.1148/radiol.223312. DOI: https://doi.org/10.1148/radiol.223312
CHEW, R.; BOLLENBACHER, J.; WENGER, M.; SPEER, J.; KIM, A. LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding. arXiv, [S. l.], 2023. Disponível em: http://arxiv.org/abs/2306.14924. Acesso em: 17 mar. 2024.
CHUBB, L. A. Me and the Machines: Possibilities and Pitfalls of Using Artificial Intelligence for Qualitative Data Analysis. International Journal of Qualitative Methods, Canada, v. 22, p. 1–16, 2023. DOI: 10.1177/16094069231193593. Disponível em: https://doi.org/10.1177/16094069231193593. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1177/16094069231193593
COSTA, A. P. Qualitative Research Methods: Do Digital Tools Open Promising Trends?. Revista Lusofona de Educacao, Lisboa, v. 59, n. 59, p. 67–76, 2023. Disponível em: https://doi.org/10.24140/issn.1645-7250.rle59.04. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.24140/issn.1645-7250.rle59.04
COTTON, D. R. E.; COTTON, P. A.; SHIPWAY, J. R. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, Londres, v. 61, n. 2, p. 228–239, 2023. DOI: 10.1080/14703297.2023.2190148. DOI: https://doi.org/10.1080/14703297.2023.2190148
CRAWFORD, K. The atlas of AI: Power, politics, and the planetary costs of artificial intelligence. Yale: Yale University Press, 2021. DOI: https://doi.org/10.12987/9780300252392
CHRISTOU, P. How to Use Artificial Intelligence (AI) as a Resource, Ow Methodological and Analysis Tool in Qualitative Research?. Qualitative Report, [S. l.], v. 28, n. 7, p. 1968–1980, 2023. DOI: https://doi.org/10.46743/2160-3715/2023.6406. DOI: https://doi.org/10.46743/2160-3715/2023.6406
DERGAA, I.; CHAMARI, K.; ZMIJEWSKI, P.; BEN SAAD, H. From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, Poland, v. 40, n. 2, p. 615–622, 2023. DOI: 10.5114/biolsport.2023.125623. DOI: https://doi.org/10.5114/biolsport.2023.125623
DWIVEDI, Y. K. et al. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, [S. l.], v. 71, p. 1-63, 2023. DOI: https://doi.org/10.1016/j.ijinfomgt.2023.102642. DOI: https://doi.org/10.1016/j.ijinfomgt.2023.102642
FARROKHNIA, M.; BANIHASHEM, S. K.; NOROOZI, O.; WALS, A. A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, Londres, p. 1–15, 2023. DOI: 10.1080/14703297.2023.2195846. DOI: https://doi.org/10.1080/14703297.2023.2195846
GAMIELDIEN, Y.; CASE, J. M.; KATZ, A. Advancing Qualitative Analysis: An Exploration of the Potential of Generative AI and NLP in Thematic Coding. SSRN Electronic Journal, [S. l.], 2023. Disponível em: https://www.ssrn.com/abstract=4487768. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.2139/ssrn.4487768
GANDHI, P.; TALWAR, V. Artificial intelligence and ChatGPT in the legal context. Int J Med Sci, v. 75, n. 1, p. 1-2, 2023. Disponível em: https://ijmsweb.com/content/101/2023/75/1/pdf/IJMS-75-001.pdf. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.25259/IJMS_34_2023
GAO, J. et al. CollabCoder: A GPT-Powered Workflow for Collaborative Qualitative Analysis. arXiv, [S. l.], 2023. Disponível em: https://doi.org/10.48550/arXiv.2304.07366. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1145/3584931.3607500
GLASER, V., GEHMAN, J. Chatty Actors: Generative AI and the Reassembly of Agency in Qualitative Research. Preprint, 2023. Disponível em: https://www.researchgate.net/publication/371756110_Chatty_Actors_Generative_AI_and_the_Reassembly_of_Agency_in_Qualitative_Research. Acesso em: 29 abr. 2024.
HACKER, P.; ENGEL, A.; MAUER, M. Regulating ChatGPT and other Large Generative AI Models. arXiv, [S. l.], 2023. Disponível em: https://doi.org/10.48550/arXiv.2302.02337. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1145/3593013.3594067
HAMILTON, L.; ELLIOTT, D.; QUICK, A.; SMITH, S.; CHOPLIN, V. Exploring the Use of AI in Qualitative Analysis: A Comparative Study of Guaranteed Income Data. International Journal of Qualitative Methods, Canada, v. 22, p. 1–13, 2023. DOI: 10.1177/16094069231201504. DOI: https://doi.org/10.1177/16094069231201504
HAYES, A. S. “Conversing” with Qualitative Data: Enhancing Qualitative Sociological Research through Large Language Models (LLMs). SocArXiv, [S. l.], p. 1-20, 2023. Disponível em: https://doi.org/10.31235/osf.io/yms8p. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.31235/osf.io/yms8p
HITCH, D. Artificial Intelligence (AI) Augmented Qualitative Analysis: The Way of the Future? SSRN Electronic Journal, [S. l.], 2023. Disponível em: https://doi.org/10.2139/ssrn.4451740. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.2139/ssrn.4451740
LI, Z.; DOHAN, D.; ABRAMSON, C. M. Qualitative Coding in the Computational Era: A Hybrid Approach to Improve Reliability and Reduce Effort for Coding Ethnographic Interviews. Socius, [S. l.], v. 7, p. 1–4, 2021. DOI: 10.1177/23780231211062345. DOI: https://doi.org/10.1177/23780231211062345
MARSHALL, D. T. NAFF, D. B. The Ethics of Using Artificial Intelligence in Qualitative Research. SocArXiv, [S. l.], p. 1-24, 2023. Disponível em: https://doi.org/10.31235/osf.io/3rnbh. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.31235/osf.io/3rnbh
MINAYO, M. C. Ética das pesquisas qualitativas segundo suas características. Revista Pesquisa Qualitativa, São Paulo, v. 9, n. 22, p. 521-539, 2021. DOI: https://doi.org/10.33361/RPQ.2021.v.9.n.22.506
OPENAI. ChatGPT (Sep 11 version). [Large language model]. 2023. Disponível em: https://chat.openai.com/chat. Acesso em: 29 abr. 2024.
PAOLI, S. Can Large Language Models Emulate an Inductive Thematic Analysis of Semi-Structured Interviews? An Exploration and Provocation on the Limits of the Approach and the Model. arXiv, [S. l.], 2023. Disponível em: https://doi.org/10.48550/arXiv.2305.13014. Acesso em: 29 abr. 2024.
PATTYN, F. Generative AI for Qualitative Research: A Paradigm Shift Towards Cost-Effectiveness (4x), Throughput Time (15x) and Reliability (Cohen’s Kapp). 2023. Disponível em: https://doi.org/10.13140/RG.2.2.11414.52800. Acesso em: 29 abr. 2024.
PAUL, J.; UENO, A.; DENNIS, C. ChatGPT and consumers: Benefits, pitfalls and future research agenda. International Journal of Consumer Studies, [S. l.], v. 47, n. 4, p. 1213-1225, 2023. DOI: https://doi.org/10.1111/ijcs.12928 DOI: https://doi.org/10.1111/ijcs.12928
QASEM, F. ChatGPT in Scientific and Academic Research: Future Fears and Reassurances. Library Hi Tech News, [S. l.], v. 40, n. 3, p. 30–32, 2023. Disponível em: https://doi.org/10.1108/LHTN-03-2023-0043. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1108/LHTN-03-2023-0043
RAHMAN, M.; TERANO, H.J.R.; RAHMAN, N.; SALAMZADEH, A.; RAHAMAN, S. ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples. Journal of Education, Management and Development Studies, Philippines, v. 3, n. 1, p.1–12, 2023. DOI: https://doi.org/10.52631/jemds.v3i1.175. DOI: https://doi.org/10.52631/jemds.v3i1.175
RAMOS, A. S. M. Generative Artificial Intelligence based on large language models - tools for use in academic research. SciELO Preprints [Preprint], 2023. DOI: https://doi.org/10.1590/SciELOPreprints.6105. DOI: https://doi.org/10.1590/SciELOPreprints.6105
RAY, P. P. ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, [S. l.], v. 3, p. 121-154, 2023. DOI: https://doi.org/10.1016/j.iotcps.2023.04.003. DOI: https://doi.org/10.1016/j.iotcps.2023.04.003
SALVAGNO, M.; TACCONE, F. S.; GERLI, A. G. Can artificial intelligence help for scientific writing? Critical Care, [S. l.], v. 27, n. 1, p. 1-5, 2023. Disponível em: https://ccforum.biomedcentral.com/articles/10.1186/s13054-023-04380-2. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1186/s13054-023-04380-2
SAMPAIO, R. C.; NICOLÁS, M. A.; JUNQUILHO, T. A.; SILVA, L. R. L.; FREITAS, C. S.; TELLES, M.; TEIXEIRA, J. S. ChatGPT and other AIs will change all scientific research: initial reflections on uses and consequences. SciELO Preprints, 2023. DOI: 10.1590/SciELOPreprints.6686. Disponível em: https://preprints.scielo.org/index.php/scielo/preprint/view/6686. Acesso em: 26 mar. 2024
SANTOS, M. F. de L.; MESQUITA, L.; PEIXOTO, J. G. de M.; CAMARGO, I. Digital News Business Models in the Age of Industry 4.0: Digital Brazilian News Players Find in Technology New Ways to Bring Revenue and Competitive Advantage. Digital Journalism, [S. l.], p. 1–25, 2022. DOI: 10.1080/21670811.2022.2037444. DOI: https://doi.org/10.1080/21670811.2022.2037444
SILVEIRA, A. de O.; BHATTACHERJEE, A. An Unsupervised Algorithm for Qualitative Coding of Text Data: Artifact Design, Application, and Evaluation. In: THE NEXT WAVE OF SOCIOTECHNICAL DESIGN 2021, Anais [...]. : Springer Cham, 2021. p. 272–284. Disponível em: https://link.springer.com/chapter/10.1007/978-3-030-82405-1_27#citeas. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1007/978-3-030-82405-1_27
SPINAK, E. Inteligência Artificial e a comunicação da pesquisa [online]. SciELO em Perspectiva, 2023 [recurso eletrônico]. Disponível em: https://blog.scielo.org/blog/2023/08/30/inteligencia-artificial-e-a-comunicacao-da-pesquisa/. Acesso em: 29 abr. 2024.
SOK, S.; HENG, K. ChatGPT for Education and Research: A Review of Benefits and Risks. SSRN Electronic Journal, [S. l.], 2023. Disponível em: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4378735. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.2139/ssrn.4378735
SUSARLA, A.; GOPAL, R.; THATCHER, J. B.; SARKER, S. The Janus Effect of Generative AI: Charting the Path for Responsible Conduct of Scholarly Activities in Information Systems. Information Systems Research, Maryland, USA, v. 34, n. 2, p. 399–408, 2023. DOI: 10.1287/isre.2023.ed.v34.n2. DOI: https://doi.org/10.1287/isre.2023.ed.v34.n2
TAI, R. H.; BENTLEY, L. R.; XIA, X.; SITT, J. M.; FANKHAUSER, S. C.; CHICAS-MOSIER, A. M.; MONTEITH, B. M. Use of Large Language Models to Aid Analysis of Textual Data. bioRxiv The Preprint server for biology, [S. l.], 2023. Disponível em: https://www.biorxiv.org/content/10.1101/2023.07.17.549361v1.abstract. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1101/2023.07.17.549361
TAYLOR, Z. W. Using Chat GPT to Clean Interview Transcriptions: A Usability and Feasibility Analysis. SSRN Electronic Journal, [S. l.], 2023. Disponível em: http://dx.doi.org/10.2139/ssrn.4437272. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.2139/ssrn.4437272
TUSTUMI, F.; ANDREOLLO, N.; AGUILAR-NASCIMENTO, J. Futuro Dos Modelos De Linguagem Nos Cuidados Em Saúde: O Papel Do Chatgpt. ABCD. Arquivos Brasileiros de Cirurgia Digestiva (São Paulo), v. 36, p. e1727, 2023. Disponível em: https://doi.org/10.1590/0102-672020230002e1727. Acesso em: 29 abr. 2024. DOI: https://doi.org/10.1590/0102-672020230002e1727
ZHAO, F.; YU, F.; TRULL, T.; SHANG, Y. A New Method Using LLMs for Keypoints Generation in Qualitative Data Analysis. In: IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE (CAI) 2023, Santa Clara, CA, USA. Anais [...]. Santa Clara, CA, USA p. 333–334. DOI: 10.1109/CAI54212.2023.00147. DOI: https://doi.org/10.1109/CAI54212.2023.00147
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Qualitative Research Journal
This work is licensed under a Creative Commons Attribution 4.0 International License.
Essa revista é licenciada pelo sistema creative commons 4.0, não-comercial.
