Socratic Chatbot for strengthening critical thinking and information literacy in university students

Authors

DOI:

https://doi.org/10.59169/pentaciencias.v8i2.1824

Keywords:

educational chatbot; critical thinking; Socratic method; SIFT strategy; disinformation

Abstract

Digital disinformation and the lack of critical thinking among university students represent a challenge for academic training in the Ecuadorian context, the objective of this research was to develop and validate an educational chatbot based on a hybrid model that integrates the Socratic method and the SIFT strategy (Stop, Investigate, Find, Trace) using the LLaMA 3.2 Instruct language model. A rapid application development (RAD) methodology with a mixed approach was applied, implementing the system with Flask and GPT4ALL, and it was evaluated using a Likert survey applied to 91 university students. The results showed a chatbot quality index (CQI) of 3.74 out of 5, highlighting the logical sense dimension as the highest rated, while relevance presented the lowest score, it is concluded that the Socratic chatbot is functional and acceptable for environments with limited resources, although it is necessary to optimize the depth of analysis and carry out long-term learning evaluations.

Downloads

Download data is not yet available.

References

Albesher, L., & Alfayez, R. (2024). An Observational Study on Flask Web Framework Questions on Stack Overflow (SO). IET Software, 2024(1), 1905538. https://doi.org/10.1049/sfw2/1905538

Anand, Y., Nussbaum, Z., Treat, A., Miller, A., Guo, R., Schmidt, B., Community, G., Duderstadt, B., & Mulyar, A. (2023). GPT4All: An Ecosystem of Open Source Compressed Language Models (arXiv:2311.04931). arXiv. https://doi.org/10.48550/arXiv.2311.04931

Astudillo Muñoz, J. (2024). Desinformación: Aproximación conceptual, riesgos y remedios. Derecho PUCP, (93), 55-97. https://doi.org/10.18800/derechopucp.202402.002

Balakrishnan, V., Ng, W. Z., Soo, M. C., Han, G. J., & Lee, C. J. (2022). Infodemic and fake news – A comprehensive overview of its global magnitude during the COVID-19 pandemic in 2021: A scoping review. International Journal of Disaster Risk Reduction, 78, 103144. https://doi.org/10.1016/j.ijdrr.2022.103144

Bruneti Severino, J. V., Basei De Paula, P. A., Berger, M. N., Loures, F. S., Todeschini, S. A., Roeder, E. A., Veiga, M. H., Guedes, M., & Marques, G. L. (2025). Benchmarking open-source large language models on Portuguese Revalida multiple-choice questions. BMJ Health & Care Informatics, 32(1), e101195. https://doi.org/10.1136/bmjhci-2024-101195

Carina Volotão & Marielle Barros de Moraes. (2023). ¿Preparados o vulnerables? Conocimiento sobre fake news en docentes universitarios. Informatio, 28(2). https://doi.org/10.35643/Info.28.2.14

Castro-Paredes, A. P., & Tomailla-Sandoval, J. G. (2024). Las fake news sobre la COVID-19 en Latinoamérica 2020-2022. Una revisión sistemática. INNOVA Research Journal, 9(1), 147-167. https://doi.org/10.33890/innova.v9.n1.2024.2431

Córdova Medina, H. M., Macías Rodríguez, L. E., Cabrera-Almeida, S., & Del Campo Saltos, G. (2025). Impact of digital media on misinformation and social health during the Metástasis case in Ecuador. Salud, Ciencia y Tecnología, 5, 1595. https://doi.org/10.56294/saludcyt20251595

De La Peña, R. (2022). Noticias falsas en tiempos de la posverdad. Revista Mexicana de Opinión Pública, (33), 88-103. https://doi.org/10.22201/fcpys.24484911e.2022.33.82237

Echeverría, M., & Rodríguez Cano, C. A. (2023). ¿La alfabetización digital activa la incredulidad en noticias falsas? Eficacia de las actitudes y estrategias contra la desinformación en México. Revista de Comunicación. https://doi.org/10.26441/RC22.2-2023-3246

Garzón-Quiroz, M., Del Campo-Saltos, G., & Loor-Ávila, B. (2025). Análisis sistemático sobre la eficiencia comunicativa entre chatbots basados en reglas y modelos de lenguaje natural. Universitas, (42), 167-192. https://doi.org/10.17163/uni.n42.2025.07

Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., Yang, A., Fan, A., Goyal, A., Hartshorn, A., Yang, A., Mitra, A., Sravankumar, A., Korenev, A., Hinsvark, A., … Ma, Z. (2024). The Llama 3 Herd of Models (arXiv:2407.21783). arXiv. https://doi.org/10.48550/arXiv.2407.21783

Hendrigan, H., Tan, S., & Cukierman, D. (2024). Combining SIFT and the Information Needs, Types, and Qualities Approaches: A Framework-Informed Strategy for Information Literacy Instruction. The Canadian Journal for the Scholarship of Teaching and Learning, 15(2). https://doi.org/10.5206/cjsotlrcacea.2024.2.15558

Jiménez-García, E., Ruiz-Lázaro, J., Martínez-Requejo, S., & Redondo-Duarte, S. (2025). Inteligencia Artificial y chatbots para una educación superior sostenible: Una revisión sistemática. RIED-Revista Iberoamericana de Educación a Distancia, 28(2). https://doi.org/10.5944/ried.28.2.43240

Khair, R. (2024). Application of Rapid Application Development (RAD) in the E-Career System: A Startup Approach. The Indonesian Journal of Computer Science, 13(6). https://doi.org/10.33022/ijcs.v13i6.4450

Li, X., & Bao, Z. (2024). The Application of AJAX and JSON in the Case. World Journal of Innovation and Modern Technology, 7(5), 113-119. https://doi.org/10.53469/wjimt.2024.07(05).13

Norman-Acevedo, E. (2023). La inteligencia artificial en la educación: Una herramienta valiosa para los tutores virtuales universitarios y profesores universitarios. Panorama, 17(32), 1-11. https://doi.org/10.15765/pnrm.v17i32.3681

Pegalajar Palomino, M. D. C., & Rodríguez Torres, Á. F. (2023). Digital literacy in university students of education degrees in Ecuador. Frontiers in Education, 8, 1299059. https://doi.org/10.3389/feduc.2023.1299059

Rodríguez Almazán, Y., Parra-González, E. F., Zurita-Aguilar, K. A., Mejía Miranda, J., & Bonilla Carranza, D. (2023). ChatGPT: La inteligencia artificial como herramienta de apoyo al desarrollo de las competencias STEM en los procesos de aprendizaje de los estudiantes. ReCIBE, Revista electrónica de Computación, Informática, Biomédica y Electrónica, 12(1), C5-12. https://doi.org/10.32870/recibe.v12i1.291

Rodríguez Rodríguez, A., Domínguez Gálvez, D. L., & Solórzano Álava, W. L. (2024). Comparación del Método Socrático y el Constructivismo en la Educación Moderna. Revista Científica de Innovación Educativa y Sociedad Actual «ALCON», 4(4), 105-117. https://doi.org/10.62305/alcon.v4i4.212

Sanmocte, E. M. T., & Costales, J. A. (2025). Exploring Effectiveness in Software Development: A Comparative Review of System Analysis and Design Methodologies. International Journal of Computer Theory and Engineering, 17(1), 36-43. https://doi.org/10.7763/IJCTE.2025.V17.1367

Singgalen, Y. A. (2024). Implementation of Rapid Application Development (RAD) for Community-based Ecotourism Monitoring System. Journal of Information System Research (JOSH), 5(2), 520-530. https://doi.org/10.47065/josh.v5i2.4749

Velásquez-Henao, J. D., Franco-Cardona, C. J., & Cadavid-Higuita, L. (2023). Prompt Engineering: A methodology for optimizing interactions with AI-Language Models in the field of engineering. DYNA, 90(230), 9-17. https://doi.org/10.15446/dyna.v90n230.111700

Velazquez-Solis, P. E., Flores-Rios, B. L., Astorga-Vargas, M. A., Ibarra Esquer, J. E., González Navarro, F. F., & Pino, F. J. (2017). Evidencia Empírica de la Minería de Procesos en la Implantación de CMMI-DEV - Empiric Evidence of Process Mining in CMMI-DEV Implementation. ReCIBE, Revista electrónica de Computación, Informática, Biomédica y Electrónica, 5(3), V. https://doi.org/10.32870/recibe.v5i3.69

Vidal-Silva, C. L., Sánchez-Ortiz, A., Serrano, J., & Rubio, J. M. (2021). Experiencia académica en desarrollo rápido de sistemas de información web con Python y Django. Formación universitaria, 14(5), 85-94. https://doi.org/10.4067/S0718-50062021000500085

Volotão, C., & Moraes, M. B. D. (2022). A PROMOÇÃO DA COMPETÊNCIA EM INFORMAÇÃO PARA A PREVENÇÃO E CONTROLE DA DESINFORMAÇÃO NA UNIVERSIDADE: O PAPEL DAS BIBLIOTECAS UNIVERSITÁRIAS. Revista EDICIC, 2(3). https://doi.org/10.62758/re.v2i3.152

Published

2026-06-16

How to Cite

Pino Mocha, D. J., Rodriguez Bravo, R. F. ., Valarezo Pardo, M. R. ., & Honores Tapia, J. A. . (2026). Socratic Chatbot for strengthening critical thinking and information literacy in university students. Revista Científica Arbitrada Multidisciplinaria PENTACIENCIAS - ISSN 2806-5794., 8(2), 554–571. https://doi.org/10.59169/pentaciencias.v8i2.1824

Issue

Section

Artículos originales