Socratic Chatbot for strengthening critical thinking and information literacy in university students
DOI:
https://doi.org/10.59169/pentaciencias.v8i2.1824Keywords:
educational chatbot; critical thinking; Socratic method; SIFT strategy; disinformationAbstract
Digital disinformation and the lack of critical thinking among university students represent a challenge for academic training in the Ecuadorian context, the objective of this research was to develop and validate an educational chatbot based on a hybrid model that integrates the Socratic method and the SIFT strategy (Stop, Investigate, Find, Trace) using the LLaMA 3.2 Instruct language model. A rapid application development (RAD) methodology with a mixed approach was applied, implementing the system with Flask and GPT4ALL, and it was evaluated using a Likert survey applied to 91 university students. The results showed a chatbot quality index (CQI) of 3.74 out of 5, highlighting the logical sense dimension as the highest rated, while relevance presented the lowest score, it is concluded that the Socratic chatbot is functional and acceptable for environments with limited resources, although it is necessary to optimize the depth of analysis and carry out long-term learning evaluations.
Downloads
References
Albesher, L., & Alfayez, R. (2024). An Observational Study on Flask Web Framework Questions on Stack Overflow (SO). IET Software, 2024(1), 1905538. https://doi.org/10.1049/sfw2/1905538
Anand, Y., Nussbaum, Z., Treat, A., Miller, A., Guo, R., Schmidt, B., Community, G., Duderstadt, B., & Mulyar, A. (2023). GPT4All: An Ecosystem of Open Source Compressed Language Models (arXiv:2311.04931). arXiv. https://doi.org/10.48550/arXiv.2311.04931
Astudillo Muñoz, J. (2024). Desinformación: Aproximación conceptual, riesgos y remedios. Derecho PUCP, (93), 55-97. https://doi.org/10.18800/derechopucp.202402.002
Balakrishnan, V., Ng, W. Z., Soo, M. C., Han, G. J., & Lee, C. J. (2022). Infodemic and fake news – A comprehensive overview of its global magnitude during the COVID-19 pandemic in 2021: A scoping review. International Journal of Disaster Risk Reduction, 78, 103144. https://doi.org/10.1016/j.ijdrr.2022.103144
Bruneti Severino, J. V., Basei De Paula, P. A., Berger, M. N., Loures, F. S., Todeschini, S. A., Roeder, E. A., Veiga, M. H., Guedes, M., & Marques, G. L. (2025). Benchmarking open-source large language models on Portuguese Revalida multiple-choice questions. BMJ Health & Care Informatics, 32(1), e101195. https://doi.org/10.1136/bmjhci-2024-101195
Carina Volotão & Marielle Barros de Moraes. (2023). ¿Preparados o vulnerables? Conocimiento sobre fake news en docentes universitarios. Informatio, 28(2). https://doi.org/10.35643/Info.28.2.14
Castro-Paredes, A. P., & Tomailla-Sandoval, J. G. (2024). Las fake news sobre la COVID-19 en Latinoamérica 2020-2022. Una revisión sistemática. INNOVA Research Journal, 9(1), 147-167. https://doi.org/10.33890/innova.v9.n1.2024.2431
Córdova Medina, H. M., Macías Rodríguez, L. E., Cabrera-Almeida, S., & Del Campo Saltos, G. (2025). Impact of digital media on misinformation and social health during the Metástasis case in Ecuador. Salud, Ciencia y Tecnología, 5, 1595. https://doi.org/10.56294/saludcyt20251595
De La Peña, R. (2022). Noticias falsas en tiempos de la posverdad. Revista Mexicana de Opinión Pública, (33), 88-103. https://doi.org/10.22201/fcpys.24484911e.2022.33.82237
Echeverría, M., & Rodríguez Cano, C. A. (2023). ¿La alfabetización digital activa la incredulidad en noticias falsas? Eficacia de las actitudes y estrategias contra la desinformación en México. Revista de Comunicación. https://doi.org/10.26441/RC22.2-2023-3246
Garzón-Quiroz, M., Del Campo-Saltos, G., & Loor-Ávila, B. (2025). Análisis sistemático sobre la eficiencia comunicativa entre chatbots basados en reglas y modelos de lenguaje natural. Universitas, (42), 167-192. https://doi.org/10.17163/uni.n42.2025.07
Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., Vaughan, A., Yang, A., Fan, A., Goyal, A., Hartshorn, A., Yang, A., Mitra, A., Sravankumar, A., Korenev, A., Hinsvark, A., … Ma, Z. (2024). The Llama 3 Herd of Models (arXiv:2407.21783). arXiv. https://doi.org/10.48550/arXiv.2407.21783
Hendrigan, H., Tan, S., & Cukierman, D. (2024). Combining SIFT and the Information Needs, Types, and Qualities Approaches: A Framework-Informed Strategy for Information Literacy Instruction. The Canadian Journal for the Scholarship of Teaching and Learning, 15(2). https://doi.org/10.5206/cjsotlrcacea.2024.2.15558
Jiménez-García, E., Ruiz-Lázaro, J., Martínez-Requejo, S., & Redondo-Duarte, S. (2025). Inteligencia Artificial y chatbots para una educación superior sostenible: Una revisión sistemática. RIED-Revista Iberoamericana de Educación a Distancia, 28(2). https://doi.org/10.5944/ried.28.2.43240
Khair, R. (2024). Application of Rapid Application Development (RAD) in the E-Career System: A Startup Approach. The Indonesian Journal of Computer Science, 13(6). https://doi.org/10.33022/ijcs.v13i6.4450
Li, X., & Bao, Z. (2024). The Application of AJAX and JSON in the Case. World Journal of Innovation and Modern Technology, 7(5), 113-119. https://doi.org/10.53469/wjimt.2024.07(05).13
Norman-Acevedo, E. (2023). La inteligencia artificial en la educación: Una herramienta valiosa para los tutores virtuales universitarios y profesores universitarios. Panorama, 17(32), 1-11. https://doi.org/10.15765/pnrm.v17i32.3681
Pegalajar Palomino, M. D. C., & Rodríguez Torres, Á. F. (2023). Digital literacy in university students of education degrees in Ecuador. Frontiers in Education, 8, 1299059. https://doi.org/10.3389/feduc.2023.1299059
Rodríguez Almazán, Y., Parra-González, E. F., Zurita-Aguilar, K. A., Mejía Miranda, J., & Bonilla Carranza, D. (2023). ChatGPT: La inteligencia artificial como herramienta de apoyo al desarrollo de las competencias STEM en los procesos de aprendizaje de los estudiantes. ReCIBE, Revista electrónica de Computación, Informática, Biomédica y Electrónica, 12(1), C5-12. https://doi.org/10.32870/recibe.v12i1.291
Rodríguez Rodríguez, A., Domínguez Gálvez, D. L., & Solórzano Álava, W. L. (2024). Comparación del Método Socrático y el Constructivismo en la Educación Moderna. Revista Científica de Innovación Educativa y Sociedad Actual «ALCON», 4(4), 105-117. https://doi.org/10.62305/alcon.v4i4.212
Sanmocte, E. M. T., & Costales, J. A. (2025). Exploring Effectiveness in Software Development: A Comparative Review of System Analysis and Design Methodologies. International Journal of Computer Theory and Engineering, 17(1), 36-43. https://doi.org/10.7763/IJCTE.2025.V17.1367
Singgalen, Y. A. (2024). Implementation of Rapid Application Development (RAD) for Community-based Ecotourism Monitoring System. Journal of Information System Research (JOSH), 5(2), 520-530. https://doi.org/10.47065/josh.v5i2.4749
Velásquez-Henao, J. D., Franco-Cardona, C. J., & Cadavid-Higuita, L. (2023). Prompt Engineering: A methodology for optimizing interactions with AI-Language Models in the field of engineering. DYNA, 90(230), 9-17. https://doi.org/10.15446/dyna.v90n230.111700
Velazquez-Solis, P. E., Flores-Rios, B. L., Astorga-Vargas, M. A., Ibarra Esquer, J. E., González Navarro, F. F., & Pino, F. J. (2017). Evidencia Empírica de la Minería de Procesos en la Implantación de CMMI-DEV - Empiric Evidence of Process Mining in CMMI-DEV Implementation. ReCIBE, Revista electrónica de Computación, Informática, Biomédica y Electrónica, 5(3), V. https://doi.org/10.32870/recibe.v5i3.69
Vidal-Silva, C. L., Sánchez-Ortiz, A., Serrano, J., & Rubio, J. M. (2021). Experiencia académica en desarrollo rápido de sistemas de información web con Python y Django. Formación universitaria, 14(5), 85-94. https://doi.org/10.4067/S0718-50062021000500085
Volotão, C., & Moraes, M. B. D. (2022). A PROMOÇÃO DA COMPETÊNCIA EM INFORMAÇÃO PARA A PREVENÇÃO E CONTROLE DA DESINFORMAÇÃO NA UNIVERSIDADE: O PAPEL DAS BIBLIOTECAS UNIVERSITÁRIAS. Revista EDICIC, 2(3). https://doi.org/10.62758/re.v2i3.152
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Revista Científica Arbitrada Multidisciplinaria PENTACIENCIAS - ISSN 2806-5794.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

