Usability of the “Be Yourself” IA-powered, chatbot-based website for the prevention of adolescent pregnancy
DOI:
https://doi.org/10.17533/udea.iee.v44n1e02Keywords:
pregnancy in adolescence, generative artificial intelligence, artificial intelligence, user-centered design, sexual healthAbstract
Objective. Analyze the usability, interaction patterns, and quality of conversational interaction of the AI-powered “Be Yourself” chatbot to foster self-determined motivation and prevent adolescent pregnancy.
Methods. Post-intervention usability pilot study conducted with 74 Mexican school-going adolescents (aged 11–15), using the System Usability Scale (SUS) at two time points: immediately after the intervention and at two-month follow-up. Interaction metrics (number of messages) and confidence coefficients were analyzed within content related to self-determined motivation, pregnancy prevention, and sexual communication.
Results. Participants were 49.6% male and 50.4% female, with a mean age of 12.7 (SD=0.98). The chatbot recorded 74 chats and 1,236 messages. The SUS was assessed post-intervention (n=74) and at the two-month follow-up (n=70). Initially, usability was rated as 18.9% “Good” and 81.1% “Acceptable.” At follow-up, the proportions across categories changed to 5.7% “Good,” 92.9% “Acceptable,” and 1.4% “Poor.” The Wilcoxon signed-rank test showed a significant decrease in perceived usability (p<0.001; r=-0.56) between the two assessment points. The highest confidence coefficients were observed for communication with parents (93.2%) and pregnancy prevention (89.1%), whereas self-determined motivation was lower (79.1%).
Conclusion. The chatbot demonstrated acceptable usability and high short-term acceptance as an informational tool for preventing adolescent pregnancy. However, the decrease in usability scores at the two-month follow-up indicates the need for improvements to foster sustained engagement and address behavioral aspects.
Downloads
References
1. Rodríguez AM, Roberto AC de M, Martins ES, Gomes EC, Reis IF, Amorim SSS, et al. Consequences and risks of pregnancy in adolescence, an integrative review. International Journal of Health Science. 2024; 4:2-6.
2. Lay AAR, Fujimori E, Duarte LS, Borges ALV. Prevalence and correlates of early sexual initiation among Brazilian adolescents. PLoS One. 2021; 16(12):e0260815.
3. World Health Organization. Adolescent pregnancy [Internet]. Ginebra: WHO; 2024 [cited 2025 Mar 19]. Available from: https://www.who.int/news-room/fact-sheets/detail/adolescent-pregnancy
4. UNFPA LAC. Embarazo en Adolescentes [Internet]. 2025 [cited 2025 Mar 19]. Available from: https://lac.unfpa.org/es/topics/embarazo-en-adolescentes
5. Myat SM, Pattanittum P, Sothornwit J, Ngamjarus C, Rattanakanokchai S, Show KL, Jampathong N, Lumbiganon P. School-based comprehensive sexuality education for prevention of adolescent pregnancy: a scoping review. BMC Womens Health. 2024; 24(1):137.
6. Swain LT, Malouff JM, Meynadier J, Schutte NS. Psychological interventions decrease unintended pregnancies: A meta-analysis of randomized controlled trials. British Journal of Health Psychology. 2023; 28(2):567-85.
7. Aggarwal A, Tam CC, Wu D, Li X, Qiao S. Artificial intelligence-based chatbots for promoting health behavioral changes: Systematic review. Journal of Medical Internet Research. 2023; 25:e40789.
8. Sands D, Finn NB. From internet to AI bot: Leveraging technology to empower and engage patients in their health. Journal of Participatory Medicine. Preprints [Preprint]. 2024 [Cited: 2025 Mar 19]. https://doi.org/10.2196/preprints.68911
9. Wang H, Gupta S, Singhal A, Muttreja P, Singh S, Sharma P, et al. An artificial intelligence chatbot for young people's sexual and reproductive health in India (SnehAI): Instrumental case study. Journal of Medical Internet Research. 2022; 24:e29969.
10. Latt PM, Aung ET, Htaik K, Soe NN, Lee D, King AJ, et al. Real-world evaluation of artificial intelligence (AI) chatbots for providing sexual health information: A consensus study using clinical queries. Research Square [Preprint]. 2024 [Cited 2025 Mar 19]. Available from: https://doi.org/10.21203/rs.3.rs-5190887/v1
11. Oliveira SG de, Torres RAM, Maia SRT, Tavares NBF, Silva HS da. Uso do chatbot para esclarecimento de dúvidas sobre infecções sexualmente transmissíveis em jovens: Revisão de escopo. Contribuciones a las Ciencias Sociales. 2024; 17:e12012.
12. Maenhout L, Peuters C, Cardon G, Compernolle S, Crombez G, DeSmet A. Participatory development and pilot testing of an adolescent health promotion chatbot. Frontiers Public Health. 2021; 9:724779.
13. Massa P, de Souza Ferraz DA, Magno L, Silva AP, Greco M, Dourado I, et al. A transgender chatbot (Amanda Selfie) to create pre-exposure prophylaxis demand among adolescents in Brazil: Assessment of acceptability, functionality, usability, and results. Journal of Medical Internet Research. 2023; 25:e41881
14. Librado González N, Onofre Rodríguez DJ, Sánchez Nigenda R, Dos Santos Monteiro JC, Benavides Torres RA, Márquez Vega MA. Revisión sistemática de programas de prevención de embarazo adolescente mediante páginas web y chatbots. Revista Panamericana de Salud Pública. 2025; 49:e22.
15. Hubert C, Estrada F, Campero L, Heredia-Pi IB, Villalobos A, Suárez-López L, et al. Designing digital tools capable of reaching disadvantaged adolescents and improving their sexual health: A Mexican experience. Journal of Health Care for the Poor and Underserved. 2021; 32(1):62-84.
16. Consejo Nacional de Población (MX). Cuaderno ¡Yo Decido! Mi futuro [Internet]. México: Gobierno de México; 2020 [Cited: 2025 Mar 19]. Available from: https://www.gob.mx/conapo/documentos/cuaderno-yo-decido-mi-futuro
17. Gobierno de México. Chat ¿Cómo le hago? Plataforma de atención en salud sexual y reproductiva [Internet]. 2023 [Cited: 2025 Mar 19]. Available from: http://comolehago.org/
18. Librado González N, Onofre Rodríguez DJ. Mapeo de intervención del programa "Sé tú mismo": Intervención educativa de motivación autodeterminada para prevenir embarazo adolescente. In: Rodríguez-Vázquez N, Hernández-Torres JL, Cárdenas-Cortés AM, editores. Sexualidad adolescente en México. Coahuila: Universidad Autónoma de Coahuila; 2024. p. 77-102.
19. Bangor A, Kortum PT, Miller JT. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies. 2009; 4(3):114-23.
20. Librado González N, Onofre Rodríguez DJ. "Be yourself", educational intervention with chatbot to promote self-determined motivation and prevent adolescent pregnancy: Pilot trial protocol [Internet]. ClinicalTrials.gov; 2025 [Cited: 2025 Mar 19]. Identifier: NCT06824922. Available from: https://clinicaltrials.gov/study/NCT06824922
21. Polit DF, Beck CT. Nursing research: Generating and assessing evidence for nursing practice. 10ª ed. Philadelphia: Wolters Kluwer; 2017.
22. Kowatsch, Tobias, Otto, Lena, Harperink, Samira, Cotti, Amanda and Schlieter, Hannes. "A design and evaluation framework for digital health interventions". It - Information Technology. 2019; 61(5-6): 253-63.
23. Lewis JR. The System Usability Scale: Past, present, and future. International Journal of Human–Computer Interaction. 2018; 34(7):577–90.
24. Chatbase. Chatbase | The complete platform for chat-based AI agents [Internet]. 2025 [Cited: 2025 Mar 19]. Available from: https://www.chatbase.co/
25. Prasad RR, Badgujar S. Use of chatbot for addressing adolescent's queries on sexual and reproductive health-related issues - Findings from a field implementation in Madhya Pradesh, India. Asian Pacific Journal of Health Sciences. 2022; 9(4):165-7.
26. Little KM, Prata N, Denise KDO, Tefouet N, Fotso JC, Angel A, et al. Mixed-methods, cross-sectional assessment of a client-facing, family planning counseling chatbot in Côte d'Ivoire. Oxford Open Digital Health. 2024; 2:oqae027.
27. Bull S, Hood S, Mumby S, Hendrickson A, Silvasstar J, Salyers A. Feasibility of using an artificially intelligent chatbot to increase access to information and sexual and reproductive health services. Digital Health. 2024; 10:20552076241308994.
28. Fetrati H, Chan G, Orji R. Chatbots for sexual health improvement: A systematic review. International Journal of Human–Computer Interaction. 2024; Epub ahead of print. Available from: https://doi.org/10.1080/10447318.2024.2376808
29. Trent M, Tomaszewski K. Family planning appointment attendance among urban youth: Results from the depotext trial. Journal of Adolescent Health. 2013; 52(2Suppl):S88.
30. Rahman R, Rahman MR, Tripto NI, Ali ME, Apon SH, Shahriyar R. AdolescentBot: Understanding opportunities for chatbots in combating adolescent sexual and reproductive health problems in Bangladesh. En: CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems [Internet]. Association for Computing Machinery; 2021 [Cited: 2025 Mar 19]. Available from: https://doi.org/10.1145/3411764.3445694
31. Park J, Singh V, Wisniewski P. Toward safe evolution of Artificial Intelligence (AI) based conversational agents to support adolescent mental and sexual health knowledge discovery. arXiv [cs.HC] [Preprint]. 2024 [Cited: 2025 Mar 19]. Available from: https://doi.org/10.48550/ARXIV.2404.03023
32. Hémono R, Gatare E, Kayitesi L, Packel L, Hunter LA, Kunesh J, et al. CyberRwanda's pathway to impact: Results from a cluster-randomized trial of adolescent family planning knowledge, beliefs, self-efficacy, and behavior. Journal of Adolescent Health. 2024; 74(6):1239-48.
33. Terefe B. The prevalence of teenage pregnancy and early motherhood and its associated factors among late adolescent (15-19) years girls in the Gambia: Based on 2019/20 Gambian demographic and health survey data. BMC Public Health. 2022; 22(1):2281. https://doi.org/10.1186/s12889-022-14167-9
34. Bonnevie E, Lloyd TD, Rosenberg SD, Williams K, Goldbarg J, Smyser J. Layla's got you: Developing a tailored contraception chatbot for Black and Hispanic young women. Health Education Journal. 2021; 80(4):413-24. 22
35. Khawaja Z, Bélisle-Pipon JC. Your robot therapist is not your therapist: Understanding the role of AI-powered mental health chatbots. Frontiers in Digital Health. 2023; 5:1278186.
36. Wycliff K, Cordova-Pozo K, Asori M, Ribeiro JD, Irfan M, Kigongo S, et al. Assessing potential game-changing interventions to reduce adolescent pregnancy in Africa and Latin America: A systematic review and meta-analysis. Research Square [Preprint]. 2024 [Cited: 2025 Mar 19]. Available from: https://doi.org/10.21203/rs.3.rs-5537014/v1
37. Abdulla AI, Mohammed IJ, Yousif ZY, Alsubari B. Generative AI chatbot for engineering scientific journal. Tikrit Journal of Engineering Sciences. 2024; 31(3):72-9.
38. Anisha SA, Sen A, Bain C. Evaluating the potential and pitfalls of AI-powered conversational agents as humanlike virtual health carers in the remote management of noncommunicable diseases: Scoping review. Journal of Medical Internet Research. 2024; 26:e56114.
39. Vieira Martins M, Karara N, Dembiński L, Jacot-Guillarmod M, Mazur A, Hadjipanayis A, et al. Adolescent pregnancy: An important issue for paediatricians and primary care providers - A position paper from the European Academy of Pediatrics. Frontiers Pediatrics. 2023; 11:1119500.
40. Schueller SM, Neary M, O'Loughlin K, Adkins EC. Discovery of and interest in health apps among those with mental health needs: Survey and focus group study. Journal of Medical Internet Research. 2018; 20(6):e10141.
41. United Nations Educational, Scientific and Cultural Organization. Recomendación sobre la ética de la inteligencia artificial [Internet]. París: UNESCO; 2021 [Cited: 2025 Mar 19]. Available from: https://www.unesco.org/es/legal-affairs/recommendation-ethics-artificial-intelligence
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Investigación y Educación en Enfermería
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Derechos de propiedad / Direitos de Propriedade
English: If the article is accepted for publication, all copyright will be of exclusive property of Investigación y Educación en Enfermería. The text and the graphics included in the publication are exclusive responsibility of the authors and not necessarily reflect the thought of the Editorial Committee.
Español: Si el artículo es aprobado para publicación, todos los derechos son de propiedad de Investigación y Educación en Enfermería. El texto y las gráficas incluidas en la publicación son de exclusiva responsabilidad de los autores y no necesariamente refleja el pensamiento del Comité Editorial.
Português: Se o artigo for aceito para publicação, todos os direitos autorais serão de propriedade exclusiva de Investigación y Educación en Enfermería. O texto e os gráficos incluídos na publicação são de responsabilidade exclusiva dos autores e não refletem necessariamente o pensamento do Comitê Editorial.
