The Gender Gap in Artificial Intelligence: An Analysis of Healthcare Texts Translated for Migrant Population
DOI:
https://doi.org/10.17533/udea.ikala.358677Keywords:
Artificial Intelligence, machine translation, migration, gender gap, gender inclusive languageAbstract
ChatGPT is an artificial intelligence tool that has become one of the most widely used by the public worldwide. Among its varied features is the ability to translate texts into a wide range of languages. This qualitative study aims to analyze ChatGPT’s ability to translate migration and healthcare-related texts from English to Spanish, using inclusive language, in order to assess their effectiveness and consistency in that language and thematic context. For this purpose, we used a corpus of 12,687 words of healthcare texts translated for migrant population having Spanish as one of their languages. The texts selected were both pre-edited and not pre-edited, so that the system’s pre-editing biases were observable. The results showed a 100% gap in the translation of texts without specific prompts, and a 54.5% gap when translating complete paragraphs, with 9.1% when translating sentences. The analysis of the results suggests that although artificial intelligence can be a useful tool for translation professionals, human oversight continues to be key, especially in areas of cultural and sexual diversity, as is the case of gender-inclusive language in Spanish. These results help us advocate for a critical reflection on the challenges posed by the use of artificial intelligence in translation and, thereby, the challenges for their future implementation, as well as making clear gender biases in these automated processes, and providing an actual assessment of their impact in current gender studies.
Downloads
References
Abubakar, I., Aldridge, R. W., Devakumar, D., Orcutt, M., Burns, R., Barreto, M. L., Dhavan, P., Fouad, F. M., Groce, N., Guo, Y., Hargreaves, S., Knipper, M., Miranda, J. J., Madise, N., Kumar, B., Mosca, D., McGovern, T., Rubenstein, L., Sammonds, P., … Zhou, S. (2018). The ucl–Lancet Commission on Migration and Health: The health of a world on the move. The Lancet, 392(10164), 2606-2654. https://doi.org/10.1016/S0140-6736(18)32114-7
Acero, J. J. y Dascal, M. (Eds.). (1998). Filosofía del lenguaje. Trotta y Consejo Superior de Investigaciones Científicas.
Aiumtrakul, N., Thongprayoon, C., Arayangkool, C., Vo, K. B., Wannaphut, C., Suppandungsuk, S., Krisanapan, P., Garcia Valencia, O., Qureshi, F., Miao, J. y Cheungpasitporn, W. (2024). Personalized medicine in urolithiasis: ai chatbot-assisted dietary management of oxalate for kidney stone prevention. Journal of Personalized Medicine, 14(1), 107. https://doi.org/10.3390/jpm14010107
Alam, K. e Imran, S. (2015). The digital divide and social inclusion among refugee migrants: A case in regional Australia. Information Technology & People, 28(2), 344-365. https://doi.org/10.1108/ITP-04-2014-0083
Álvaro Aranda, C. (2020). La traducción de materiales sanitarios sobre la covid-19 para población inmigrante: Análisis exploratorio de propuestas en España. trans. Revista de Traductología, (24), 455-468. https://doi.org/10.24310/TRANS.2020.v0i24.9762
Ayuntamiento de Madrid. (2017). Guía de lenguaje inclusivo y no sexista. https://www.madrid.es/UnidadesDescentralizadas/IgualdadDeOportunidades/Publicaciones/ficheros/guialenguajeinclusivoynosexista.pdf
Bhandari, S., Karki, T. y Pandey, P. (2022). Role of development communication in women empowerment. Malaysian Business Management Journal, 1(1), 23-25. https://doi.org/10.26480/mbmj.01.2022.23.25
Bolívar, A. (2019). Una introducción al análisis crítico del “lenguaje inclusivo”. Literatura y Lingüística, (40), 355-375. https://www.scielo.cl/scielo.php?pid=S0716-58112019000200355&script=sci_arttext
Bozorgmehr, K., Biddle, L., Rohleder, S., Puthoopparambil, S. J. y Jahn, R. (2019). What is the evidence on availability and integration of refugee and migrant health data in health information systems in the who European region? Themed issues on migration and health, X. (Health Evidence Network synthesis report 66). World Health Organization Regional Office for Europe. https://iris.who.int/handle/10665/328634
Bozorgmehr, K., McKee, M., Azzopardi-Muscat, N., Bartovic, J., Campos-Matos, I., Gerganova, T.-I., Hannigan, A., Janković, J., Kállayová, D., Kaplan, J., Kayi, I., Kondilis, E., Lundberg, L., Mata, I. D. L., Medarević, A., Suvada, J., Wickramage, K. y Puthoopparambil, S. J. (2023). Integration of migrant and refugee data in health information systems in Europe: Advancing evidence, policy and practice. The Lancet Regional Health - Europe, 34, 100744. https://doi.org/10.1016/j.lanepe.2023.100744
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners (No. arXiv:2005.14165). arXiv. https://doi.org/10.48550/arXiv.2005.14165
Carretero Palacios, A. (2014). Migraciones y género. La feminización de la migración transnacional. Consejería de Justicia e Interior. Junta de Andalucía. https://www.juntadeandalucia.es/export/drupaljda/migraciones_genero.pdf
Celik, I., Dindar, M., Muukkonen, H. y Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616-630. https://doi.org/10.1007/s11528-022-00715-y
Cribben, I. y Zeinali, Y. (2023). The benefits and limitations of Chatgpt in business education and research: A focus on management science, operations management and data analytics. ssrn Electronic Journal. https://doi.org/10.2139/ssrn.4404276
De Marco, M. (2012). Audiovisual translation through a gender lens. brill. https://doi.org/10.1163/9789401207881
Del Valle, J. D. (2014). Lo político del lenguaje y los límites de la política lingüística panhispánica. Boletín de Filología, 49(2), 87-112. https://doi.org/10.4067/S0718-93032014000200005
Díaz, M. (2023, julio 25). How to use Chatgpt: Everything you need to know. Hi-Network. https://www.hi-network.com/how-to-use-chatgpt-everything-you-need-to-know.html
Díaz-Millón, M., Gutiérrez-Artacho, J. y Olvera-Lobo, M. D. (2024). Comunicación interlingüística e intercultural. La transcreación en el contexto de la migración. En A. Castillo y I. Zacipa (Eds.), Retos y tendencias en los nuevos contextos comunicativos (pp. 223-239). Editorial Fragua.
Díaz-Millón, M., Rivera-Trigueros, I. y Pérez-Contreras, Á. (2021). Development of an evaluation tool for assessing the use of inclusive language: An institutional perspective [Ponencia]. 14th annual International Conference of Education, Research and Innovationof 2021, 8th-9th November 2021 (pp. 1842-1847). https://doi.org/10.21125/iceri.2021.0492
España, Consejo General del Poder Judicial. (2009). Normas mínimas lenguaje inclusivo. Normas mínimas para evitar la discriminación de la mujer en el lenguaje administrativo del cgpj. [blog]. https://www.poderjudicial.es/cgpj/es/Temas/Igualdad-de-Genero/Normas-minimas-lenguaje-inclusivo/
Expósito Castro, C. y Rodríguez Muñoz, M. L. (Eds.). (2023). Guía de buenas prácticas de lenguaje inclusivo para la redacción y la traducción. uco Press. https://www.uco.es/servicios/ucopress/images/librosgratuitos/978-84-9927-755-4/9788499277554.pdf
Gallach, A. P., López-Francés, I., García-García, F. J. y Folgado Bueno, L. (2024). Sesgos de la iag: Reflexiones desde la docencia universitaria. Edetania. Estudios y Propuestas Socioeducativos, (65), 47-64. https://doi.org/10.46583/edetania_2024.65.1135
García, M. (2023). Notes on the Spanish translation of Data feminism. En L. Peyrano y F. Aguilar (Eds.), Data feminism. The mit Press. https://data-feminism.mitpress.mit.edu/pub/zhu9hb0a
Gfk dam. (2023, noviembre 29). El número de usuarios de Chatgpt en España se ha triplicado en tan solo un año. https://www.gfk.com/es/prensa/evolucion-chatgpt-gfkdam
Gil-Salmerón, A., Katsas, K., Riza, E., Karnaki, P. y Linos, A. (2021). Access to healthcare for migrant patients in Europe: Healthcare discrimination and translation services. International Journal of Environmental Research and Public Health, 18(15), 7901. https://doi.org/10.3390/ijerph18157901
González-Geraldo, J. L., Buedo-Martínez, S. y Ortega-López, L. (2023). Los micromachismos de Chatgpt: Evidencias sexistas a través de unicode, implicaciones socioeducativas. En Libro de resúmenes del xxxv Congreso Internacional de la Sociedad Iberoamericana de Pedagogía Social: “La pedagogía social en una sociedad digital e hiperconectada: desafíos y propuestas” (p. 102). Universidad de Salamanca. https://cisips.files.wordpress.com/2023/10/libro_resumenes_sips-23.pdf
Gupta, M. R. (2024). Chatgpt—A generative pre-trained transformer. International Journal of Advanced Research in Science, Communication and Technology, 4(1), 590-595. https://doi.org/10.48175/IJARSCT-15087
Gutiérrez-Artacho, J., Olvera-Lobo, M.-D. (2022). Transcreation in digital tourism information: An inclusive language approach. En P. Cembranel, J. R. R. Soares y A. R. C. Perinotto (Eds.), Promoting social and cultural equity in the tourism sector (pp. 245-256). igi Global Scientific Publishing. https://doi.org/10.4018/978-1-6684-4194-7.ch013
Halaweh, M. (2023). Chatgpt in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421. https://doi.org/10.30935/cedtech/13036
Instituto de la Mujer y para la Igualdad de Oportunidades (s. f.). Guías de uso no sexista del lenguaje. https://www.inmujeres.gob.es/servRecursos/formacion/GuiasLengNoSexista/docs/Guiaslenguajenosexista_.pdf
International Organization for Migration. (2021). World migration report 2022. https://publications.iom.int/books/world-migration-report-2022
Jiménez-Castro, M. (2022). Traducción y localización de tecnologías de la información y comunicación en el ámbito sanitario para la inclusión de población migrante. En S. Olivero Guidobono (Coord.), El camino hacia las sociedades inclusivas (pp. 828-843). Dykinson.
Jiménez-Castro, M., Díaz-Millón, M. y Rivera-Trigueros, I. (2023). Analysis of (gender-)inclusive language strategies in ecotourism corporate websites of Southern Spanish smes. Procedia Computer Science, 219, 3-10. https://doi.org/10.1016/j.procs.2023.01.257
Jiménez-Castro, M. y Gutiérrez-Artacho, J. (2023). El acceso a la información multilingüe para las personas migrantes: estudio de caso en la ciudad autónoma de Ceuta. En I. Blázquez Rodríguez y M. Á. Martín López (Coords.), Migraciones internacionales y sostenibilidad social (pp. 624-240). Dykinson.
Jin, W., Cheng, Y., Shen, Y., Chen, W. y Ren, X. (2022). A good prompt is worth millions of parameters: Low-resource prompt-based learning for vision-language models. En Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 2763-2775). Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.acl-long.197
Kluge, H. H. P., Jakab, Z., Bartovic, J., D’Anna, V. y Severoni, S. (2020). Refugee and migrant health in the covid-19 response. The Lancet, 395(10232), 1237-1239. https://doi.org/10.1016/S0140-6736(20)30791-1
Knipper, M., Bozorgmehr, K., Offe, J. y Orcutt, M. (2021). Germany’s new global health strategy: Leaving migrants behind. The Lancet, 397(10268), 20-21. https://doi.org/10.1016/S0140-6736(20)32546-0
Knisely, K. A. (2020). Le français non‐binaire : Linguistic forms used by non-binary speakers of French. Foreign Language Annals, 53(4), 850-876. https://doi.org/10.1111/flan.12500
Kumar, H., Musabirov, I., Shi, J., Lauzon, A., Choy, K. K., Gross, O., Kulzhabayeva, D. y Williams, J. J. (2022). Exploring the design of prompts for applying gpt-3 based chatbots: A mental wellbeing case study on Mechanical Turk (versión 1). arXiv. https://doi.org/10.48550/ARXIV.2209.11344
Liuccio, M. (2015). Gender, health, and communication. Journal of Communication in Healthcare, 8(1), 5-6. https://doi.org/10.1179/1753806815Z.000000000104
Lodge, J. M., Thompson, K. y Corrin, L. (2023). Mapping out a research agenda for generative artificial intelligence in tertiary education. Australasian Journal of Educational Technology, 39(1), 1-8. https://doi.org/10.14742/ajet.8695
Marnpae, M. (2014). Materiales multilingües en el ámbito sanitario en España. Panacea, 15(40), 264-277. https://www.tremedica.org/wp-content/uploads/n40_tribuna_Marnpae.pdf
McMullin, C. (2021). Migrant integration services and coping with the digital divide: Challenges and opportunities of the covid-19 pandemic. Voluntary Sector Review, 12(1), 129-136. https://doi.org/10.1332/204080520X16076177287917
Meana Suárez, T. (s. f.). Porque las palabras no se las lleva el viento: por un uso no sexista de la lengua. Ayuntamiento de Quart de Poblet.
Moneus, A. M. y Sahari, Y. (2024). Artificial intelligence and human translation: A contrastive study based on legal texts. Heliyon, 10(6), e28106. https://doi.org/10.1016/j.heliyon.2024.e28106
Morales-Chan, M. A. (2023). Explorando el potencial de Chatgpt: Una clasificación de Prompts efectivos para la enseñanza. Biblioteca Galileo. https://biblioteca.galileo.edu/tesario/handle/123456789/1348
Naciones Unidas (2015). Transformar nuestro mundo: la Agenda 2030 para el desarrollo sostenible. https://unctad.org/system/files/official-document/ares70d1_es.pdf
onu Mujeres (2023a). Acerca de onu Mujeres. https://www.unwomen.org/es/about-un-women
onu Mujeres (2023b). Migration experiences of people with diverse sogiesc: Policy paper. https://www.unwomen.org/sites/default/files/2023-12/policy-paper_migration-experiences-people-diverse-sogiesc-en.pdf
onu Mujeres (2023c). Strengthening migration programming from a gender perspective: Lessons learned. https://www.unwomen.org/sites/default/files/2023-06/Strengthening-migration-programming-from-a-gender-perspective-Lessons-learned-en.pdf
Parlamento Europeo. (2018). Gender-neutral language in the European Parliament. https://www.europarl.europa.eu/cmsdata/151780/GNL_Guidelines_EN.pdf Parra, M. L. y Serafini, E. J. (2022). “Bienvenidxs todes”: el lenguaje inclusivo desde una perspectiva crítica para las clases de español. Journal of Spanish Language Teaching, 8(2), 143-160. https://doi.org/10.1080/23247797.2021.2012739
Rivera Alfaro, S. (2019). La planificación lingüística en la Universidad de Costa Rica: política lingüística de lenguaje inclusivo de género, su ejecución y relación con propuestas de universidades hispanohablantes. Revista de Filología y Lingüística de la Universidad de Costa Rica, 45(2), 269-294. https://doi.org/10.15517/rfl.v45i2.39162
Saghir, A., Ashfaq, M. y Noreen, A. (2009). Gender and information and communication technologies (icts). Journal of Animal and Plant Sciences, 19(2): 94-97. https://eurekamag.com/research/066/222/066222803.php
Scotto, S. C. y Pérez, D. I. (2020). Relatividad lingüística, gramáticas de género y lenguaje inclusivo: algunas consideraciones. Análisis Filosófico, 40(1), 5-39. https://doi.org/10.36446/af.2020.318
Serre-Delcor, N., Oliveira, I., Moreno, R., Treviño, B., Hajdók, E., Esteban, E., Murias-Closas, A., Denial, A. y Evangelidou, S. (2021). A cross-sectional survey on professionals to assess health needs of newly arrived migrants in Spain. Frontiers in Public Health, 9, 667251. https://doi.org/10.3389/fpubh.2021.667251
Universidad de Granada. (2023). Guías del lenguaje no sexista. https://viics.ugr.es/sites/vic/viics/public/inline-files/Guia%20de%20Lenguaje.%20Maquetado.pdf
Yin, Z. H. y Choi, C. H. (2022). The effect of trade on the gender gap in labour markets: The moderating role of information and communication technologies. Economic Research-Ekonomska Istraživanja, 36(1), 2443-2462. https://doi.org/10.1080/1331677X.2022.2100434
Zambrini, L. (2011). Modos de vestir e identidades de género: reflexiones sobre las marcas culturales en el cuerpo. Nomadías, (11), 130-149. https://doi.org/10.5354/0719-0905.2010.15158
Zhou, K., Yang, J., Loy, C. C. y Liu, Z. (2022). Learning to prompt for vision-language models. International Journal of Computer Vision, 130(9), 2337-2348. https://doi.org/10.1007/s11263-022-01653-1
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2024 Íkala, Revista de Lenguaje y Cultura
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
