The nursing care process (NCP) is a tool that allows professional nurses to apply the scientific method to provide care in continuous and individualized manner, rationally, logically, and systematically.1 Application of the NCP has been enriched with the use of the nursing taxonomies about results2) and interventions3 that summarize the diagnoses of the North American Nursing Diagnosis Association (NANDA).4) The use of nursing outcomes from the Nursing Outcome Classification (NOC) began in the 1960s; its objective was to assess the quality of nursing care. From there, processes of adjustments and measures have been developed. Currently, the NOC classification, in the sixth-edition text, contains 540 results, 7 domains, and 32 classes. The NOC results, in care plans, quantify the state, behavior or perception of the patient expected to occur in specific moments of a care episode. Each NOC has a battery of indicators evaluated by the professional. The scores issued from the NOC, using a Likert scale from one to five, measure the initial and final state of the diagnosis intervened and, consequently, the change in the patient's health, if any.2) However, for the NOC to be replicated, it is necessary to validate its indicators, which analyze the adequate psychometric characteristics to measure that for which it was designed.5 This content validity consists in the evaluation by experts on the study theme of the relevance (importance of the item measured in the context) and pertinence (quality of the item of corresponding entirely to the context) of the items included in a scale.6,7
The evaluation of care by nursing professionals to patients with delirium is part of interdisciplinary work, given that management of the diagnosis is multicausal, commonly goes unnoticed by over 67% of non-psychiatric physicians8,9 and only 22% of the nursing staff identifies delirium and its criteria.10) A study conducted in Cartagena (Colombia) affirmed that 54.23% of medical professionals and nurses evaluate delirium occasionally, 68.31% evaluate delirium through general clinical evaluation; moreover, 52.11% of the professionals consider that delirium is a pathology that requires intervention.11
The foregoing identifies a void in the continuity of caring for delirium and in unifying the results and interventions to implement. In addition, it has led to the need to use evaluation scales for the early detection and management of delirium. However, few of these scales or tools have been validated and are typical of nursing professionals.12 Based on the aforementioned, the aim of this study was to validate the indicators contained in the NOC of a nursing care plan developed previously by the research team to manage elderly patients with postsurgical delirium. This care plan included 11 NOC: cognition, nutrition, cardiac pump effectiveness, circulatory state, hydric balance, respiratory state, pain control, mobility, electrolyte and acid-base balance, sleep and vital signs.8 The vital sign NOC was identified as an activity inherent to the care provided by professionals in addition to being in the protocols of hospital institutions, hence, it was excluded from the validation. The context to which the care plan is applied corresponds to the intensive care units (ICU) and hospitalization units where postsurgical delirium is treated.
Design. A content validity process was carried out by expert judgment using the Delphi method.13) The population was comprised by nurses with graduate studies, experience in ICU and hospitalization of at least two years, including management of patients with delirium and the nursing care process. The participants were recruited according to their compliance with the inclusion criteria through contact with the academic units linked to the hospital institutions participating in the research. The sample was taken according with the criteria by Hyrkäs et al.,14) who manifest that 10 experts provide a reliable estimation of the content validity of an instrument; in turn, Voutilainen & Liukkonen15 indicate that if 80% of the experts have agreed with the validity of an item, it can be incorporated onto the instrument.
Data collection. The study was conducted during two moments: the first from January to May of 2021, with the literature search by the researchers to select the indicators of the results that have been used to evaluate the evolution of patients with delirium, according to NANDA diagnoses established in a prior study carried out in the city of Cartagena (Colombia).8 The second moment was the evaluation by nurses from August to October of 2021, with the participation of 14 experts from four hospital institutions who assessed the pertinence and relevance of the NOC indicators with the aid of a form delivered via e-mail. The nurses took between five and twenty days to respond.
Instruments. The form used contained two questionnaires: one for sociodemographic variables (age, academic training, work experience, knowledge about the NCP, experience in managing patients with delirium) and another that contained the results to be evaluated with their indicators according to relevance and relevance. Each indicator corresponded to an item from the form, so that nurses made their judgment based on the relevance and pertinence measured with a Likert scale, where they assigned a score from one to five, considering one as not relevant or not pertinent and five as very relevant or pertinent.16
Data analysis. To analyze the information, relative and absolute frequencies were calculated for categorical or qualitative variables and measures of central tendency and dispersion for numerical variables. The Content Validity Coefficient (CVC) was calculated for each of the items. When the experts assigned scores of 4 or 5 (relevant and pertinent), these were assumed as a favorable concept and the fraction was calculated with the total responses for each item, following what was proposed by Polit et al.,16 in addition, the mean of the scores of the indicators is presented. Calculations were performed on the STATAv statistical software.
Ethical considerations. The study was based on Resolution 8430 of 1993 by the Colombian Ministry of Health17 and the Declaration of Helsinki promulgated by the World Medical Association in 2000.18 The research was considered a study without risk. Among the ethical principles of the research, autonomy was taken into account. The informed consent was requested to be signed and forwarded by e-mail; the objective of the research was explained to the participants in the document, highlighting that their participation and withdrawal was voluntary. The study was endorsed by the ethics committee at Universidad de Cartagena (Colombia) with minute 02 of May 11, 2021.
Fourteen expert judges participated by reviewing the indicators from 10 NOC. The experts were characterized, thus: eight with Masters educational level and 7 with specialization; with an average of 15.28 ± 8.87 years of work experience and an average of 9.21 ± 4.26 years managing patients with delirium (Table 1).
Table 2 shows the CVC according to the pertinence and relevance criteria of each of the NOC indicators; 68 indicators were linked, among which 9 from cognition NOC, 7 from sleep, 10 from nutrition, 7 from cardiac pump effectiveness, 7 from circulatory state, 5 from hydric balance, 10 from electrolyte and acid-base balance, 6 from respiratory state, 5 from pain control, and 7 from mobility. It is noted that 85.52% (58) had CVC > 0.80, 97.70% (66) with CVC > 0.75, and only two items had low scores, which are “040004 Ejection fraction” with CVC = 0.64 and “040105 Central venous pressure” with CVC = 0.57.
Table 2 shows that the health physiology domain contains the most nursing outcomes (NOC) 7/10; in these seven results, each indicator was scored by the experts with agreement among them > 4.20, corresponding to being pertinent and relevant. Likewise, it is possible to identify the relationship between results, like Cardiac pump effectiveness and Circulatory state, where indicators to be evaluated are shared, and between Hydric balance and Electrolyte and acid-base balance, which share indicators to measure. It is shown how the nutritional state NOC is a necessary element to be incorporated in monitoring of patients with eight indicators.
The findings reveal that the indicators selected for each of the 10 NOC contemplated in this study are pertinent and relevant, which is why they can be considered by nursing professionals to evaluate the evolution of care for adult and elderly patients with postsurgical delirium. Most of the indicators had a CVC mean > 0.80. The evolution is complemented with monitoring of vital signs.
This work is among the first to use NOC indicators to measure the evolution of patients with postsurgical delirium, a fact that also hinders discussion with other previous studies. The expert participants showed graduate academic level, which leads to believe that they managed adequately the concept of patients with delirium. It is noteworthy that the use of these indicators may complement the use of other evaluation instruments, highlighting the CAM-ICU scale, considered the valid and reliable psychometric instrument to issue the delirium diagnosis,19,20) as well as to determine the prevalence of the problem.21
In relation with the indicators, the NOC result: Cognition showed nine indicators to measure, with “is oriented” being relevant. Thus, is how Inouye et al.,22) showed in their study that specific interventions of information on orientation, for example, date, time, names of hospital staff, cognitive stimulation activities, among others, reduce significantly the number and duration of delirium episodes in relation with patients not monitored with the information described. Due to being quite close to patients, nurses are perhaps the individuals who can better stimulate patient orientation in the ICU and contribute to earlier reversal of delirium.
Moreover, from the nutrition NOC, it was evidenced that protein, fat, carbohydrate, fiber, and calcium intake is considered important by the experts. The literature shows that managing elements, like electrolytes and proteins is key. It has been demonstrated that biochemical alterations (low sodium and potassium levels) and a low body mass index (BMI) are indicators that lead to deteriorated cognitive function that predispose the severity of delirium.23 Thereby, the need is evidenced for biochemical monitoring in coordination with other disciplines.
The NOC indicators related with cardiac pump effectiveness and circulatory state relate to monitoring of diastolic and systolic blood pressure in patients, as mechanism to control adequate and sufficient perfusion at the cerebral level in these patients. This is coherent with the findings by Wang et al.,24) who reported greater prevalence of postsurgical delirium in patients undergoing surgical procedures that occurred with low saturations due to their decreased mean arterial pressure.
It was evidenced in the results that maintaining electrolytes, pH, bicarbonate, and hematocrits are necessary variables to measure during the patient’s clinical signs and symptoms. This agrees with that explained by Artola et al., (25) who reported that early detection of dehydration signs, states of oliguria added to maintaining a hydric balance lead to early identification of hydro-electrolyte alterations and, with this, permit unifying correct treatment actions by the interdisciplinary team.
With regards to the respiratory state NOC, the experts classified the six indicators with maximum pertinence and relevance, which could infer that oxygenation is an essential process for optimal brain functioning, thought processes and the state of cognition that, in situations like surgical procedures can be compromised, causing delirium in patients. Therefore, if each of the indicators is evaluated in time, the condition could be controlled early. In this respect, Recasens et al.,26 through a program, via prior training and formation of nursing professionals on the management of the NANDA, NOC, NIC taxonomy, managed to incorporate the evaluation of the respiratory state NOC and, with this, evaluation of care was standardized, in addition to supporting nursing professionals to pay attention to changes specific to the respiratory state.
Finally, upon analyzing the mobility, pain control and sleep NOC indicators, it may be documented that their articulation is important in the evolution of the delirium condition; patients can recognize the moment when their pain begins and mention these changes to the health professional, they could correlate whether it is during mobility, exercise, or postural change, in addition to the fact that it could cause changes in the hours and quality of sleep of patients with delirium. The foregoing is corroborated with the study by Rodríguez et al.,27) where the range of pain prevailing in postsurgical patients was slight, attributed, among other factors, to its early detection and to correcting activities, like early mobilization to ensure that the patient intervened reconciles sleep.
Among the strengths of this study, it is considered that the indicators evaluated guide in care process for patients with delirium in ICU and hospitalization contexts in which this condition can develop. It is convenient to continue exploring other interventions that involve, for example, the family,28 or that take place in other services, like emergency,29 besides analyzing the effect on the workload30 of the nursing staff given the occurrence of delirium in patients. Further, it would be worth investigating possible interventions or guidelines at the home level,31 as well as performing post-discharge research to determine the quality of life and functionality (32 in patients who have endured this event.
Among the limitations of this study, it should be noted that the validation was applied by experts who manage the taxonomies, which is why its implementation requires extensive knowledge by all nursing professionals to manage a clinical diagnosis, like delirium. Furthermore, it is necessary to continue advancing in validation studies involving more countries and which explore more advanced procedures.
Regarding the practical implications of this research, it is worth highlighting that application of the NANDA, NOC, NIC taxonomy allows obtaining precise information that should be assumed by health professionals, in their care practice, because it has been proven that it allows them to make their practice fluid, define interventions patients require, and evaluate the evolution of the diagnosis labeled. In line with the aforementioned, this requires training on managing taxonomies, something that should be evaluated in undergraduate and graduate training.
Conclusion. The findings, herein, show a high relevance and pertinence index of the indicators evaluated, which favors their being applied to measure care changes in patients with delirium. Among these changes, indicators of aspects related to sleep quality, biochemical measures, pain control or cognition are included.
2. Moorhead S, Swanson E, Johnson M, Maas ML. Clasificación de Resultados de Enfermería NOC. Medición de Resultados en Salud. 6 ed. Barcelona, España: Elsevier; 2018.
S Moorhead E Swanson M Johnson ML Maas Clasificación de Resultados de Enfermería NOC. Medición de Resultados en Salud. 6 edBarcelona, EspañaElsevier2018
6. Bosch-Alcaraz A, Jordan-Garcia I, Alcolea-Mon S, Fernández-Lorenzo R, Carrasquer-Feixa E, Ferrer-Orona M, et al. Validez de contenido de una escala de confort crítico pediátrico mediante una metodología mixta. Enferm. Intensiva. 2018; 29(1):21-31.
A Bosch-Alcaraz I Jordan-Garcia S Alcolea-Mon R Fernández-Lorenzo E Carrasquer-Feixa M Ferrer-Orona Validez de contenido de una escala de confort crítico pediátrico mediante una metodología mixtaEnferm. Intensiva20182912131
7. Manrique-Anaya Y, Cogollo-Milanés M, Simancas-Pallares M. Adaptación transcultural y validez de un pictograma para evaluar necesidades de comunicación en adultos con vía aérea artificial en cuidados intensivos. Enferm. Intensiva . 2021; 32(4):198-206.
Y Manrique-Anaya M Cogollo-Milanés M Simancas-Pallares Adaptación transcultural y validez de un pictograma para evaluar necesidades de comunicación en adultos con vía aérea artificial en cuidados intensivosEnferm. Intensiva2021324198206
8. Melguizo-Herrera E, Acosta-López A, Gómez-Palencia IP, Manrique-Anaya Y, Hueso-Montoro C. The Design and validation of a Nursing Plan for Elderly Patients with Postoperative Delirium. Int. J. Environ. Res. Public Health. 2019; 16(22):4504
E Melguizo-Herrera A Acosta-López IP Gómez-Palencia Y Manrique-Anaya C Hueso-Montoro The Design and validation of a Nursing Plan for Elderly Patients with Postoperative DeliriumInt. J. Environ. Res. Public Health2019162245044504
10. Ocádiz-Carrasco J, Gutiérrez-Padilla RA, Páramo-Rivas F, Tovar-Serrano A, Hernández-Ortega JL. Programa preventivo del delirio postoperatorio en ancianos. Cir. Cir. 2013; 81(3):181-6.
J Ocádiz-Carrasco RA Gutiérrez-Padilla F Páramo-Rivas A Tovar-Serrano JL Hernández-Ortega Programa preventivo del delirio postoperatorio en ancianosCir. Cir2013813181186
11. Estrada SM, González JJ, Herrera KD, Ramos MV, Vásquez KP, Melguizo E. Conceptos y prácticas sobre delirium por parte de los médicos y enfermeras en una institución de salud - Cartagena 2017-2018. Cartagena: Universidad de Cartagena; 2018.
SM Estrada JJ González KD Herrera MV Ramos KP Vásquez E Melguizo Conceptos y prácticas sobre delirium por parte de los médicos y enfermeras en una institución de salud - Cartagena 2017-2018CartagenaUniversidad de Cartagena2018
12. Henao AM. Delirium en pacientes con ventilación mecánica en la UCI: factores asociados y cuidado de Enfermería. (Dissertation). Bogotá: Universidad Nacional de Colombia, Facultad de Enfermería; 2013.
AM Henao Delirium en pacientes con ventilación mecánica en la UCI: factores asociados y cuidado de Enfermería. (Dissertation)BogotáUniversidad Nacional de Colombia, Facultad de Enfermería2013
14. Hyrkäs K, Appelqvist-Schmidlechner K, Oksa L. Validating an instrument for clinical supervision using an expert panel. Int. J. Nurs. Stud. 2003; 40(6):619-25.
K Hyrkäs K Appelqvist-Schmidlechner L Oksa Validating an instrument for clinical supervision using an expert panelInt. J. Nurs. Stud2003406619625
16. Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Res. Nurs. Health. 2006; 29(5): 489-97.
DF Polit CT Beck The content validity index: are you sure you know what's being reported? Critique and recommendationsRes. Nurs. Health2006295489497
17. Colombia, Ministerio de Salud. Resolución 8430 de 1993, por la cual se establecen las normas científicas, técnicas y administrativas para la investigación en salud. 1993.
Colombia, Ministerio de Salud Resolución 8430 de 1993, por la cual se establecen las normas científicas, técnicas y administrativas para la investigación en salud1993
18. Asociación Médica Mundial. Declaración de Helsinki de la AMM: principios éticos para las investigaciones médicas en seres humanos [Internet]. 2000 [cited 17 Jun 2022]; Available from: Available from: https://www.wma.net/es/policies-post/declaracion-de-helsinki-de-la-amm-principios-eticos-para-las-investigaciones-medicas-en-seres-humanos/ .
Asociación Médica Mundial Declaración de Helsinki de la AMM: principios éticos para las investigaciones médicas en seres humanos200017 Jun 2022Available from: https://www.wma.net/es/policies-post/declaracion-de-helsinki-de-la-amm-principios-eticos-para-las-investigaciones-medicas-en-seres-humanos/
19. Contreras CCT, Esteban ANP, Parra MD, Romero MKR, Silva CGD, Buitrago NPD. Multicomponent nursing program to prevent delirium in critically ill patients: a randomized clinical trial. Rev. Gaucha Enferm. 2021; 3(42):e20200278.
CCT Contreras ANP Esteban MD Parra MKR Romero CGD Silva NPD Buitrago Multicomponent nursing program to prevent delirium in critically ill patients: a randomized clinical trialRev. Gaucha Enferm2021342e20200278
20. Contreras CCT, Páez-Esteban AN, Rincon-Romero MK, Carvajal RR, Herrera MM, Castillo AHDD. Nursing intervention to prevent delirium in critically ill adults. Rev. Esc. Enferm. USP. 2021; 16(55):e03685.
CCT Contreras AN Páez-Esteban MK Rincon-Romero RR Carvajal MM Herrera AHDD Castillo Nursing intervention to prevent delirium in critically ill adultsRev. Esc. Enferm. USP20211655e03685
21. Madera O, Lugo A, Hernández J, Núñez A, Ureña M, Petit-Frere G. Prevalencia de deliro posoperatorio y factores de riesgo relacionados en pacientes intervenidos quirúrgicamente. An. Med. PUCMM. 2014; 4(1):38-45.
O Madera A Lugo J Hernández A Núñez M Ureña G Petit-Frere Prevalencia de deliro posoperatorio y factores de riesgo relacionados en pacientes intervenidos quirúrgicamenteAn. Med. PUCMM2014413845
22. Inouye SK, Bogardus ST, Charpentier PA, et al. Una intervención multicompartimental para prevenir el delirio en pacientes mayores hospitalizados. N. Engl. J. Med. 1999; 340:669-76.
SK Inouye ST Bogardus PA Charpentier Una intervención multicompartimental para prevenir el delirio en pacientes mayores hospitalizadosN. Engl. J. Med1999340669676
23. Carrasco M, Zalaquett M. Delirium: una epidemia desde el servicio de urgencia a la unidad de paciente crítico. Rev. Med. Clin. Condes. 2017; 28(2):301-10.
Carrasco M, Zalaquett M. Delirium: una epidemia desde el servicio de urgencia a la unidad de paciente críticoRev. Med. Clin. Condes2017282301310
24. Wang X, Feng K, Liu H, Liu Y, Ye M, Zhao G, et al. Regional cerebral oxygen saturation and postoperative delirium in endovascular surgery: a prospective cohort study. Trials. 2019 20(1):504.
X Wang K Feng H Liu Y Liu M Ye G Zhao Regional cerebral oxygen saturation and postoperative delirium in endovascular surgery: a prospective cohort studyTrials2019201504504
26. Recasens M, Villamor A, Sanz M, Sánchez M, Serna R, Asensio Y. Eficacia de un plan de cuidados de enfermería específico para el paciente con delirio. Rev. Cubana Enferm. 2019; 35(1):e1749.
M Recasens A Villamor M Sanz M Sánchez R Serna Y Asensio Eficacia de un plan de cuidados de enfermería específico para el paciente con delirioRev. Cubana Enferm2019351e1749
27. Rodríguez-Díaz JL, Galván-López GP, Pacheco-Lombeida MX, Parcon-Bitanga M. Evaluación del dolor postquirúrgico y el uso de terapias complementarias por enfermería. AMC. 2019; 23(1):53-63.
JL Rodríguez-Díaz GP Galván-López MX Pacheco-Lombeida M Parcon-Bitanga Evaluación del dolor postquirúrgico y el uso de terapias complementarias por enfermeríaAMC20192315363
28. Mitchell ML, Kean S, Rattray JE, Hull AM, Davis C, Murfield JE, Aitken LM. A family intervention to reduce delirium in hospitalized ICU patients: A feasibility randomized controlled trial. Intensive Crit. Care Nurs. 2017; 40:77-84.
ML Mitchell S Kean JE Rattray AM Hull C Davis JE Murfield LM Aitken A family intervention to reduce delirium in hospitalized ICU patients: A feasibility randomized controlled trialIntensive Crit. Care Nurs2017407784
29. João VM, Dias BM, Oliveira MPd, Laus AM, Bernardes A, Gabriel CS. Cultura de Segurança do Paciente no Serviço Médico de Urgência: estudo transversal. Rev. Cuid. 2023; 14(1):e2531.
João VM, Dias BM, Oliveira MPd, Laus AM, Bernardes A, Gabriel CSCultura de Segurança do Paciente no Serviço Médico de Urgência: estudo transversalRev. Cuid2023141e2531
30. Cáceres Rivera DI, Ruiz Sandoval JP, Cristancho Zambrano LY, Pulido Montes MA, López Romero LA. Métodos empleados para cuantificar la carga de trabajo en Enfermería en las unidades de cuidados intensivos: Una revisión de la literatura. Rev. Cuid . 2022; 13(3):e2301.
DI Cáceres Rivera JP Ruiz Sandoval LY Cristancho Zambrano MA Pulido Montes LA López Romero Métodos empleados para cuantificar la carga de trabajo en Enfermería en las unidades de cuidados intensivos: Una revisión de la literaturaRev. Cuid2022133e2301
31. Campos de Aldana MS, Durán- Niño EY, Ruiz-Roa Silvia Liliana, Páez Esteban AN. Plan de egreso: herramienta del cuidado-diada con enfermedad crónica. Rev. Cuid . 2023; 14(1):e2754.
MS Campos de Aldana EY Durán- Niño Ruiz-Roa Silvia Liliana AN Páez Esteban Plan de egreso: herramienta del cuidado-diada con enfermedad crónicaRev. Cuid2023141e2754
32. Mejia Vanegas D, Arias Díaz JA, Leyton Toro L, Ayala Grajales KY, Becerra Londoño AM, Vallejo Ospina JI, Rincón Hurtado AM. Calidad de vida y funcionalidad en sobrevivientes de cuidados intensivos: Una revisión exploratoria. Rev. Cuid . 2022; 13(3):e2269.
D Mejia Vanegas JA Arias Díaz L Leyton Toro KY Ayala Grajales AM Becerra Londoño JI Vallejo Ospina AM Rincón Hurtado Calidad de vida y funcionalidad en sobrevivientes de cuidados intensivos: Una revisión exploratoriaRev. Cuid2022133e2269