Reliability and Validity of the Persian Version of Intensive Care Delirium Screening Checklist in detection of delirium in Intensive Care Units

Document Type : Original Article (s)

Authors

1 MSc Student, Department of Nursing and Midwifery, School of Nursing and Midwifery, Arak University of Medical Sciences, Arak, Iran

2 Associate Professor, Department of Nursing and Midwifery, School of Nursing and Midwifery, Arak University of Medical Sciences, Arak, Iran

3 Assistant Professor, Psychosomatic Research Center AND Department of Psychiatry, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran

4 Associate Professor, Psychosomatic Research Center AND Department of Psychiatry, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran

5 Department of Clinical Psychology, University of Social Welfare and Rehabilitation Sciences, Tehran, Iran

Abstract

Background: Delirium is a dangerous neuro-psychiatric syndrome. Intensive Care Delirium Screening Checklist (ICDSC) is a suitable tool for diagnosis of this disease. This tool has not been translated and validated into Persian language until now. The goal of this study was to determine the reliability and validity of Persian version of this tool in detection of delirium in intensive care units (ICU).Methods: This study is a psychometric study of the Persian version. All samples were selected from hospitalized patients in ICU and nurses in Al-Zahra hospital, Isfahan, Iran, in 2015. In each case, after 30 minutes of making diagnoses based on Diagnostic and Statistical Manual of Mental Disorders-Forth Version-Text Revision (DSM-IV-TR) criteria by a psychiatrist, a nurse makes her diagnoses by using ICDSC without knowing the psychiatrist’ idea. Then all cases of delirium diagnosis according to the tool were compared with delirium diagnosis by psychiatrist and psychometric properties of tool were assessed.Findings: After doing forward and backward translation, the face validity was confirmed. The mean of content validity index (CVI) in relevancy, clarity and simplicity were 0.83, 0.81, and 0.86 respectively. The construct validity based on factor analysis outputs were above 0.5 for all items. In criterion validity measurement, the cut point of five for Persian version of ICDSC is founded. In this cut point the sensitivity and specificity of the tool was calculated 80% and 93%, respectively. The positive predictive value and negative predictive value in this cut off was calculated 92% and 88%, respectively. The correlation between an equivalent criteria with this tool for delirium screening was 0.74 (P = 0.001). Internal Consistency for the tool based on Cronbach’s alpha was 0.83 and the correlation between two split half of the tool for delirium screening was 0.72.Conclusion: The Persian version of ICDSC has a high validity and reliability for delirium screening. This tool in cut point of five can differentiate delirium from normal case with high positive and negative predictive value.

Keywords


  1. Solai LKK. Delirium. In: Sadock BJ, Sadock VA, Ruiz P, editors. Kaplan and Sadock's comprehensive textbook of psychiatry. 9th ed. New York, NY: Lippincott Williams and Wilkins; 2009. p. 1153-67.
  2. Jackson P, Khan A. Delirium in critically ill patients. Crit Care Clin 2015; 31(3): 589-603.
  3. Bryczkowski SB, Lopreiato MC, Yonclas PP, Sacca JJ, Mosenthal AC. Risk factors for delirium in older trauma patients admitted to the surgical intensive care unit. J Trauma Acute Care Surg 2014; 77(6): 944-51.
  4. Vasilevskis EE, Han JH, Hughes CG, Ely EW. Epidemiology and risk factors for delirium across hospital settings. Best Pract Res Clin Anaesthesiol 2012; 26(3): 277-87.
  5. Catic AG. Identification and management of in-hospital drug-induced delirium in older patients. Drugs Aging 2011; 28(9): 737-48.
  6. Leentjens AF, van der Mast RC. Delirium in elderly people: an update. Curr Opin Psychiatry 2005; 18(3): 325-30.
  7. Saxena S, Lawley D. Delirium in the elderly: a clinical review. Postgrad Med J 2009; 85(1006): 405-13.
  8. Soejono CH. Sindrom delirium akut (acute confusional state). In: Sudoyo AW, Setyohadi B, Alwi I, Kolopaking MS, Setiati S, editors. Buku ajar ilmu penyakit dalam. 4th ed. Jakarta, Indonesia: Pusat Penerbitan Ilmu Penyakit Dalam; 2006. p.1433-8.
  9. Inouye SK. A practical program for preventing delirium in hospitalized elderly patients. Cleve Clin J Med 2004; 71(11): 890-6.
  10. Sri-on J, Tirrell GP, Vanichkulbodee A, Niruntarai S, Liu SW. The prevalence, risk factors and short-term outcomes of delirium in Thai elderly emergency department patients. Emerg Med J 2016; 33(1): 17-22.
  11. Cole MG, McCusker J, Bellavance F, Primeau FJ, Bailey RF, Bonnycastle MJ, et al. Systematic detection and multidisciplinary care of delirium in older medical inpatients: a randomized trial. CMAJ 2002; 167(7): 753-9.
  12. Sharma A, Malhotra S, Grover S, Jindal SK. Incidence, prevalence, risk factor and outcome of delirium in intensive care unit: a study from India. Gen Hosp Psychiatry 2012; 34(6): 639-46.
  13. McCusker J, Cole M, Abrahamowicz M, Primeau F, Belzile E. Delirium predicts 12-month mortality. Arch Intern Med 2002; 162(4): 457-63.
  14. Pauley E, Lishmanov A, Schumann S, Gala GJ, van DS, Katz JN. Delirium is a robust predictor of morbidity and mortality among critically ill patients treated in the cardiac intensive care unit. Am Heart J 2015; 170(1): 79-86, 86.
  15. Neufeld KJ, Leoutsakos JM, Oh E, Sieber FE, Chandra A, Ghosh A, et al. Long-Term Outcomes of Older Adults with and Without Delirium Immediately After Recovery from General Anesthesia for Surgery. Am J Geriatr Psychiatry 2015; 23(10): 1067-74.
  16. Klein Klouwenberg PM, Zaal IJ, Spitoni C, Ong DS, van der Kooi AW, Bonten MJ, et al. The attributable mortality of delirium in critically ill patients: prospective cohort study. BMJ 2014; 349: g6652.
  17. Neto AS, Nassar AP, Jr., Cardoso SO, Manetta JA, Pereira VG, Esposito DC, et al. Delirium screening in critically ill patients: a systematic review and meta-analysis. Crit Care Med 2012; 40(6): 1946-51.
  18. Devlin JW, Brummel NE, Al-Qadheeb NS. Optimising the recognition of delirium in the intensive care unit. Best Pract Res Clin Anaesthesiol 2012; 26(3): 385-93.
  19. Naughton BJ, Saltzman S, Ramadan F, Chadha N, Priore R, Mylotte JM. A multifactorial intervention to reduce prevalence of delirium and shorten hospital length of stay. J Am Geriatr Soc 2005; 53(1): 18-23.
  20. Lemiengre J, Nelis T, Joosten E, Braes T, Foreman M, Gastmans C, et al. Detection of delirium by bedside nurses using the confusion assessment method. J Am Geriatr Soc 2006; 54(4): 685-9.
  21. Inouye SK, Foreman MD, Mion LC, Katz KH, Cooney LM, Jr. Nurses' recognition of delirium and its symptoms: comparison of nurse and researcher ratings. Arch Intern Med 2001; 161(20): 2467-73.
  22. Law TJ, Leistikow NA, Hoofring L, Krumm SK, Neufeld KJ, Needham DM. A survey of nurses' perceptions of the intensive care delirium screening checklist. Dynamics 2012; 23(4): 18-24.
  23. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington, DC: APA; 2000.
  24. Olson T. Delirium in the intensive care unit: role of the critical care nurse in early detection and treatment. Dynamics 2012; 23(4): 32-6.
  25. Devlin JW, Fong JJ, Howard EP, Skrobik Y, McCoy N, Yasuda C, et al. Assessment of delirium in the intensive care unit: nursing practices and perceptions. Am J Crit Care 2008; 17(6): 555-65.
  26. Devlin JW, Bhat S, Roberts RJ, Skrobik Y. Current perceptions and practices surrounding the recognition and treatment of delirium in the intensive care unit: a survey of 250 critical care pharmacists from eight states. Ann Pharmacother 2011; 45(10): 1217-29.
  27. Pun BT, Gordon SM, Peterson JF, Shintani AK, Jackson JC, Foss J, et al. Large-scale implementation of sedation and delirium monitoring in the intensive care unit: a report from two medical centers. Crit Care Med 2005; 33(6): 1199-205.
  28. Riekerk B, Pen EJ, Hofhuis JG, Rommes JH, Schultz MJ, Spronk PE. Limitations and practicalities of CAM-ICU implementation, a delirium scoring system, in a Dutch intensive care unit. Intensive Crit Care Nurs 2009; 25(5): 242-9.
  29. Gusmao-Flores D, Salluh JI, Chalhub RA, Quarantini LC. The confusion assessment method for the intensive care unit (CAM-ICU) and intensive care delirium screening checklist (ICDSC) for the diagnosis of delirium: a systematic review and meta-analysis of clinical studies. Crit Care 2012; 16(4): R115.
  30. Orman ES, Perkins A, Ghabril M, Khan BA, Chalasani N, Boustani MA. The confusion assessment method for the intensive care unit in patients with cirrhosis. Metab Brain Dis 2015; 30(4): 1063-71.
  31. Gesin G, Russell BB, Lin AP, Norton HJ, Evans SL, Devlin JW. Impact of a delirium screening tool and multifaceted education on nurses' knowledge of delirium and ability to evaluate it correctly. Am J Crit Care 2012; 21(1): e1-11.
  32. Ouimet S, Riker R, Bergeron N, Cossette M, Kavanagh B, Skrobik Y. Subsyndromal delirium in the ICU: evidence for a disease spectrum. Intensive Care Med 2007; 33(6): 1007-13.
  33. Hakim SM, Othman AI, Naoum DO. Early treatment with risperidone for subsyndromal delirium after on-pump cardiac surgery in the elderly: a randomized trial. Anesthesiology 2012; 116(5): 987-97.
  34. Bergeron N, Dubois MJ, Dumont M, Dial S, Skrobik Y. Intensive Care Delirium Screening Checklist: evaluation of a new screening tool. Intensive Care Med 2001; 27(5): 859-64.
  35. Gusmao-Flores D, Salluh JI, Dal-Pizzol F, Ritter C, Tomasi CD, Lima MA, et al. The validity and reliability of the Portuguese versions of three tools used to diagnose delirium in critically ill patients. Clinics (Sao Paulo) 2011; 66(11): 1917-22.
  36. Radtke FM, Franck M, Oppermann S, Lutz A, Seeling M, Heymann A, et al. The Intensive Care Delirium Screening Checklist (ICDSC)--translation and validation of intensive care delirium checklist in accordance with guidelines. Anasthesiol Intensivmed Notfallmed Schmerzther 2009; 44(2): 80-6. [In German].
  37. World Health Organization. Process of translation and adaptation of instruments. [Online]. [cited 2012 Mar 11]; Available from: URL:
  38. http://www.who.int/substance_abuse/research_tools/translation/en/
  39. Jones EG, Mallinson RK, Phillips L, Kang Y. Challenges in language, culture, and modality: translating English measures into American sign language. Nurs Res 2006; 55(2): 75-81.
  40. Yaghmaei F. Measuring behavior in research by valid and reliable instrument. 2nd ed. Tehran, Iran: Shahid Beheshti University of Medical Sciences; 2009. [In Persian].
  41. Ganji H, Sabet M. Psychometry: Theoretical fundations of psychological tests. Tehran, Iran: Savalan Publications: 2011. [In Persian].
  42. Hyrkas K, Appelqvist-Schmidlechner K, Oksa L. Validating an instrument for clinical supervision using an expert panel. Int J Nurs Stud 2003; 40(6): 619-25.
  43. George C, Nair JS, Ebenezer JA, Gangadharan A, Christudas A, Gnanaseelan LK, et al. Validation of the Intensive Care Delirium Screening Checklist in nonintubated intensive care unit patients in a resource-poor medical intensive care setting in South India. J Crit Care 2011; 26(2): 138-43.
  44. van Eijk MM, van Marum RJ, Klijn IA, de WN, Kesecioglu J, Slooter AJ. Comparison of delirium assessment tools in a mixed intensive care unit. Crit Care Med 2009; 37(6): 1881-5.
  45. Tomasi CD, Grandi C, Salluh J, Soares M, Giombelli VR, Cascaes S, et al. Comparison of CAM-ICU and ICDSC for the detection of delirium in critically ill patients focusing on relevant clinical outcomes. J Crit Care 2012; 27(2: 212-7.