Introduction
Delirium, characterized by an acute change in the level of consciousness, inattention, and disturbed cognitive function, is an important and common medical condition, particularly in hospitalized patients. Delirium is associated with adverse outcomes such as increased mortality, accidental falls, cognitive decline, functional dependence, and healthcare costs. The identification, prevention, and treatment of delirium are increasingly regarded as major public health priorities (Chaput & Bryson, 2012; Greer et al., 2011; Inouye, Westendorp, & Saczynski, 2014; O'Regan, Fitzgerald, Timmons, O'Connell, & Meagher, 2013).
In our hospital, we began addressing issues related to delirium beginning in 2011. These actions were as follows: early assessment of the risk of delirium after admission and repeated assessments thereafter, acquiring information on drugs with a risk for delirium (benzodiazepine, etc.), physical therapy (cognitive stimulation, promotion of good sleep, early mobilization, etc.), nutritional support (including avoidance of dehydration), family education, and early introduction of therapy using medications (quetiapine, risperidone, haloperidol, etc.; Inouye et al., 1999; Martinez, Tobar, & Hill, 2015; National Institute for Health and Care Excellence, 2010; Siddiqi et al., 2016; Zhang et al., 2013). Delirium was screened and diagnosed using the Delirium Screening Tool (DST) and the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). We have recently reported risk factors for delirium in patients hospitalized for more than 5 days in surgical wards (Kubota et al., 2018).
We then wanted to assess the incidence of delirium in our hospital before the implementation of the abovementioned actions (i.e., before 2011). However, DST and CAM-ICU were unavailable because we did not screen for delirium using these tools before 2011.
Therefore, the aim of this study was to devise a convenient screening tool for delirium in patients hospitalized for more than 5 days in surgical wards, using clinical observations that are typically recorded by nurses subjectively in clinical records. This new screening tool would allow us to obtain information on whether or not a patient had delirium by checking past records retrospectively.
Methods
This study was approved by the local ethical committee of St. Luke's International Hospital (#16-09). Written informed consent had been provided by all of the patients at admission for use of their data for publication.
The study was conducted using data collected retrospectively from hospital medical records on 2,168 patients who had been admitted to the surgical ward of St. Luke's International Hospital for 5 days or more between January 2011 and December 2014 (Kubota et al., 2018). The most frequent surgeries in our hospital are appendectomy, cholecystectomy, and herniorrhaphy. Their clinical paths for hospitalization range between 3 and 4 days. We rarely encounter delirium in short-term hospitalization patients. In one study of postoperative delirium, entry criteria included the expectation of a hospital stay of more than 48 hours after surgery (DeCrane et al., 2011). General hospitals in Japan typically hospitalize patients for 1-2 days before surgery (Kubota et al., 2018). Therefore, we considered 5 days or more as a sufficiently long period of hospitalization for the purposes of this study.
Clinical variables obtained from the medical records included age, gender, underlying disease, results of DST and CAM-ICU, observational factors recorded by nurses, length of hospital stay, and mortality. Factors observed and recorded by nurses subjectively included hypomotivation, somnolence, hallucinations, visual hallucinations, auditory hallucinations, disorientation, disturbance, insomnia, depression, and restlessness. A list of over 50 signs and symptoms were observed and recorded by nurses in an electronic medical chart. The nurses routinely observed the patients and recorded "yes or no" for each sign or symptom in the usual clinical settings. In this study, we selected 10 psychological problems among the list of items and analyzed the data electronically.
In this study, the definition of delirium onset was made when the score for either the DST or CAM-ICU was positive for delirium. Univariate analysis was performed to investigate the relationship between each factor observed and recorded by nurses subjectively and delirium as determined by either the DST or CAM-ICU. To select the final predictive factors and develop a scoring formula, a multivariate analysis was performed using all of the candidate observed factors in the univariate analysis. Scores for each corresponding factor were obtained based on the beta value from the final prediction model.
On the basis of these results, a screening tool for delirium (Subjective Delirium Screening Scale by Nurse: SDS-N) was constructed. We calculated the total SDS-N score for each patient and the sensitivities and specificities for each cutoff value of the SDS-N score. A receiver operating characteristic curve was then drawn, and the area under the curve (AUC) was obtained.
For internal validation, a bootstrapping technique with 1,000 iterations was used to simulate unbiased expected future performance. The internal validity of a predictive logistic regression model may best be estimated using bootstrapping analysis, which provides stable estimates with low bias (Ohde et al., 2010; Steyerberg et al., 2001). All analyses were performed using SPSS Version 22.0 (IBM, Inc., Armonk, NY, USA).
Results
Table 1 shows the background characteristics of the patients included in this study. Delirium was identified in 205 of the 2,168 patients (9.5%).
Table 2 shows the results of the univariate analysis of the relationship between delirium and factors observed subjectively and recorded by nurses. According to the results of the univariate analysis, logistic regression analysis was constructed, with all of the identified factors determined to be candidate predictors by the univariate analysis (Table 3). Disorientation, restlessness, somnolence, and hallucination were identified as statistically independent factors of delirium in the multivariate analysis. Disorientation was identified as the factor with the greatest effect, with an odds ratio of 9.632.
On the basis of these results, a simple and practical screening tool for delirium (SDS-N) with a total score of 5 points was constructed as follows: 2 points for disorientation and 1 point each for restlessness, somnolence, and hallucination, as shown below:
We calculated the total SDS-N score for each patient and drew a receiver operating characteristic curve. Table 4 shows the sensitivities and specificities for each cutoff value of the SDS-N score when the cutoff values were changed from 1 to 5. The AUC of this novel screening tool was 81.9% (95% CI [77.9%, 85.8%]; Figure 1). On the basis of these results, the most appropriate cutoff value was determined as 2 (sensitivity: 61.0%; specificity: 96.7%).
We then conducted bootstrap cross-validation with 1,000 iterations for the SDS-N. Table 5 shows the originally observed beta coefficient and the bootstrapped validation beta coefficient. Scores assigned to each predictive factor were identical in both the original and bootstrapped results, which supports that this model is relatively robust.
Discussion
We conducted this study to construct a chart-based DST to be administered to patients hospitalized for more than 5 days in surgical wards using clinical observations that are typically recorded by nurses subjectively. In the study group, delirium was screened and diagnosed using the CAM-ICU and DST. We then searched for key factors associated with delirium to create a chart-based tool: SDS-N. The SDS-N included four predictive factors for delirium screening: disorientation, restlessness, somnolence, and hallucination. The AUC showed good accuracy (AUC = 0.819, 95% CI [0.779, 0.858]). Delirium was diagnosed with a sensitivity of 61.0% and a specificity of 96.7% in comparisons with the DST and CAM-ICU. However, caution is still advised in applying the AUC, as subjective observational diagnoses often miss or fail to recognize the onset of delirium (Inouye, Foreman, Mion, Katz, & Cooney, 2001).
Some reviews have reported currently available assessment tools for delirium (Grover & Kate, 2012; van Meenen, van Meenen, de Rooij, & ter Riet, 2014). Our colleagues, Kobayashi et al., introduced the Chi-Square Automatic Interaction Detector Decision Tree Analysis Model, which is an easy-to-implement model for detecting the development of delirium in patients in medical wards (Kobayashi, Takahashi, Arioka, Koga, & Fukui, 2013). In addition, the NEECHAM Confusion Scale (Neelon, Champagne, Carlson, & Funk, 1996) and the Nursing Delirium Screening Scale (Gaudreau, Gagnon, Harel, Tremblay, & Roy, 2005) are based on nursing assessments similar to the SDS-N, with 80%-90% sensitivity and specificity. As these scales include specifically determined items and the recording of each item uses a scale, they are not suitable for use in research such as that conducted in this study. The Chart-based Delirium Identification Instrument was developed to identify delirium retrospectively from information that is typically included on medical charts (Inouye et al., 2005). However, this scale is overly complicated and difficult to apply in daily clinical settings, and although potentially helpful for determining delirium in individual patients, it may not be suited for screening large numbers of patients. The SDS-N developed in this study has an advantage over existing screening tools in that it is simple and practical because it includes only factors that are regularly observed subjectively and recorded by nurses. Furthermore, the SDS-N has shown adequate diagnostic accuracy.
Various interventions, including Multicomponent Interventions and Hospital Elder Life Program, have been proposed as strategies to prevent delirium in hospitalized patients (Inouye et al., 1999; Martinez et al., 2015). Several practice guidelines, for example, the National Institute for Health and Care Excellence guidelines, have encouraged the establishment of multicomponent interventions programs to prevent the incidence of delirium (National Institutes for Health and Care Excellence, 2010), which have subsequently been shown to be effective in reducing the incidence, duration, and severity of delirium and in decreasing healthcare costs.
A major limitation of this study is our exclusive focus on cognitive disturbances such as disorientation, restlessness, somnolence, and hallucination and exclusion of important symptoms such as acute onset and fluctuation in the new SDS-N tool. We are now conducting a prospective cohort study of delirium focused on dementia and cerebrovascular disease. In addition, diagnostic accuracy in this study was evaluated in comparison with the DST and CAM-ICU, which are also screening tools. Our newly developed tool should be evaluated in comparison with a standard diagnostic tool such as the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Another limitation of this study was its retrospective design. Replication of the results is needed using a study with a prospective design and external validation.
In conclusion, the SDS-N, a novel screening tool for delirium in patients hospitalized for more than 5 days in surgical wards, was created in this study using factors that are typically recorded by nurses subjectively in clinical settings. The developed tool is simple and practical and has adequate diagnostic accuracy.
Acknowledgments
We thank the colleagues of the Gastroenterological Surgery Department, including Takuto Yoshida, Aoi Fujikawa, Takayuki Watanabe, Takashi Taketa, Taketo Matsubara, Hiroki Sunagawa, Seiji Ohigashi, and Shintaro Sakurai, for their daily clinical practice and data collection efforts. We further thank Chika Horikawa and Aya Ohizumi of the Center for Information Systems for their special assistance in collecting data.
Author Contributions
Study conception and design: KK, AS
Data collection: IF, AK
Data analysis and interpretation: SO
Drafting of the article: KK
Critical revision of the article: UY
References