C International Psychogeriatric Association 2014 International Psychogeriatrics (2014), 26:8, 1377–1385 doi:10.1017/S1041610214000830
The benefits of implementing a computerized Intervention-Management-System (IMS) on delivering integrated dementia care in the primary care setting ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Tilly Eichler,1 Jochen René Thyrian,1 Daniel Fredrich,2 Leonore Köhler,1 Diana Wucherer,1 Bernhard Michalowsky,1 Adina Dreier2 and Wolfgang Hoffmann1,2 1 2
German Center for Neurodegenerative Diseases (DZNE), Rostock/Greifswald, Ellernholzstrasse 1-2, Greifswald D-17489, Germany Institute for Community Medicine, Section Epidemiology of Health Care and Community Health, University Medicine Greifswald, Ellernholzstrasse 1-2, Greifswald D-17487, Germany
ABSTRACT
Background: A computerized Intervention-Management-System (IMS) has been developed and implemented to facilitate dementia care management. IMS is a rule-based expert decision support system that matches individual patient characteristics to a computerized knowledge base. One of the most important functionalities of IMS is to support the compilation of the individual intervention plan by systematically identifying unmet needs and suggesting the corresponding specific interventions for recommendation to the general practitioner (GP). The present analysis aimed to determine if the implementation of IMS improves the identification of unmet needs and the recommendation of adequate specific interventions. In addition, the feasibility and acceptability of the IMS were evaluated. Methods: Delphi-MV is an on-going GP-based, cluster-randomized, controlled intervention trial to implement and evaluate a collaborative dementia care management program for community-dwelling PWDs and their caregivers. IMS was developed and implemented over the course of the DelpHi-trial. The identified unmet needs and the interventions that were recommended to the GP before and after the implementation of IMS were compared. To evaluate the feasibility and acceptability of the IMS, a survey was conducted among the current users of IMS. Results and Conclusions: After the implementation of IMS, the number of specific interventions recommended to the GP increased by 85%. Our findings provide evidence that IMS improves the systematic identification of unmet needs and the subsequent recommendation of interventions to address these needs. The users evaluated IMS as very helpful and would like to use it for their future work. However, the usability could be further improved. Key words: Intervention-Management-System (IMS), dementia care management, complex intervention, identification of unmet needs, individualized intervention plan, decision support system (DSS)
Background The increasing incidence and prevalence of dementia is a challenge for healthcare systems worldwide. There have been efforts to establish guidelines for evidence-based diagnosis and treatment of dementia (e.g. DEGAM, 2008; DGPPN and DGN, 2009; NICE, 2012). A common theme among these guidelines is the complexity of the disease that affects a variety of physical, medical, Correspondence should be addressed to: Dr. Tilly Eichler, German Center for Neurodegenerative Diseases (DZNE), Rostock/Greifswald, Ellernholzstrasse 1-2, Greifswald D-17489, Germany. Phone: +49(0)3834 86 7591; Fax: +49(0)3834 86 19551. Email: [email protected]. Received 7 Feb 2014; revision requested 28 Feb 2014; revised version received 3 Apr 2014; accepted 8 Apr 2014. First published online 9 May 2014.
psychological, social, and legal issues. In caring for people with dementia (PWD), these issues are ideally addressed comprehensively with multiprofessional and multimodal interventions. These interventions need to be tailored to the individual needs and resources of the individual PWD, his or her caregiver and the local and regional framework of the healthcare system. Although these guidelines offer practicing physicians an orientation for caring for PWDs, the diagnosis and treatment of dementia are complex tasks. Studies show that physicians sometimes feel challenged to adapt these guidelines to specific local and individual situations (Riepe and Fellgiebel, 2012; Vollmar et al., 2010). Case management has been suggested as a method to optimize treatment and care for
1378
T. Eichler et al.
community-dwelling PWDs, and intensive collaborative care management programs that ensure a high level of integration between health and social service organizations have been proofed to be clinically effective in the United States (Somme et al., 2012). With DelpHi-MV (Dementia: lifeand person-centered help in Mecklenburg-Western Pomerania), we developed and implemented a collaborative dementia care management program to provide “optimum care” to community-dwelling PWDs and their caregivers in Germany (for a detailed description of the dementia care management in DelpHi-MV, see (Eichler et al., 2014)). The comprehensive, individualized intervention is initiated and coordinated by a dementia care manager (DCM) and delivered in close cooperation with the treating general practitioner (GP). The intervention is based on a systematic and standardized baseline assessment that covers up to 3,500 different variables with the aim of identifying the individual needs and resources of the PWDs and his or her caregiver. These needs are then addressed in a tailored intervention/treatment plan. Considering the vast amount of data needed to assess for the provision of optimum care, there is a considerable risk that unmet needs remain overlooked and therefore unaddressed. Clinical decision support systems (DSS) have been suggested to assist GPs in the diagnosis and management of dementia (Lindgren et al., 2002; Downs et al., 2006; Lindgren and Eriksson, 2010). In Delphi-MV, a computerized InterventionManagement-System (IMS) was developed and implemented to facilitate the planning as well as the conduction and documentation of the DelphiIntervention. IMS is a rule-based expert DSS that matches individual patient characteristics to a computerized knowledge base. One of the most important functionalities of IMS is to support the compilation of the individual intervention plan by systematically identifying unmet needs and suggesting the corresponding specific interventions for recommendation to the GP. The objective of the present analyses was to examine whether the implementation of the IMS improved the identification of unmet needs as well as the recommendation of adequate specific interventions to the treating GP. In addition, the feasibility and acceptability of the system to the users (i.e. the DCMs) were evaluated.
Methods Study design Present analyses are based on data derived from the on-going GP-based randomized, controlled
intervention trial DelpHi-MV (Dementia: lifeand person-centered help in Mecklenburg-Western Pomerania). The details of the study are described in the study protocol (Thyrian et al., 2012). The eligible patients (older than 70 years, living at home) are screened for dementia in participating GP practices using DemTect (Calabrese and Kessler, 2000). DemTect is a widely used dementia screening tests in GP practices in Germany (Thyrian and Hoffmann, 2012). Patients who meet the inclusion criteria (DemTect < 9) are informed by their GP about the study, are invited to participate, and are asked to provide written informed consent. If the patient names a caregiver, he or she is asked to participate in the study. When the patient is unable to provide written informed consent, his or her legal representative is asked to sign the consent form on the patients behalf (as approved by the Ethical Committee of the Chamber of Physicians of Mecklenburg-Western Pomerania, registry number BB 20/11). Participants and their caregivers are assigned to an intervention or a control group, depending on whether the treating GP practice was randomized into either the control or intervention group. The enrollment into the main study started on January 1, 2012. Baseline and annual follow-up assessments are conducted identically in both groups. Whereas the control group receives “care as usual,” the intervention group receives the “DelpHiIntervention.” The intervention is initiated and coordinated by a DCM – a nurse with dementiaspecific qualifications (Dreier et al., 2011; Dreier and Hoffmann, 2013). Study participants are contacted by their designated DCM to arrange two to four personal visits at their homes to carry out the comprehensive standardized baseline assessment regarding each patient’s specific social, medical, psychological, pharmaceutical, and nursing care situation. The DCM conducts further in-depth assessments at the first visit after baseline (e.g. mobility tests, pain assessment, and neuropsychiatric assessment). Based on the information collected, the unmet needs of the PWD are identified and an adequate individualized intervention plan according to the “DelpHiStandard” is established and forwarded to the treating GP by a semi-standardized GP-information letter. The letter includes the recommendations for specific interventions. The GP decides whether he rates a recommended intervention as “necessary” and, if so, whether he conducts the respective intervention himself or delegates it to the DCM. The GP-information letter is the main instrument for communication and coordination between the DCM and GP and ensures that the GP assumes a key role in the DelpHi-Intervention.
Benefits of IMS
The “DelpHi-Standard” of optimum care is composed of a comprehensive set of 95 intervention modules that are assigned to eight different action fields representing the complexity of dementia care (e.g. medical diagnosis and treatment; nursing care; pharmaceutical treatment and care). Each intervention module consists of: (a) predefined trigger condition(s) derived from the comprehensive standardized assessment; (b) a subsequent intervention task; and (c) at least one criterion to define the successful completion of the respective task. Intervention tasks include in-depth assessments, counseling of the PWD or the caregiver on specific dementia-related topics, emergency measures, structured provision of information to the treating GP about specific health problems and recommending specific interventions to the treating GP (for a detailed description of the “Delphi-Standard,” see (Eichler et al., 2014)). Intervention-Management-System IMS is a rule-based expert DSS, which is composed of the programmed algorithms of the 95 predefined intervention modules of the “DelpHi-Standard.” For data collection, tablet-PCs that comply with the legal requirements for technical products in medical settings (Bundesministerium der Justiz, 1994) are used. All data are entered directly into the DelpHiinformation system and are immediately processed (Meyer et al., 2012). Whenever a predefined trigger condition is activated, the corresponding intervention task is automatically selected by the IMS. A total of 43 specific interventions can be recommended in the GP-information letter. Of these, 28 are automatically selected by IMS whenever the respective trigger conditions are met (see Table 1). Trigger conditions were defined broadly to ensure that unmet needs do not remain undetected. Thus, not all triggered and selected interventions must be recommended to the GP (the reason for not recommending an IMS-selected intervention has to be documented). Because life circumstances are too complex and individual to cover them entirely with a fixed set of predefined algorithms, the DCM can also recommend further interventions manually, even if they had not been previously selected by IMS. The present analyses focus solely on these 28 specific interventions that IMS automatically selects for recommendation in the GP-information letter when the trigger conditions are met. There are another 15 specific interventions that can be recommended to the GP, but are not automatically selected by IMS. Instead,
1379
IMS suggests either (a) a special evaluation of complex circumstances to decide whether a specific intervention should be recommended or (b) a case conference to discuss the case before recommending a specific intervention. Because recommending these interventions requires active human interactions that could disturb the evaluation of the impact of implementing IMS, they were excluded from the analysis. Figure 1 illustrates the outline of IMS. IMS was developed and tested over the course of the DelpHi-trial and implemented into the study routine 12 months after the first enrollment of study participants into the main study (January 2012). Before the implementation of IMS, a written version of the “DelpHi-Standard” was used by the DCM to identify unmet needs and to establish the intervention plan. A total of 96 patients were included in this period (the “pre-IMS-group”). After the implementation of IMS, the system was tested with 33 patients (the “IMS-group”). For each of these 33 PWDs, the IMS generated a list of recommended interventions. The DCM decided, if the respective intervention should be recommended to the GP in the GP-information letter. If not, the reason for not recommending was documented. In addition, the DCM can recommend interventions that have not been automatically selected by IMS. To determine the benefits of implementing IMS, the system was also retroactively applied to the 96 PWDs of the “pre-IMS-group.” Because the data to run and trigger IMS were available in this group, we determined which specific interventions IMS would have selected for these respective patients. After comparing the actual recommendations given in the GP-information letters for each PWD in the “preIMS-group” with the recommendations triggered retrospectively by IMS, the DCMs were asked to document the reason for each difference based on their individual case documentation. The feasibility and acceptability of IMS to the users (n = 6 DCMs) were assessed by a self-designed questionnaire, which contained the following three questions: How helpful is IMS for your work? How user-friendly is IMS? Would you like to apply the system in your further work? The DCMs were asked to answer these questions on a scale ranging from 1 (lowest possible satisfaction) to 10 (highest possible satisfaction).
Sample The present analyses are based on a total sample of 129 patients of the intervention group (n = 96 PWDs in the “pre-IMS-group” and n = 33 PWDs in the “IMS-group”).
1380
T. Eichler et al.
Table 1. Specific interventions that are automatically recommended by IMS for the GP-information letter whenever the respective trigger conditions are met (grouped by action fields) A C T I O N FI E L D
S P E C I FI C I N T E R V E N T I O N
............................................................................................................................................................................................................................................................................................................................
Nursing care
Social counseling and legal support
Medical diagnosis and treatment
Pharmaceutical treatment and care
Social integration Special therapies
Application for care level (nursing care insurance) Appeal against refusal of care level (nursing care insurance) Pain: diagnosis/treatment Incontinence: diagnosis/treatment Nutritional disorder: monitoring/treatment Mobility limitation/risk of fall: monitoring/treatment Visual problems: diagnosis/treatment Hearing impairment: diagnosis/treatment Establish power of attorney for health care Establish appointment of legal representative for health care Establish legal representative (general) Establish patient decree (living will) Application for an identity card for the disabled In-depth information about dementia Clarification of the diagnosis of dementia Referral to a psychiatrist (suspicion of major depression) Referral to a neurologist (suspicion of disturbance of extrapyramidal motor system/gait) Indication check: anti-dementia drugs Indication check: guideline-based treatment Indication check : substance XX Dosage check: substance XX Medication check by pharmacist Issue of up-to-date medication plan Support of preparing/administering medication Occupational therapy Partial ambulant rehabilitation Ambulant geriatric rehabilitation Inpatient geriatric rehabilitation
Data analyses For the sample description, we analyzed age, sex, living situation (alone/not alone), and cognitive status (assessed using the German version of the Mini Mental Status Examination (Kessler et al., 1990)). To test for significant group differences, we used Fisher’s exact test for categorical variables and the two sample t-test for continuous variables. Statistical analyses were performed with STATA version 11.0 (StataCorp, 2009). The frequency of IMS-selected and subsequently DCM-recommended interventions, reasons for not recommending IMS-selected interventions as well as additionally DCM-recommended interventions are described for both groups (number of recommended interventions: total/per PWD). We report the total number of recommended interventions in the GP-information letters and the number of recommended interventions grouped by the action fields (“nursing care,” “social counseling and legal support,” “medical diagnosis and treatment,” “pharmaceutical treatment and care,” “social integration,” and “special therapies”).
Regarding the feasibility and acceptability of the IMS to the users, we report mean sum scores and ranges.
Results Characteristics of the study sample Table 2 presents the sociodemographic and clinical characteristics of the study sample. With the exception of sex, there are no significant differences between the “pre-IMS-group” and the “IMSgroup.” Identification of unmet needs The retroactive application of IMS to determine, which specific interventions IMS would have selected for the PWDs of the “pre-IMS-group,” yielded the following results: in total IMS selected n = 552 specific interventions (n = 5.75 per PWD; R = 1–12). Of these, the DCMs had actually recommended 28% to the GP (n = 157 interventions; n = 1.64 per PWD; R = 1–5).
Benefits of IMS
1381
Table 2. Sociodemographic and clinical characteristics of the study sample TOTAL SAMPLE (N = 129)
PRE-IMSGROUP
IMS-GROUP
(n = 96)
(n = 33)
TEST OF S I G N I FI C A N T D I FF E R E N C E S
............................................................................................................................................................................................................................................................................................................................
Sex (female) Age Living alone Severity of dementia (MMSE) Total score No cognitive impairment (score, 27–30) Mild cognitive impairment (score, 20–26) Moderate cognitive impairment (score, 10–19) Severe cognitive impairment (score, 0–9)
90 (70%) 80.18 (5.53) 62 (48%) n = 128 22.17 (5.11) 29 (23%) 63 (49%) 35 (27%) 1 (1%)
72 (75%) 80.02 (5.56) 46 (48%) n = 96 22.55 (4.87) 23 (24%) 48 (50%) 24 (25%) 1 (1%)
18 (55%) 80.63 (5.49) 16 (48%) n = 32∗ 21.06 (5.70) 6 (19%) 15 (47%) 11 (34%) –
p < 0.05a p > 0.50b p > 0.50b p > 0.15b
Standard deviations or percentages are in brackets. MMSE = Mini Mental State Examination; range: 0–30; higher score indicates better cognitive functioning. ∗ n = 1 observation missing; a Fisher’s exact test; b two sample t-test.
Figure 1. (Colour online) Outline of IMS (present analyses are focused on thick-rimmed areas).
Across the individual action fields, the concordance between IMS-selected and actually DCM-recommended interventions varied widely between 11% (“pharmaceutical treatment and care”) and 83% (“special therapies”). The results are illustrated in Figure 2. In the “pre-IMS-group,” as many as 72% of the IMS-selected interventions were actually not
recommended to the GP (n = 395 interventions; n = 4.13 per PWD). The DCMs were asked to provide reasons why they did not recommend these interventions (retrospective statements). The majority of the interventions (n = 311 (78.8%)) were not recommended, because the respective unmet need had not been identified by the DCMs. Another 19.7% of these interventions (n = 78) were
1382
T. Eichler et al.
Figure 2. (Colour online) Number of specific interventions (per PWD) that were suggested by IMS and the percentage of subsequently recommended interventions in the GP-information letter before (“pre-IMS-group”; n = 96) and after (“IMS-group”; n = 33) the implementation of IMS into the study routine (total/grouped by action fields).
already addressed, thus the intervention was not deemed necessary by the DCM (e.g. IMS triggered the recommendation for diagnosis/treatment of visual problems, but the DCM knows that the PWD has an appointment with an ophthalmologist already). Furthermore, 1.5% of the interventions (n = 6) were not agreed to by the PWD or their caregivers. After the implementation of IMS into the study routine, IMS selected a total of n = 184 interventions (n = 5.58 per PWD; R = 1–11) for the n = 33 PWD of the “IMS-group.” Of these, the DCMs subsequently recommended 74% to the GP (n = 136; n = 4.12 per PWD; R = 1–11). Regarding the individual action fields, the variation of concordance between IMS-selected and actually recommended interventions was considerably lower than in the “pre-IMS-group” and ranged between 65% (“nursing care”) and 86% (“social counseling and legal support”). The results are illustrated in Figure 2. In the “IMS-group,” only 26% of IMS-selected interventions were not recommended by the DCMs (n = 48; n = 1.45 per PWD). Of these, 90% (n = 43 interventions) were not recommended because
these needs were addressed already. The remaining 10% (n = 5 interventions) were not wanted by either the PWD or his or her caregiver.
Recommendations of specific interventions to the treating GP For n = 96 PWD of the “pre-IMS-group,” the DCMs recommended a total of n = 258 specific interventions (n = 2.69 per PWD; R = 1–8) to the GP. The results are shown in Table 3. We found that 61% of these recommended interventions (n = 157) were retroactively selected by IMS as well. Across individual action fields, these figures varied considerably between 19% and 100%. The DCMs recommended additional n = 101 specific interventions (n = 1.05 per PWD) that were not selected by IMS (39% of the finally recommended interventions). After the implementation of IMS into the study routine, the DCMs recommended n = 164 specific interventions for n = 33 PWD of the “IMS-group” to the GP (n = 4.97 interventions per PWD; R = 1–13) (see Table 3).
11 (20%) 8 (16%) 1 (5%) 6 (20%) 1 (20%) 1 (33%) 44 (80%) 42 (84%) 20 (95%) 24 (80%) 4 (80%) 2 (67%) 67 (0.70) 84 (0.89) 27 (0.28) 47 (0.49) 14 (0.14) 19 (0.20)
50 (75%) 55 (65%) 27 (100%) 9 (19%) 11 (79%) 5 (26%)
17 (25%) 29 (35%) 38 (81%) 3 (21%) 14 (73%)
55 (1.67) 50 (1.52) 21 (0.64) 30 (0.91) 5 (0.15) 3 (0.09)
28 (17%) 136 (83%) 164 (4.97) 101 (39%) 157 (61%) 258 (2.69)
Specific interventions (total) Grouped by action fields Nursing care Social counseling and legal support Medical diagnosis and treatment Pharmaceutical treatment and care Social integration Special therapies
n (%) n (%) n (%) n (%)
............................................................................................................................................................................................................................................................................................................................................................................................................................................................
DCM ALONE: INTERVENTIONS ADDITIONAL RECOMMENDED BY DCM TO GP:
INTERVENTIONS RECOMMENDED TO THE GP: TOTAL (MEAN N PER PWD)
DCM ALONE: INTERVENTIONS ADDITIONAL RECOMMENDED BY DCM TO GP: IMS & DCM: INTERVENTIONS SELECTED BY IMS AND RECOMMENDED BY DCM TO GP:
INTERVENTIONS RECOMMENDED TO THE GP: TOTAL (MEAN N PER PWD)
IMS & DCM: INTERVENTIONS SELECTED BY IMS AND RECOMMENDED BY DCM TO GP:
(n = 33) IMS-GROUP
(n = 96) PRE-IMS-GROUP
Table 3. Specific interventions recommended to the GP before (pre-IMS-group) and after (IMS-group) the implementation of IMS into the study routine: total number of recommended interventions; interventions selected by IMS and subsequently recommended by DCM (IMS & DCM); and additional recommended interventions by DCM (DCM alone)
Benefits of IMS
1383
Of these recommended interventions, 83% were previously selected by IMS. Variance across action fields (67%–95%) was considerably lower than in the “pre-IMS-group.” The proportion of additional recommended interventions that were previously not selected by IMS was clearly lower than in the “pre-IMSgroup” (17% vs. 39% of finally recommended interventions). Feasibility and acceptability of IMS On a scale from 1 to 10, the six current users of IMS evaluated the system as followed: They regarded IMS as helpful for their work with an average score of 9.5 (R = 8–10). The user-friendliness was judged with an average score of 6.8 (R = 5–8). In terms of willingness to implement IMS in their future work, the average score was 9.0 (R = 7–10).
Discussion Present results demonstrate a substantial benefit of implementing the computerized IMS on the identification of unmet needs in dementia care management. Before the implementation of IMS, 72% of the interventions that the IMS would have automatically suggested for recommendation to the GP according to the “DelpHi-Standard” have actually not been recommended by the DCM – most often because the DCMs did not recognize the respective unmet need without the support of IMS. These results clearly point out the difficulty of detecting unmet needs within the complexity of home caring situations for PWDs. The capacity of human conscious thinking is limited; only 5 ± 2 chunks of information can be processed at the same time (Doerner and Schaub, 1994; Miller, 1994). This fundamental psychological principle supports the need for utilizing the assistance of a computerized system to improve the systematic identification of unmet needs. Furthermore, the implementation of IMS resulted in an improved adherence to the “DelphiStandard” of dementia care and increased the comprehensiveness of the established intervention/treatment plans. The results show that due to the implementation of IMS, the concordance between automatically IMS-selected and actually DCM-recommended interventions increased from 28% to 74%. Consequently, the number of recommendations for specific interventions given to the treating GP increased by 85% (from n = 2.69 to n = 4.97 recommended interventions per PWD). The high concordance between automatically IMSselected and actually recommended interventions indicates that IMS produces adequate suggestions
1384
T. Eichler et al.
for the intervention with a high degree of clinical relevance. However, our findings clearly reflect that IMS can only support, but not serve as a substitute for a qualified person. After the implementation of IMS, the DCMs did not rely solely on the suggestions that are generated automatically by IMS. Instead, they critically reconsidered whether an IMS-selected intervention was actually necessary and acceptable by the PWD and/or the caregiver. On the other hand, they also gave additional recommendations when they thought that an intervention was required, even when IMS had not selected it previously. Regarding the feasibility and acceptability of IMS, the current six users of the system evaluated it as very helpful and they would like to use it for their future work. However, the usability was not so highly rated and could be further improved. Because the number of users is still low, these results cannot be generalized. To summarize, our findings provide evidence that IMS improves the systematic identification of unmet needs and the subsequent recommendation of interventions to adequately address these needs. Therefore, our data suggest that utilizing IMS increases the comprehensiveness of dementia care management. Whether this will actually lead to optimized care and to improved patient outcomes needs to be evaluated over the course of the DelpHitrial. Three reviews of clinical DSS for various diseases and purposes have shown inconsistent results (Garg et al., 2005; Roshanov et al., 2011; Sahota et al., 2011). These reviews report an effect of implementing a clinical DSS on the improvement of the care process in more than half of the studies under consideration (52%, 63%, and 64%). However, they differ considerably in their estimate on the positive results of a clinical DSS regarding patient outcomes (range of 15% to 65% of the studies under consideration). Bryan and Boren (2008) report positive or variable outcomes in 76% of the included studies. Only one of the studies included in these reviews implemented a dementia-specific DSS (Downs et al., 2006). Their DSS operated within patient electronic records and was used to prompt and assist clinical reasoning and care planning. Results showed a significant improvement in detection rates of dementia, but there was no evidence for an impact on the management of dementia. However, for the DelpHi-trial, we expect a positive effect of the dementia care management on patient outcomes because of the setup of the intervention that differs to the one of Downs et al. (2006). IMS has been developed and implemented to facilitate the planning as well as the conduction,
monitoring, and documentation of the dementia care management. The system does not only support the establishment of an individualized intervention plan that is forwarded to the GP. In addition, IMS suggests specific interventions directly to the DCMs, e.g. the counseling and support of the caregiver. Most important is that the DCMs are responsible for the implementation of all IMS-selected and additional self-selected interventions, including all the interventions that the GP delegated back to them (except for the ones that were rated as “not necessary” or “not wanted” by the DCM, the PWD, the caregiver or the GP). The completion of each specific intervention has to be documented by the DCMs in the IMS. In the case that an intervention cannot be completed, the reason has to be documented as well. This way IMS ensures that unmet needs are not only identified, but will be really addressed in the course of the DelpHi-Intervention.
Limitations The size of the “IMS-group” was not sufficient to allow meaningful comparisons regarding the action fields “social integration” and “special therapies.” The reasons for not recommending an IMSselected intervention were given retrospectively by the DCMs and may not be fully reliable. However, because the DCMs kept detailed documentation of each case, the potential for systematically compromised validity is most likely limited.
Conflict of interest None.
Description of authors’ roles TE drafted the manuscript and was a main contributor to the development of IMS. JRT, the study coordinator, contributed substantially to the overall design of the Delphi-trial and the development of the DelpHi-Intervention. DF (computer science), LK (data management), AD (nursing care), DW (pharmacy), and BM (health economy) contributed to the DelpHi-trial and to the manuscript in accordance with their areas of expertise. WH, the principal investigator of the study, contributed substantially to the concept of the DelpHi-trial and to the final version of the manuscript. All authors have read and approved the final manuscript.
Benefits of IMS
Acknowledgments The authors would especially like to thank Kerstin Albuerne for the programming of the IMS-algorithms. The DelpHi-trial and IMS were developed and established as a result of input from the following experts in their respective fields, with support provided by an experienced field study team: Ines Abraham, Aniela Angelow, Grit Aßmann, Vaska Böhmann, Georgia Böwing, Kathleen Dittmer, Thomas Fiß, Sarah Gardzella, Jana Hubert, Ulrike Kempe, Ingo Kilimann, Saskia Moll, Andrea Pooch, Sabine Schmidt, Christiane Schnick, Christine Winckler, and Paula Winter. We thank all of the participating patients and their general practitioners for their collaboration.
References Bryan, C. and Boren, S. A. (2008). The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Informatics in Primary Care, 16, 79–91. Bundesministerium der Justiz (1994). Gesetz über Medizinprodukte (Medizinproduktegesetz - MPG). Available at: http://www.gesetze-im-internet.de/bundesrecht/mpg/ gesamt.pdf; last accessed 15 January 2014. Calabrese, P. and Kessler, J. (2000). Screening for cognitive impairment in dementia - the DemTect procedure. European Neuropsychopharmacology, 10, 369. DEGAM (Deutsche Gesellschaft für Allgemeinmedizin und Familienmedizin e.V.) (2008). DEGAM-Leitlinie Nr 12: Demenz. Düsseldorf: omikron. DGPPN and DGN (Deutsche Gesellschaft für Psychiatrie, Psychotherapie und Nervenheilkunde und Deutsche Gesellschaft für Neurologie) (2009). S-3 Leitlinie “Demenzen.” Available at: http://www.dgppn.de/ fileadmin/user_upload/_medien/download/pdf/ kurzversion-leitlinien/s3-leitlinie-demenz-lf.pdf; last accessed 15 January 2014. Doerner, D. and Schaub, H. (1994). Errors in planning and decision-making and the nature of human information processing. Journal of Applied Psychology, 43, 433–453. Downs, M. et al. (2006). Effectiveness of educational interventions in improving detection and management of dementia in primary care: cluster randomised controlled study. British Medical Journal, 332, 692–696. Dreier, A. and Hoffmann, W. (2013). Dementia care manager for patients with dementia: determination of the requirements and qualifications contents for nurses in the DelpHi-MV study. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz, 56, 1398–409. doi:10.1007/s00103-013-1796-0. Dreier, A., Thyrian, J. R. and Hoffmann, W. (2011). Dementia Care Manager in der ambulanten Demenzversorgung: entwicklung einer innovativen Qualifizierung für Pflegefachkräfte. Pflege & Gesellschaft, 16, 53–64. Eichler, T. et al. (2014). Dementia care management: going new ways in ambulant dementia care within a GP-based randomized controlled intervention trial. International
1385
Psychogeriatrics, 26, 247–256. doi:10.1017/ S1041610213001786. Garg, A. X. et al. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. Journal of the American Medical Association, 293, 1223–1238. Kessler, J., Markowitsch, H. J. and Denzler, P. (1990). Mini-Mental-Status-Test (MMST) [German Version]. Göttingen: Beltz Test GmbH. Lindgren, H. and Eriksson, S. (2010). Sociotechnical integration of decision support in the dementia domain. Studies in Health Technology and Informatics, 157, 79–84. Lindgren, H., Eklund, P. and Eriksson, S. (2002). Clinical decision support system in dementia care. Studies in Health Technology and Informatics, 90, 568–571. Meyer, J., Fredrich, D., Piegsa, J., Habes, M., van den, B. N. and Hoffmann, W. (2012). A mobile and asynchronous electronic data capture system for epidemiologic studies. Computer Methods and Programs in Biomedicine, 107, 369–379. Miller, G. A. (1994). The magical number seven, plus or minus two: some limits on our capacity for processing information, 1956. Psychological Review, 101, 343–352. National Institute for Health and Care Excellence (NICE) (2012). Dementia: Supporting People with Dementia and Their Carers in Health and Social Care. Available at: http: //www.nice.org.uk/nicemedia/live/10998/30318/30318.pdf; last accessed 15 January 2014. Riepe, M. W. and Fellgiebel, A. (2012). Dementia guidelines: what should come to general practice-an interdisciplinary consensus of physicians in private practice. Deutsche medizinische Wochenschrift, 137, 1499–1504. doi:10.1055/s-0032-1305171. Roshanov, P. S. et al. (2011). Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implementation Science, 6, 92. doi:10.11861748-5908-6-92. Sahota, N. et al. (2011). Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implementation Science, 6, 91. doi:10.1186/1748-5908-6-91. Somme, D., Trouve, H., Drame, M., Gagnon, D., Couturier, Y. and Saint-Jean, O. (2012). Analysis of case management programs for patients with dementia: a systematic review. Alzheimer’s & Dementia, 8, 426–436. doi:10.1016/j.jalz.2011.06.004. StataCorp (2009). Stata Statistical Software: Release 11. College Station, TX: StataCorp LP. Thyrian, J. R. and Hoffmann, W. (2012). Dementia care and general physicians-a survey on prevalence, means, attitudes and recommendations. Central European Journal of Public Health, 20, 270–275. Thyrian, J. R. et al. (2012). Life- and person-centred help in Mecklenburg-Western Pomerania, Germany (DelpHi): study protocol for a randomised controlled trial. Trials, 13, 56. doi:10.1186/1745-6215-13-56. Vollmar, H. C. et al. (2010). Knowledge transfer for the management of dementia: a cluster randomised trial of blended learning in general practice. Implementation Science, 5, 1. doi:10.1186/1748-5908-5-1.
The benefits of implementing a computerized Intervention-Management-System (IMS) on delivering integrated dementia care in the primary care setting ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Tilly Eichler,1 Jochen René Thyrian,1 Daniel Fredrich,2 Leonore Köhler,1 Diana Wucherer,1 Bernhard Michalowsky,1 Adina Dreier2 and Wolfgang Hoffmann1,2 1 2
German Center for Neurodegenerative Diseases (DZNE), Rostock/Greifswald, Ellernholzstrasse 1-2, Greifswald D-17489, Germany Institute for Community Medicine, Section Epidemiology of Health Care and Community Health, University Medicine Greifswald, Ellernholzstrasse 1-2, Greifswald D-17487, Germany
ABSTRACT
Background: A computerized Intervention-Management-System (IMS) has been developed and implemented to facilitate dementia care management. IMS is a rule-based expert decision support system that matches individual patient characteristics to a computerized knowledge base. One of the most important functionalities of IMS is to support the compilation of the individual intervention plan by systematically identifying unmet needs and suggesting the corresponding specific interventions for recommendation to the general practitioner (GP). The present analysis aimed to determine if the implementation of IMS improves the identification of unmet needs and the recommendation of adequate specific interventions. In addition, the feasibility and acceptability of the IMS were evaluated. Methods: Delphi-MV is an on-going GP-based, cluster-randomized, controlled intervention trial to implement and evaluate a collaborative dementia care management program for community-dwelling PWDs and their caregivers. IMS was developed and implemented over the course of the DelpHi-trial. The identified unmet needs and the interventions that were recommended to the GP before and after the implementation of IMS were compared. To evaluate the feasibility and acceptability of the IMS, a survey was conducted among the current users of IMS. Results and Conclusions: After the implementation of IMS, the number of specific interventions recommended to the GP increased by 85%. Our findings provide evidence that IMS improves the systematic identification of unmet needs and the subsequent recommendation of interventions to address these needs. The users evaluated IMS as very helpful and would like to use it for their future work. However, the usability could be further improved. Key words: Intervention-Management-System (IMS), dementia care management, complex intervention, identification of unmet needs, individualized intervention plan, decision support system (DSS)
Background The increasing incidence and prevalence of dementia is a challenge for healthcare systems worldwide. There have been efforts to establish guidelines for evidence-based diagnosis and treatment of dementia (e.g. DEGAM, 2008; DGPPN and DGN, 2009; NICE, 2012). A common theme among these guidelines is the complexity of the disease that affects a variety of physical, medical, Correspondence should be addressed to: Dr. Tilly Eichler, German Center for Neurodegenerative Diseases (DZNE), Rostock/Greifswald, Ellernholzstrasse 1-2, Greifswald D-17489, Germany. Phone: +49(0)3834 86 7591; Fax: +49(0)3834 86 19551. Email: [email protected]. Received 7 Feb 2014; revision requested 28 Feb 2014; revised version received 3 Apr 2014; accepted 8 Apr 2014. First published online 9 May 2014.
psychological, social, and legal issues. In caring for people with dementia (PWD), these issues are ideally addressed comprehensively with multiprofessional and multimodal interventions. These interventions need to be tailored to the individual needs and resources of the individual PWD, his or her caregiver and the local and regional framework of the healthcare system. Although these guidelines offer practicing physicians an orientation for caring for PWDs, the diagnosis and treatment of dementia are complex tasks. Studies show that physicians sometimes feel challenged to adapt these guidelines to specific local and individual situations (Riepe and Fellgiebel, 2012; Vollmar et al., 2010). Case management has been suggested as a method to optimize treatment and care for
1378
T. Eichler et al.
community-dwelling PWDs, and intensive collaborative care management programs that ensure a high level of integration between health and social service organizations have been proofed to be clinically effective in the United States (Somme et al., 2012). With DelpHi-MV (Dementia: lifeand person-centered help in Mecklenburg-Western Pomerania), we developed and implemented a collaborative dementia care management program to provide “optimum care” to community-dwelling PWDs and their caregivers in Germany (for a detailed description of the dementia care management in DelpHi-MV, see (Eichler et al., 2014)). The comprehensive, individualized intervention is initiated and coordinated by a dementia care manager (DCM) and delivered in close cooperation with the treating general practitioner (GP). The intervention is based on a systematic and standardized baseline assessment that covers up to 3,500 different variables with the aim of identifying the individual needs and resources of the PWDs and his or her caregiver. These needs are then addressed in a tailored intervention/treatment plan. Considering the vast amount of data needed to assess for the provision of optimum care, there is a considerable risk that unmet needs remain overlooked and therefore unaddressed. Clinical decision support systems (DSS) have been suggested to assist GPs in the diagnosis and management of dementia (Lindgren et al., 2002; Downs et al., 2006; Lindgren and Eriksson, 2010). In Delphi-MV, a computerized InterventionManagement-System (IMS) was developed and implemented to facilitate the planning as well as the conduction and documentation of the DelphiIntervention. IMS is a rule-based expert DSS that matches individual patient characteristics to a computerized knowledge base. One of the most important functionalities of IMS is to support the compilation of the individual intervention plan by systematically identifying unmet needs and suggesting the corresponding specific interventions for recommendation to the GP. The objective of the present analyses was to examine whether the implementation of the IMS improved the identification of unmet needs as well as the recommendation of adequate specific interventions to the treating GP. In addition, the feasibility and acceptability of the system to the users (i.e. the DCMs) were evaluated.
Methods Study design Present analyses are based on data derived from the on-going GP-based randomized, controlled
intervention trial DelpHi-MV (Dementia: lifeand person-centered help in Mecklenburg-Western Pomerania). The details of the study are described in the study protocol (Thyrian et al., 2012). The eligible patients (older than 70 years, living at home) are screened for dementia in participating GP practices using DemTect (Calabrese and Kessler, 2000). DemTect is a widely used dementia screening tests in GP practices in Germany (Thyrian and Hoffmann, 2012). Patients who meet the inclusion criteria (DemTect < 9) are informed by their GP about the study, are invited to participate, and are asked to provide written informed consent. If the patient names a caregiver, he or she is asked to participate in the study. When the patient is unable to provide written informed consent, his or her legal representative is asked to sign the consent form on the patients behalf (as approved by the Ethical Committee of the Chamber of Physicians of Mecklenburg-Western Pomerania, registry number BB 20/11). Participants and their caregivers are assigned to an intervention or a control group, depending on whether the treating GP practice was randomized into either the control or intervention group. The enrollment into the main study started on January 1, 2012. Baseline and annual follow-up assessments are conducted identically in both groups. Whereas the control group receives “care as usual,” the intervention group receives the “DelpHiIntervention.” The intervention is initiated and coordinated by a DCM – a nurse with dementiaspecific qualifications (Dreier et al., 2011; Dreier and Hoffmann, 2013). Study participants are contacted by their designated DCM to arrange two to four personal visits at their homes to carry out the comprehensive standardized baseline assessment regarding each patient’s specific social, medical, psychological, pharmaceutical, and nursing care situation. The DCM conducts further in-depth assessments at the first visit after baseline (e.g. mobility tests, pain assessment, and neuropsychiatric assessment). Based on the information collected, the unmet needs of the PWD are identified and an adequate individualized intervention plan according to the “DelpHiStandard” is established and forwarded to the treating GP by a semi-standardized GP-information letter. The letter includes the recommendations for specific interventions. The GP decides whether he rates a recommended intervention as “necessary” and, if so, whether he conducts the respective intervention himself or delegates it to the DCM. The GP-information letter is the main instrument for communication and coordination between the DCM and GP and ensures that the GP assumes a key role in the DelpHi-Intervention.
Benefits of IMS
The “DelpHi-Standard” of optimum care is composed of a comprehensive set of 95 intervention modules that are assigned to eight different action fields representing the complexity of dementia care (e.g. medical diagnosis and treatment; nursing care; pharmaceutical treatment and care). Each intervention module consists of: (a) predefined trigger condition(s) derived from the comprehensive standardized assessment; (b) a subsequent intervention task; and (c) at least one criterion to define the successful completion of the respective task. Intervention tasks include in-depth assessments, counseling of the PWD or the caregiver on specific dementia-related topics, emergency measures, structured provision of information to the treating GP about specific health problems and recommending specific interventions to the treating GP (for a detailed description of the “Delphi-Standard,” see (Eichler et al., 2014)). Intervention-Management-System IMS is a rule-based expert DSS, which is composed of the programmed algorithms of the 95 predefined intervention modules of the “DelpHi-Standard.” For data collection, tablet-PCs that comply with the legal requirements for technical products in medical settings (Bundesministerium der Justiz, 1994) are used. All data are entered directly into the DelpHiinformation system and are immediately processed (Meyer et al., 2012). Whenever a predefined trigger condition is activated, the corresponding intervention task is automatically selected by the IMS. A total of 43 specific interventions can be recommended in the GP-information letter. Of these, 28 are automatically selected by IMS whenever the respective trigger conditions are met (see Table 1). Trigger conditions were defined broadly to ensure that unmet needs do not remain undetected. Thus, not all triggered and selected interventions must be recommended to the GP (the reason for not recommending an IMS-selected intervention has to be documented). Because life circumstances are too complex and individual to cover them entirely with a fixed set of predefined algorithms, the DCM can also recommend further interventions manually, even if they had not been previously selected by IMS. The present analyses focus solely on these 28 specific interventions that IMS automatically selects for recommendation in the GP-information letter when the trigger conditions are met. There are another 15 specific interventions that can be recommended to the GP, but are not automatically selected by IMS. Instead,
1379
IMS suggests either (a) a special evaluation of complex circumstances to decide whether a specific intervention should be recommended or (b) a case conference to discuss the case before recommending a specific intervention. Because recommending these interventions requires active human interactions that could disturb the evaluation of the impact of implementing IMS, they were excluded from the analysis. Figure 1 illustrates the outline of IMS. IMS was developed and tested over the course of the DelpHi-trial and implemented into the study routine 12 months after the first enrollment of study participants into the main study (January 2012). Before the implementation of IMS, a written version of the “DelpHi-Standard” was used by the DCM to identify unmet needs and to establish the intervention plan. A total of 96 patients were included in this period (the “pre-IMS-group”). After the implementation of IMS, the system was tested with 33 patients (the “IMS-group”). For each of these 33 PWDs, the IMS generated a list of recommended interventions. The DCM decided, if the respective intervention should be recommended to the GP in the GP-information letter. If not, the reason for not recommending was documented. In addition, the DCM can recommend interventions that have not been automatically selected by IMS. To determine the benefits of implementing IMS, the system was also retroactively applied to the 96 PWDs of the “pre-IMS-group.” Because the data to run and trigger IMS were available in this group, we determined which specific interventions IMS would have selected for these respective patients. After comparing the actual recommendations given in the GP-information letters for each PWD in the “preIMS-group” with the recommendations triggered retrospectively by IMS, the DCMs were asked to document the reason for each difference based on their individual case documentation. The feasibility and acceptability of IMS to the users (n = 6 DCMs) were assessed by a self-designed questionnaire, which contained the following three questions: How helpful is IMS for your work? How user-friendly is IMS? Would you like to apply the system in your further work? The DCMs were asked to answer these questions on a scale ranging from 1 (lowest possible satisfaction) to 10 (highest possible satisfaction).
Sample The present analyses are based on a total sample of 129 patients of the intervention group (n = 96 PWDs in the “pre-IMS-group” and n = 33 PWDs in the “IMS-group”).
1380
T. Eichler et al.
Table 1. Specific interventions that are automatically recommended by IMS for the GP-information letter whenever the respective trigger conditions are met (grouped by action fields) A C T I O N FI E L D
S P E C I FI C I N T E R V E N T I O N
............................................................................................................................................................................................................................................................................................................................
Nursing care
Social counseling and legal support
Medical diagnosis and treatment
Pharmaceutical treatment and care
Social integration Special therapies
Application for care level (nursing care insurance) Appeal against refusal of care level (nursing care insurance) Pain: diagnosis/treatment Incontinence: diagnosis/treatment Nutritional disorder: monitoring/treatment Mobility limitation/risk of fall: monitoring/treatment Visual problems: diagnosis/treatment Hearing impairment: diagnosis/treatment Establish power of attorney for health care Establish appointment of legal representative for health care Establish legal representative (general) Establish patient decree (living will) Application for an identity card for the disabled In-depth information about dementia Clarification of the diagnosis of dementia Referral to a psychiatrist (suspicion of major depression) Referral to a neurologist (suspicion of disturbance of extrapyramidal motor system/gait) Indication check: anti-dementia drugs Indication check: guideline-based treatment Indication check : substance XX Dosage check: substance XX Medication check by pharmacist Issue of up-to-date medication plan Support of preparing/administering medication Occupational therapy Partial ambulant rehabilitation Ambulant geriatric rehabilitation Inpatient geriatric rehabilitation
Data analyses For the sample description, we analyzed age, sex, living situation (alone/not alone), and cognitive status (assessed using the German version of the Mini Mental Status Examination (Kessler et al., 1990)). To test for significant group differences, we used Fisher’s exact test for categorical variables and the two sample t-test for continuous variables. Statistical analyses were performed with STATA version 11.0 (StataCorp, 2009). The frequency of IMS-selected and subsequently DCM-recommended interventions, reasons for not recommending IMS-selected interventions as well as additionally DCM-recommended interventions are described for both groups (number of recommended interventions: total/per PWD). We report the total number of recommended interventions in the GP-information letters and the number of recommended interventions grouped by the action fields (“nursing care,” “social counseling and legal support,” “medical diagnosis and treatment,” “pharmaceutical treatment and care,” “social integration,” and “special therapies”).
Regarding the feasibility and acceptability of the IMS to the users, we report mean sum scores and ranges.
Results Characteristics of the study sample Table 2 presents the sociodemographic and clinical characteristics of the study sample. With the exception of sex, there are no significant differences between the “pre-IMS-group” and the “IMSgroup.” Identification of unmet needs The retroactive application of IMS to determine, which specific interventions IMS would have selected for the PWDs of the “pre-IMS-group,” yielded the following results: in total IMS selected n = 552 specific interventions (n = 5.75 per PWD; R = 1–12). Of these, the DCMs had actually recommended 28% to the GP (n = 157 interventions; n = 1.64 per PWD; R = 1–5).
Benefits of IMS
1381
Table 2. Sociodemographic and clinical characteristics of the study sample TOTAL SAMPLE (N = 129)
PRE-IMSGROUP
IMS-GROUP
(n = 96)
(n = 33)
TEST OF S I G N I FI C A N T D I FF E R E N C E S
............................................................................................................................................................................................................................................................................................................................
Sex (female) Age Living alone Severity of dementia (MMSE) Total score No cognitive impairment (score, 27–30) Mild cognitive impairment (score, 20–26) Moderate cognitive impairment (score, 10–19) Severe cognitive impairment (score, 0–9)
90 (70%) 80.18 (5.53) 62 (48%) n = 128 22.17 (5.11) 29 (23%) 63 (49%) 35 (27%) 1 (1%)
72 (75%) 80.02 (5.56) 46 (48%) n = 96 22.55 (4.87) 23 (24%) 48 (50%) 24 (25%) 1 (1%)
18 (55%) 80.63 (5.49) 16 (48%) n = 32∗ 21.06 (5.70) 6 (19%) 15 (47%) 11 (34%) –
p < 0.05a p > 0.50b p > 0.50b p > 0.15b
Standard deviations or percentages are in brackets. MMSE = Mini Mental State Examination; range: 0–30; higher score indicates better cognitive functioning. ∗ n = 1 observation missing; a Fisher’s exact test; b two sample t-test.
Figure 1. (Colour online) Outline of IMS (present analyses are focused on thick-rimmed areas).
Across the individual action fields, the concordance between IMS-selected and actually DCM-recommended interventions varied widely between 11% (“pharmaceutical treatment and care”) and 83% (“special therapies”). The results are illustrated in Figure 2. In the “pre-IMS-group,” as many as 72% of the IMS-selected interventions were actually not
recommended to the GP (n = 395 interventions; n = 4.13 per PWD). The DCMs were asked to provide reasons why they did not recommend these interventions (retrospective statements). The majority of the interventions (n = 311 (78.8%)) were not recommended, because the respective unmet need had not been identified by the DCMs. Another 19.7% of these interventions (n = 78) were
1382
T. Eichler et al.
Figure 2. (Colour online) Number of specific interventions (per PWD) that were suggested by IMS and the percentage of subsequently recommended interventions in the GP-information letter before (“pre-IMS-group”; n = 96) and after (“IMS-group”; n = 33) the implementation of IMS into the study routine (total/grouped by action fields).
already addressed, thus the intervention was not deemed necessary by the DCM (e.g. IMS triggered the recommendation for diagnosis/treatment of visual problems, but the DCM knows that the PWD has an appointment with an ophthalmologist already). Furthermore, 1.5% of the interventions (n = 6) were not agreed to by the PWD or their caregivers. After the implementation of IMS into the study routine, IMS selected a total of n = 184 interventions (n = 5.58 per PWD; R = 1–11) for the n = 33 PWD of the “IMS-group.” Of these, the DCMs subsequently recommended 74% to the GP (n = 136; n = 4.12 per PWD; R = 1–11). Regarding the individual action fields, the variation of concordance between IMS-selected and actually recommended interventions was considerably lower than in the “pre-IMS-group” and ranged between 65% (“nursing care”) and 86% (“social counseling and legal support”). The results are illustrated in Figure 2. In the “IMS-group,” only 26% of IMS-selected interventions were not recommended by the DCMs (n = 48; n = 1.45 per PWD). Of these, 90% (n = 43 interventions) were not recommended because
these needs were addressed already. The remaining 10% (n = 5 interventions) were not wanted by either the PWD or his or her caregiver.
Recommendations of specific interventions to the treating GP For n = 96 PWD of the “pre-IMS-group,” the DCMs recommended a total of n = 258 specific interventions (n = 2.69 per PWD; R = 1–8) to the GP. The results are shown in Table 3. We found that 61% of these recommended interventions (n = 157) were retroactively selected by IMS as well. Across individual action fields, these figures varied considerably between 19% and 100%. The DCMs recommended additional n = 101 specific interventions (n = 1.05 per PWD) that were not selected by IMS (39% of the finally recommended interventions). After the implementation of IMS into the study routine, the DCMs recommended n = 164 specific interventions for n = 33 PWD of the “IMS-group” to the GP (n = 4.97 interventions per PWD; R = 1–13) (see Table 3).
11 (20%) 8 (16%) 1 (5%) 6 (20%) 1 (20%) 1 (33%) 44 (80%) 42 (84%) 20 (95%) 24 (80%) 4 (80%) 2 (67%) 67 (0.70) 84 (0.89) 27 (0.28) 47 (0.49) 14 (0.14) 19 (0.20)
50 (75%) 55 (65%) 27 (100%) 9 (19%) 11 (79%) 5 (26%)
17 (25%) 29 (35%) 38 (81%) 3 (21%) 14 (73%)
55 (1.67) 50 (1.52) 21 (0.64) 30 (0.91) 5 (0.15) 3 (0.09)
28 (17%) 136 (83%) 164 (4.97) 101 (39%) 157 (61%) 258 (2.69)
Specific interventions (total) Grouped by action fields Nursing care Social counseling and legal support Medical diagnosis and treatment Pharmaceutical treatment and care Social integration Special therapies
n (%) n (%) n (%) n (%)
............................................................................................................................................................................................................................................................................................................................................................................................................................................................
DCM ALONE: INTERVENTIONS ADDITIONAL RECOMMENDED BY DCM TO GP:
INTERVENTIONS RECOMMENDED TO THE GP: TOTAL (MEAN N PER PWD)
DCM ALONE: INTERVENTIONS ADDITIONAL RECOMMENDED BY DCM TO GP: IMS & DCM: INTERVENTIONS SELECTED BY IMS AND RECOMMENDED BY DCM TO GP:
INTERVENTIONS RECOMMENDED TO THE GP: TOTAL (MEAN N PER PWD)
IMS & DCM: INTERVENTIONS SELECTED BY IMS AND RECOMMENDED BY DCM TO GP:
(n = 33) IMS-GROUP
(n = 96) PRE-IMS-GROUP
Table 3. Specific interventions recommended to the GP before (pre-IMS-group) and after (IMS-group) the implementation of IMS into the study routine: total number of recommended interventions; interventions selected by IMS and subsequently recommended by DCM (IMS & DCM); and additional recommended interventions by DCM (DCM alone)
Benefits of IMS
1383
Of these recommended interventions, 83% were previously selected by IMS. Variance across action fields (67%–95%) was considerably lower than in the “pre-IMS-group.” The proportion of additional recommended interventions that were previously not selected by IMS was clearly lower than in the “pre-IMSgroup” (17% vs. 39% of finally recommended interventions). Feasibility and acceptability of IMS On a scale from 1 to 10, the six current users of IMS evaluated the system as followed: They regarded IMS as helpful for their work with an average score of 9.5 (R = 8–10). The user-friendliness was judged with an average score of 6.8 (R = 5–8). In terms of willingness to implement IMS in their future work, the average score was 9.0 (R = 7–10).
Discussion Present results demonstrate a substantial benefit of implementing the computerized IMS on the identification of unmet needs in dementia care management. Before the implementation of IMS, 72% of the interventions that the IMS would have automatically suggested for recommendation to the GP according to the “DelpHi-Standard” have actually not been recommended by the DCM – most often because the DCMs did not recognize the respective unmet need without the support of IMS. These results clearly point out the difficulty of detecting unmet needs within the complexity of home caring situations for PWDs. The capacity of human conscious thinking is limited; only 5 ± 2 chunks of information can be processed at the same time (Doerner and Schaub, 1994; Miller, 1994). This fundamental psychological principle supports the need for utilizing the assistance of a computerized system to improve the systematic identification of unmet needs. Furthermore, the implementation of IMS resulted in an improved adherence to the “DelphiStandard” of dementia care and increased the comprehensiveness of the established intervention/treatment plans. The results show that due to the implementation of IMS, the concordance between automatically IMS-selected and actually DCM-recommended interventions increased from 28% to 74%. Consequently, the number of recommendations for specific interventions given to the treating GP increased by 85% (from n = 2.69 to n = 4.97 recommended interventions per PWD). The high concordance between automatically IMSselected and actually recommended interventions indicates that IMS produces adequate suggestions
1384
T. Eichler et al.
for the intervention with a high degree of clinical relevance. However, our findings clearly reflect that IMS can only support, but not serve as a substitute for a qualified person. After the implementation of IMS, the DCMs did not rely solely on the suggestions that are generated automatically by IMS. Instead, they critically reconsidered whether an IMS-selected intervention was actually necessary and acceptable by the PWD and/or the caregiver. On the other hand, they also gave additional recommendations when they thought that an intervention was required, even when IMS had not selected it previously. Regarding the feasibility and acceptability of IMS, the current six users of the system evaluated it as very helpful and they would like to use it for their future work. However, the usability was not so highly rated and could be further improved. Because the number of users is still low, these results cannot be generalized. To summarize, our findings provide evidence that IMS improves the systematic identification of unmet needs and the subsequent recommendation of interventions to adequately address these needs. Therefore, our data suggest that utilizing IMS increases the comprehensiveness of dementia care management. Whether this will actually lead to optimized care and to improved patient outcomes needs to be evaluated over the course of the DelpHitrial. Three reviews of clinical DSS for various diseases and purposes have shown inconsistent results (Garg et al., 2005; Roshanov et al., 2011; Sahota et al., 2011). These reviews report an effect of implementing a clinical DSS on the improvement of the care process in more than half of the studies under consideration (52%, 63%, and 64%). However, they differ considerably in their estimate on the positive results of a clinical DSS regarding patient outcomes (range of 15% to 65% of the studies under consideration). Bryan and Boren (2008) report positive or variable outcomes in 76% of the included studies. Only one of the studies included in these reviews implemented a dementia-specific DSS (Downs et al., 2006). Their DSS operated within patient electronic records and was used to prompt and assist clinical reasoning and care planning. Results showed a significant improvement in detection rates of dementia, but there was no evidence for an impact on the management of dementia. However, for the DelpHi-trial, we expect a positive effect of the dementia care management on patient outcomes because of the setup of the intervention that differs to the one of Downs et al. (2006). IMS has been developed and implemented to facilitate the planning as well as the conduction,
monitoring, and documentation of the dementia care management. The system does not only support the establishment of an individualized intervention plan that is forwarded to the GP. In addition, IMS suggests specific interventions directly to the DCMs, e.g. the counseling and support of the caregiver. Most important is that the DCMs are responsible for the implementation of all IMS-selected and additional self-selected interventions, including all the interventions that the GP delegated back to them (except for the ones that were rated as “not necessary” or “not wanted” by the DCM, the PWD, the caregiver or the GP). The completion of each specific intervention has to be documented by the DCMs in the IMS. In the case that an intervention cannot be completed, the reason has to be documented as well. This way IMS ensures that unmet needs are not only identified, but will be really addressed in the course of the DelpHi-Intervention.
Limitations The size of the “IMS-group” was not sufficient to allow meaningful comparisons regarding the action fields “social integration” and “special therapies.” The reasons for not recommending an IMSselected intervention were given retrospectively by the DCMs and may not be fully reliable. However, because the DCMs kept detailed documentation of each case, the potential for systematically compromised validity is most likely limited.
Conflict of interest None.
Description of authors’ roles TE drafted the manuscript and was a main contributor to the development of IMS. JRT, the study coordinator, contributed substantially to the overall design of the Delphi-trial and the development of the DelpHi-Intervention. DF (computer science), LK (data management), AD (nursing care), DW (pharmacy), and BM (health economy) contributed to the DelpHi-trial and to the manuscript in accordance with their areas of expertise. WH, the principal investigator of the study, contributed substantially to the concept of the DelpHi-trial and to the final version of the manuscript. All authors have read and approved the final manuscript.
Benefits of IMS
Acknowledgments The authors would especially like to thank Kerstin Albuerne for the programming of the IMS-algorithms. The DelpHi-trial and IMS were developed and established as a result of input from the following experts in their respective fields, with support provided by an experienced field study team: Ines Abraham, Aniela Angelow, Grit Aßmann, Vaska Böhmann, Georgia Böwing, Kathleen Dittmer, Thomas Fiß, Sarah Gardzella, Jana Hubert, Ulrike Kempe, Ingo Kilimann, Saskia Moll, Andrea Pooch, Sabine Schmidt, Christiane Schnick, Christine Winckler, and Paula Winter. We thank all of the participating patients and their general practitioners for their collaboration.
References Bryan, C. and Boren, S. A. (2008). The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Informatics in Primary Care, 16, 79–91. Bundesministerium der Justiz (1994). Gesetz über Medizinprodukte (Medizinproduktegesetz - MPG). Available at: http://www.gesetze-im-internet.de/bundesrecht/mpg/ gesamt.pdf; last accessed 15 January 2014. Calabrese, P. and Kessler, J. (2000). Screening for cognitive impairment in dementia - the DemTect procedure. European Neuropsychopharmacology, 10, 369. DEGAM (Deutsche Gesellschaft für Allgemeinmedizin und Familienmedizin e.V.) (2008). DEGAM-Leitlinie Nr 12: Demenz. Düsseldorf: omikron. DGPPN and DGN (Deutsche Gesellschaft für Psychiatrie, Psychotherapie und Nervenheilkunde und Deutsche Gesellschaft für Neurologie) (2009). S-3 Leitlinie “Demenzen.” Available at: http://www.dgppn.de/ fileadmin/user_upload/_medien/download/pdf/ kurzversion-leitlinien/s3-leitlinie-demenz-lf.pdf; last accessed 15 January 2014. Doerner, D. and Schaub, H. (1994). Errors in planning and decision-making and the nature of human information processing. Journal of Applied Psychology, 43, 433–453. Downs, M. et al. (2006). Effectiveness of educational interventions in improving detection and management of dementia in primary care: cluster randomised controlled study. British Medical Journal, 332, 692–696. Dreier, A. and Hoffmann, W. (2013). Dementia care manager for patients with dementia: determination of the requirements and qualifications contents for nurses in the DelpHi-MV study. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz, 56, 1398–409. doi:10.1007/s00103-013-1796-0. Dreier, A., Thyrian, J. R. and Hoffmann, W. (2011). Dementia Care Manager in der ambulanten Demenzversorgung: entwicklung einer innovativen Qualifizierung für Pflegefachkräfte. Pflege & Gesellschaft, 16, 53–64. Eichler, T. et al. (2014). Dementia care management: going new ways in ambulant dementia care within a GP-based randomized controlled intervention trial. International
1385
Psychogeriatrics, 26, 247–256. doi:10.1017/ S1041610213001786. Garg, A. X. et al. (2005). Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. Journal of the American Medical Association, 293, 1223–1238. Kessler, J., Markowitsch, H. J. and Denzler, P. (1990). Mini-Mental-Status-Test (MMST) [German Version]. Göttingen: Beltz Test GmbH. Lindgren, H. and Eriksson, S. (2010). Sociotechnical integration of decision support in the dementia domain. Studies in Health Technology and Informatics, 157, 79–84. Lindgren, H., Eklund, P. and Eriksson, S. (2002). Clinical decision support system in dementia care. Studies in Health Technology and Informatics, 90, 568–571. Meyer, J., Fredrich, D., Piegsa, J., Habes, M., van den, B. N. and Hoffmann, W. (2012). A mobile and asynchronous electronic data capture system for epidemiologic studies. Computer Methods and Programs in Biomedicine, 107, 369–379. Miller, G. A. (1994). The magical number seven, plus or minus two: some limits on our capacity for processing information, 1956. Psychological Review, 101, 343–352. National Institute for Health and Care Excellence (NICE) (2012). Dementia: Supporting People with Dementia and Their Carers in Health and Social Care. Available at: http: //www.nice.org.uk/nicemedia/live/10998/30318/30318.pdf; last accessed 15 January 2014. Riepe, M. W. and Fellgiebel, A. (2012). Dementia guidelines: what should come to general practice-an interdisciplinary consensus of physicians in private practice. Deutsche medizinische Wochenschrift, 137, 1499–1504. doi:10.1055/s-0032-1305171. Roshanov, P. S. et al. (2011). Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review. Implementation Science, 6, 92. doi:10.11861748-5908-6-92. Sahota, N. et al. (2011). Computerized clinical decision support systems for acute care management: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implementation Science, 6, 91. doi:10.1186/1748-5908-6-91. Somme, D., Trouve, H., Drame, M., Gagnon, D., Couturier, Y. and Saint-Jean, O. (2012). Analysis of case management programs for patients with dementia: a systematic review. Alzheimer’s & Dementia, 8, 426–436. doi:10.1016/j.jalz.2011.06.004. StataCorp (2009). Stata Statistical Software: Release 11. College Station, TX: StataCorp LP. Thyrian, J. R. and Hoffmann, W. (2012). Dementia care and general physicians-a survey on prevalence, means, attitudes and recommendations. Central European Journal of Public Health, 20, 270–275. Thyrian, J. R. et al. (2012). Life- and person-centred help in Mecklenburg-Western Pomerania, Germany (DelpHi): study protocol for a randomised controlled trial. Trials, 13, 56. doi:10.1186/1745-6215-13-56. Vollmar, H. C. et al. (2010). Knowledge transfer for the management of dementia: a cluster randomised trial of blended learning in general practice. Implementation Science, 5, 1. doi:10.1186/1748-5908-5-1.
