|
|
||||||||
| ABSTRACT |
|
|
|---|
5 years of age. The proportion of patients with negative blood smears prescribed antimalarial drugs decreased from 47.9% to 19.6% (P < 0.001) in persons < 5 years of age and from 38.8% to 15.6% (P < 0.001) in those
5 years of age. Training did not improve the proportion of patients with positive blood smears prescribed antimalarial drugs, the proportion of patients prescribed appropriate antimalarial drugs, or the diagnostic accuracy of microscopy. Integrated team-based training may improve malaria case management and reduce the number of unnecessary antimalarial treatments. | INTRODUCTION |
|
|
|---|
Presumptive treatment was accepted and even encouraged in official guidelines when older, inexpensive antimalarial drugs such as chloroquine were widely effective. In addition, the anti-inflammatory properties of chloroquine may effectively manage other non-malarial febrile conditions. However, in many settings, empiric treatment results in substantial overuse of antimalarial drugs and delays in the diagnosis of other febrile illnesses.2,7–9 For example, bacteremia is an important, treatable cause of fever and coma resembling malaria.10 Inappropriate use of antimalarial drugs is increasingly problematic because older antimalarial drugs are replaced by new artemisinin-based combination therapies (ACTs) that are more costly, in limited supply, and have less established safety records.11,12 The need for improved malaria case management in sub-Saharan Africa is recognized as a public health issue requiring urgent attention.13–15
Most countries in sub-Saharan Africa have recently changed their antimalarial drug treatment policies, adopting ACTs as the recommended treatment of uncomplicated malaria. The widespread implementation of these new highly effective drugs provides an important opportunity to substantially improve the treatment of malaria. However, it is imperative that these drugs are used rationally to maximize their impact. Training of health workers and improving diagnostic capabilities have been identified as potential avenues for improving malaria case management. The results of observational studies suggest a need for more integrated training approaches6 and supportive supervision.16 However, recent intervention studies highlight the challenges faced in changing in health workers diagnostic and prescribing practices.5
In response to concerns about the need for improved case management in Uganda, we designed and prospectively evaluated a training curriculum for health workers at facilities with existing laboratory services. The Malaria Control Program (MCP) of the Uganda Ministry of Health recommends diagnostic testing for malaria at all sites with a functional laboratory. We evaluated the impact of the training on the quality of case management in eight health facilities approximately one year after the implementation of artemether-lumefantrine as the recommended first-line treatment for uncomplicated malaria. Outcomes were measured using an existing targeted surveillance system that captures data on outpatient demographics, diagnoses, and treatments prescribed.
| METHODS |
|
|
|---|
|
Training intervention The aim of the training was to improve health workers performance of clinical and laboratory tasks relevant to malaria case management, and to encourage a shared understanding of the management approach and the role of each staff member. The curriculum and training materials were developed and delivered through the Joint Uganda Malaria Training Program (JUMP), a partnership between UMSP and the Infectious Diseases Institute (IDI) of Makerere University. The course was team-based and targeted three categories of staff typically working in health facilities in Uganda: clinicians (medical officers, clinical officers, nurses, and midwives), laboratory staff, and records clerks. The course includes both didactic and practical hands-on sessions. Training modules include information on malaria transmission and epidemiology, Uganda malaria policy, medical ethics, clinical management of malaria, preparation of blood smears, microscopy skills, and medical record keeping. The modules on clinical management of malaria included a session on management of patients with fever but with a negative blood slide for malaria parasites. Details are available at http://www.idi.ac.ug/resources/JUMPCurriculum.pdf and http://www.muucsf.org/publications/Training_materials.asp).
To ensure consensus among key stakeholders and cohesion with national case management guidelines, the training materials were developed through an iterative process with input from many sources. Existing resource materials and guidelines issued by the Uganda Ministry of Health, the World Health Organization, including the Integrated Management of Childhood Illness (IMCI) strategy, and other training and public health institutions were reviewed. A curriculum development specialist led the process in which training modules were written by experts in malaria epidemiology, laboratory diagnosis, and antimalarial treatment, and were edited by colleagues with field and training experience. Two national stakeholders meetings were held to formally review and revise subsequent curriculum drafts, informed by pilot trainings of 50 health workers. The final curriculum and training materials were approved by Ugandas National Malaria Case Management Technical Working Group, the MCP, and other stakeholders in Uganda.
Each site was visited by the JUMP team prior to training as part of a baseline needs assessment. A total of 170 health workers received training from the 8 sentinel site health facilities from December 2006 through June 2007 (Table 1
). Training consisted of a six-day course conducted at the IDI and UMSP core facilities at Mulago Hospital in Kampala. To minimize disruption of patient services, the staff at each health facility was divided into two groups and trained in two back-to-back week-long sessions. Trainees were assessed for learning attainment in terms of knowledge, skills, and attitudes through performance on written pre-test and post-test, participation in clinical and case discussions, and attendance of at least 90% of the sessions. Two follow-up support supervision visits approximately 6 and 12 weeks after the initial training course were conducted at the sentinel sites by JUMP team members to reinforce training messages, assess skills, and provide individual feedback.
Microscopy and quality control We compared the diagnostic accuracy of field microscopy before and after training using expert microscopy as the gold standard. Thick blood smears were collected from 1,000 consecutive patients referred to the laboratory prior to training and 500 consecutive patients referred to the laboratory approximately one month after training. Thick blood smears were stained with 10% Giemsa for 10 minutes and read by health facility staff as part of their usual practice. Thick blood smears were fixed and subsequently sent to a central laboratory in Kampala, Uganda for reading by expert microscopists who were blinded to field results. Asexual parasitemia of any level was reported as a positive smear, and smears were considered negative if the examination of 100 high-power fields did not show asexual parasites. When results of the field reading and the first expert reading were discrepant, smears were reviewed by a second expert microscopist. Results were considered final if the first and second expert readings agreed. If the first and second expert readings were discordant the tie was broken by a third expert reader.
Data management and statistical analysis Individual patient-level surveillance data were entered into a centralized database using Access (Microsoft Corporation, Redmond, WA). Statistical analysis was done using Stata version 10 (Stata, College Station, TX). For analysis of microscopy data at individual sites, the sensitivity and specificity of field microscopy (with expert microscopy as the gold standard) for pre-training (n = 1,000) and post-training (n = 500) blood smears were compared using the chi-square test. We compared surveillance data collected 120 calendar days prior to the last day of training with data collected 120 calendar days after the last day of training for the following four outcome measures: 1) proportion of patients suspected of having malaria who were referred for microscopy; patients suspected of having malaria were defined as any patient sent for microscopy or any patient not sent for microcopy and given a clinical diagnosis of malaria; 2) proportion of patients with a positive blood smear who were prescribed antimalarial treatment; 3) proportion of patients with a negative blood smear who were prescribed antimalarial treatment; and 4) proportion of patients prescribed antimalarial treatment whose prescription included an appropriate regimen. An appropriate regimen was defined as the governments recommended first-line treatment, artemether-lumefantrine, or the second-line treatment, quinine.
Two analyses were conducted for each of the outcome variables: 1) analysis of individual sites, and 2) summary analysis of all sites in which the site was the unit of analysis. For analysis of individual sites, the unit of analysis was one working day rather than the patient. Surveillance data were not available on the name of the patient or the provider. Consequently, it was not possible to perform the analysis with hierarchical models that adjust for potential repeated observations of the same patient and same clinician. In particular, the providers at a facility on a given day may have had a practice style that was similar across patients leading to autocorrelation. To adjust for autocorrelation with available information, data were aggregated and weighted by the number of patients seen each day using survey estimation to compute means and the Wald test for hypothesis testing of pre-training and post-training comparisons. The issue of autocorrelation did not arise in the summary analysis with the site as the unit of analysis. A single proportion was computed for an outcome for all of the patients pre-training and a second proportion for all of the patients post-training at each site. The eight pre-training proportions were then compared with the eight post-training proportions using the paired sample -test. All analyses were stratified a priori for patients < 5 years of age and patients
5 years of age. A P value < 0.05 was considered statistically significant.
| RESULTS |
|
|
|---|
Diagnostic accuracy of field microscopy
As shown in Table 2
, the sensitivity of field microscopy, i.e., correctly identifying the presence of malaria parasites, was relatively high before training (greater than 85% at 5 of 7 sites) and did not improve significantly after training. One site had a non-significant improvement in sensitivity from 66.7% to 85.7% and two sites had a significant decrease in sensitivity. The specificity of field microscopy, i.e., correctly reading a blood smear as negative, was also high before training (greater than 90% at 5 of 7 sites) and did not improve significantly after training (with a significant decrease in specificity at one site, Nagongera).
|
5 years of age at 5 of the 8 sites. Pre-training, Kihihi was the only site where more than 50% of patients suspected to have malaria in both age groups were sent to the laboratory; post-training, this benchmark was met at 5 of the sites for patients < 5 years of age and at 4 of the sites for patients
5 years of age. With the site as the unit of analysis, the proportion increased from 38.3% pre-training to 54.6% post-training for patients < 5 years of age (P = 0.04) and from 34.1% to 53.4% for patients
5 years of age (P = 0.02).
|
5 years of age = 83.3–95.3%), and no significant changes were seen after training (Figure 2
5 years of age (P = 0.87). A relatively high proportion of patients with negative blood smears were prescribed antimalarial drugs at all of the sites prior to training (range for patients < 5 years of age = 30.7–77.7%; range for patients
5 years of age = 26.6–68.8%). After training, the proportion of patients with negative smears who were prescribed antimalarial treatment decreased at all sites, for both age groups (Figure 3
5 years of age at 7 of the 8 sites. With the site as the unit of analysis, the proportion decreased from 47.9% pre-training to 19.6% post-training for patients < 5 years of age (P < 0.001) and from 38.8% to 15.6% for patients
5 years of age (P < 0.001).
|
|
5 years of age. After training, results were mixed across the sites with statistically significant improvements at 2 of the 8 sites in patients < 5 years of age and at 4 of the 8 sites in patients
5 years of age (Figure 4
5 years of age (P = 0.86).
|
| DISCUSSION |
|
|
|---|
To the best of our knowledge, there are relatively few published studies evaluating the impact of training on malaria case management. A prospective study in Guinea-Bissau found reduced mortality after a training and implementation of standardized guidelines for malaria management in a hospital setting.23 A survey study of the impact of IMCI training in Uganda noted significant associations between training and health workers demonstrated ability to correctly classify childrens illnesses, to provide correct treatment of those requiring an antibiotic or antimalarial, and to advise caregivers effectively.24 Other studies that have considered training as a factor in quality of case management illustrate the challenges in altering health workers diagnostic and prescribing practices. In Tanzania, malaria rapid diagnostic tests were introduced with a basic training course, but this intervention did not lead to a reduction in overuse of antimalarial drugs.5 However, a retrospective assessment found a significant decrease in malaria over-diagnosis associated with a sustained training and supportive supervision effort.16 Pariyo and others also highlighted the importance of follow-up visits, finding that the quality of care was higher at facilities with at least one supervision visit every six months compared with other facilities.24 In summary, earlier studies demonstrate that case management training may lead to improvements in health care, although challenges remain in optimizing the impact of such training efforts.
The results of this study confirm the potential for training to effect significant improvements in some areas of malaria case management across sites that represented a wide range of malaria transmission intensities. Particularly encouraging are the increase in the proportion of patients suspected of having malaria referred for laboratory confirmation, and the reduction in antimalarial drug treatments prescribed to patients with negative blood smears. After training, the proportion of patients suspected of having malaria referred for microscopy increased by approximately 50%, and the proportion of patients with a negative blood smear prescribed antimalarial drug therapy decreased by approximately 60%. When the data from all 8 health facilities combined were extrapolated, these improvements resulted in 8,151 fewer prescriptions for antimalarial drug therapy among the 67,705 patients over the 120 days after training. The training program did not have a significant impact on the proportion of patients with positive blood smears who were prescribed antimalarial drug therapy. However, the pre-training standard for this indicator was already high, with more than 90% of patients with a positive blood smear prescribed antimalarial drug therapy.
The training program was less successful in improving the proportion of patients prescribed appropriate antimalarial drug therapy and the diagnostic accuracy of field microscopy. Prior to training the proportion of patients whose prescription included an appropriate antimalarial drug regimen was 86% in children < 5 years of age and 79% in those
5 years of age. Most appropriate prescriptions were for the governments newly recommended first-line treatment, artemether-lumefantrine (83%), and the remaining appropriate prescriptions were for quinine, the governments recommended second-line treatment. These results were better than those in a recent study from Zambia in which 27% of children weighing 5–9 kg and 42% of children weighing
10 kg with uncomplicated malaria were treated with artemether-lumefantrine. The Zambian study was conducted two years after the facilities began the process of implementing this drug as the recommended first-line therapy.15 In our study, most patients not given appropriate therapy were prescribed chloroquine plus sulfadoxine-pyrimethamine (87%), the previous first-line treatment of uncomplicated malaria in Uganda. Although data were not collected systematically about case management decisions, health workers reported that the primary reason for not prescribing appropriate therapy was that supplies of artemether-lumefantrine were depleted, which occurred variably from site to site both before and after the training period. For example, Aduku experienced a long period of depletion of artemether-lumefantrine after the training, which could explain the significant decrease in appropriate antimalarial drug therapy at that site.
Failure to improve the diagnostic accuracy of field microscopy after training was also felt to be caused by a combination of surprisingly good pre-training performance and limitations extraneous to the training intervention. Our overall sensitivity and specificity prior to training of 86% and 90%, respectively, was considerably higher than reported accuracy of field microscopy from other studies in Africa.4,25
There were several strengths and limitations in this study. This study is among the first to use an independent facility-based surveillance system to evaluate the effectiveness of a training program on key indicators of malaria case management. Surveillance data have the advantage of providing ongoing information about the quality of care and are likely to be more representative of actual performance compared with direct observation of provider-patient interactions. However, our pre-test/post-test study design may have been biased because of a Hawthorne effect, whereby health worker performance may have been improved by increased attention and not by the training program itself. Our integrated training approach was designed to involve all aspects of patient management, including diagnosis and treatment of non-malaria illnesses. By using team-based training, we attempted to emphasize the importance of all staff members of the health care facility working together. However, our six-day training program with supervised follow-up visits was labor-intensive and required considerable resources.
In summary, results of this study demonstrate that a relatively brief integrated training program, with supportive follow-up supervision, can achieve a significant impact on the quality of malaria case management. Improved use of laboratory confirmation of malaria cases and reduced prescription of antimalarial drugs for patients with negative blood smears are critical for rational use of antimalarial drugs and effective patient care. For optimal impact, integrated training must be accompanied by investment in other components of the health care system, including adequate staffing and reliable supplies of drugs and laboratory materials.
Received August 9, 2008. Accepted for publication September 18, 2008.
Acknowledgments: We thank the staff of participating health facilities for their enthusiastic cooperation with the training intervention evaluated in this study; the Uganda Malaria Control Program and other stakeholders who participated in development and approval of the training program; and the trainers, the JUMP team, and the UMSP data management team for their dedication and effort. This report is dedicated to Dr. Merle A. Sande (1939–2007), whose vision led to the creation of the Infectious Diseases Institute as an academic center of excellence at Makerere University and whose generous spirit brought together colleagues from several academic institutions and research projects to create the Joint Uganda Malaria Training Program.
Financial support: The study was supported by the Exxon Mobil Corporation, the Centers for Disease Control and Prevention (U50/CCU925122), and the National Institutes of Health (AI065457-01). Grant Dorsey is a recipient of the Doris Duke Charitable Foundation Clinical Scientist Development Award.
* Address correspondence to Grant Dorsey, University of California, San Francisco, Box 0811, San Francisco, CA 94143. E-mail: gdorsey{at}medsfgh.ucsf.edu ![]()
Authors addresses: Umaru Ssekabira and Allen Namagembe, Joint Malaria Training Program, c/o Infectious Diseases Institute, Mulago Hospital Complex, PO Box 22418, Kampala, Uganda, E-mails: ussekabira{at}idi.co.ug and anamagembe{at}idi.co.ug. Hasifa Bukirwa, Adoke Yeka, Moses Kiggundu, and Fred Wabwire-Mangen, Uganda Malaria Surveillance Program, c/o MUUCSF Malaria Research Collaboration, PO Box 7475, Kampala, Uganda, E-mails: hbukirwa{at}muucsf.org, yadoke{at}muucsf.org, mosesk_33{at}hotmail.com, and fwabwire{at}musph.ac.ug. Heidi Hopkins, University of California, San Francisco, c/o MUUCSF Malaria Research Collaboration, PO Box 7475, Kampala, Uganda, E-mail: hhopkins{at}medsfgh.ucsf.edu. Marcia R. Weaver, International Training and Education Center on HIV (I-TECH) University of Washington, 901 Boren, Suite 1100, Seattle, WA 98104, E-mail: mweaver{at}u.washington.edu. Lydia Mpanga Sebuyira, Infectious Diseases Institute, Mulago Hospital Complex, PO Box 22418, Kampala, Uganda, E-mail: lmpangasebuyira{at}idi.co.ug. Linda Quick, 2190 Kampala Place, Kampala, Uganda, E-mail: maq2{at}ug.cdc.gov. Sarah Staedke, London School of Hygiene and Tropical Medicine, c/o MUUCSF Malaria Research Collaboration, PO Box 7475, Kampala, Uganda, E-mail: sarah.staedke{at}lshtm.ac.uk. Gisela Schneider, DIFAEM, Paul Lechler Strasse 24, D 72076, Tubingen, Germany, E-mail: schneider{at}difaem.de. Keith McAdam, London School of Hygiene and Tropical Medicine, Keppel Street London WC1E 7HT, United Kingdom, E-mail: Keith.McAdam{at}lshtm.ac.uk. Grant Dorsey, University of California, San Francisco, Box 0811, San Francisco, CA 94143, E-mail: gdorsey{at}medsfgh.ucsf.edu.
| REFERENCES |
|
|
|---|
This article has been cited by other articles:
![]() |
L. A. Mills, J. Kagaayi, G. Nakigozi, R. M. Galiwango, J. Ouma, J. P. Shott, V. Ssempijja, R. H. Gray, M. J. Wawer, D. Serwadda, et al. Utility of a Point-of-Care Malaria Rapid Diagnostic Test for Excluding Malaria as the Cause of Fever among HIV-Positive Adults in Rural Rakai, Uganda Am J Trop Med Hyg, January 1, 2010; 82(1): 145 - 147. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Bukirwa, V. Yau, R. Kigozi, S. Filler, L. Quick, M. Lugemwa, G. Dissanayake, M. Kamya, F. Wabwire-Mangen, and G. Dorsey Assessing the Impact of Indoor Residual Spraying on Malaria Morbidity Using a Sentinel Site Surveillance System in Western Uganda Am J Trop Med Hyg, October 1, 2009; 81(4): 611 - 614. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |