|
|
||||||||
| ABSTRACT |
|
|
|---|
| WHY ARE COUNTRY AND SUB-NATIONAL LEVEL ESTIMATES OF MALARIA BURDEN NEEDED? |
|
|
|---|
| COUNTRIES EXPERIENCE DIFFICULTIES IN QUANTIFYING BURDEN: WHY? |
|
|
|---|
Nationally representative surveys. Demographic and health surveys (DHSs) and multiple indicator cluster surveys (MICSs) produce reliable estimates of all-cause mortality rates in children < 5 years old, which are useful in countries with high malaria burdens, although the estimates are usually centered on a period 3–5 years before the survey. The DHSs and MICSs also include a 2-week period-prevalence of fever in children < 5 years old, an indicator that is difficult to interpret as a measure of malaria morbidity.8–10 An increasing proportion of surveys now assesses the prevalence of low birth weight and hemoglobin levels,11 and countries are now undertaking malaria indicator surveys (MISs), which can include estimates of parasite prevalence.12 Such household surveys are seldom representative at a district level, because the two-stage cluster sampling technique does not always include all districts, and the number of clusters within a district is small. This, along with the long interval between surveys, reduces their direct relevance for monitoring changes in disease burden at country level; however, the information provided on mortality, morbidity, parasitemia, and care-seeking behavior can be valuable in interpreting data from other sources.
Demographic surveillance sites. Some malaria-endemic countries have demographic surveillance sites (DSSs) that enable trends in malaria mortality and morbidity to be measured at a population level.13 Because of the intensive nature of the data collection activities, DSSs cannot generally be applied over wide geographic areas or in large populations. If a DSS site exists within a district, it may provide pertinent information for a district manager. At a national level, the DSS cannot necessarily be used to paint a broader picture because they represent only a small fraction of a countrys population, and the sites may not be typical of all areas in the country. A key advantage of DSS is that they produce cause-specific death rates, as assessed through verbal autopsy, and some sites have followed trends over 10 years or more. The lack of sensitivity and specificity of verbal autopsies has been highlighted,14 but even with some imprecision, they can be a useful guide for resource allocation decisions.15
Health management information systems. Every country has a system for routinely recording the morbidity and mortality seen at health facilities, sometimes with parasitologic confirmation. Such information is collected continuously, from every district in a country, and for most districts, is the only readily available source of information on malaria. When such systems are working well, they show consistent seasonal variation in numbers of cases, coinciding with the pattern of malaria transmission that suggests, with other factors being constant, that they might be able to detect changes in morbidity over time. Moreover, when data from routine systems are compared with other sources of information (such as verbal autopsies in sentinel surveillance sites), it seems that health facilities capture the major causes of mortality in rural areas, although some individual causes of death may be over-or under-represented.16,17 A major limitation of such systems is that they represent a biased and incomplete sample of the morbidity and mortality experienced by communities. They often do not consider private clinics or other non-government facilities or morbidity treated at home. Hence, they can underestimate the total burden of disease by a considerable fraction.18,19 They are also influenced by changes in health service utilization, which may be general (such as introduction of user fees or construction of roads) or specific to malaria (such as availability of new therapies or introduction of laboratory confirmation). Moreover, such systems seldom function optimally; there is often inconsistent application of malaria case and risk definitions and irregularity in reporting from health facilities and districts to central levels. Trends in morbidity and mortality are therefore particularly prone to variations in reporting rates.20
Other sources. Systems of vital registration can sometimes provide relevant information, and many countries have locally conducted surveys that consider entomologic inoculation rates, parasite prevalence, or self-reported fever. Often such studies are primarily to answer locally specific questions and conducted in areas where malaria is perceived to be a problem, rather than to build up a national picture of disease burden or assess trends over time.
| HOW CAN WE USE AND IMPROVE AVAILABLE INFORMATION IN COUNTRIES? |
|
|
|---|
|
Estimating case incidence. Estimates of the population at risk of malaria also serve as the denominators for estimating malaria case incidence. (Care should be taken to ensure that population data are derived from sources officially recognized locally, such as projections from the national census, if estimates of incidence are to have local credibility.) Estimates of disease incidence have been inferred from parasite prevalence data, but the relationship is, at best, approximate. Incidence is best measured directly to genuinely determine whether the scaling-up of malaria interventions results in a reduction in morbidity and mortality. Direct measurement becomes particularly important as parasite prevalence declines and the proportion of infections that result in disease increases. Some countries might be able to estimate incidence by extrapolating the results of DSSs to provide national estimates of disease burden using the population at risk stratification. However, because the number of DSSs is usually small, or non-existent, it will usually be necessary to examine data obtained from routine health information systems. In doing so, at least two problems must be tackled: deficiencies in the reporting and collation of routine data and the under-representation that cases in health facilities represent.
Overcoming incompleteness of reporting.
One strategy is to concentrate on good reporting centers; if disease trends are estimated using a sample of facilities where reporting rates are high (e.g., > 90%), there is less chance that changes in disease incidence are distorted by fluctuation in reporting rates. Another strategy is to replace any missing value with an expected value for the health facility adjusted for the time of year and the year in question. In practice, it is best to use both methods because they complement each other. By concentrating on facilities with high reporting rates, one can be confident about a trend, but the facilities represent an incomplete selection from all facilities in the country. Conversely, the imputation of missing values will summarize trends for all facilities in the country, but the procedure uses incomplete temporal data. If the trends exhibited by both methods are consistent, one can have some confidence that the conclusions drawn are correct. Such a method was used in the mid-term review of the National Health Plan in Papua New Guinea in 1998 (Figure 2
) and provided confirmation that the upward trend in cases of cerebral malaria was not caused simply by changes in reporting rates or selection of facilities reporting.23,24
|
Overcoming incomplete coverage. Although trends might be inferred from consistently reported health facility data, it is more difficult to provide estimates of disease incidence that are comparable between sub-national administrative areas or can be aggregated to form a national estimate. Only a small proportion of fever cases may seek treatment in formal health facilities, and areas with better coverage may report unduly high levels of malaria incidence compared with those with less extensive health infrastructure. Some adjustment to incidence rates may be provided by considering health service utilization, as revealed by nationally representative household surveys, and by taking into account differential patterns of utilization by educational or socioeconomic status or sex. Such a procedure would benefit from greater consistency between the data items requested from household surveys and routine information systems. In particular, it would be useful for DHSs and MICSs to ask questions about total outpatient and inpatient utilization and reported diagnosis, as well as for selected conditions such as fever, diarrhea, and respiratory infections.
In many situations, reported malaria cases, if not confirmed parasitologically, should also be adjusted downward based on positivity rates from those health facilities that undertake laboratory confirmation. The adjustment required is likely to vary by levels of endemicity,26 and in areas of uncertainty, there may also be value in tracking confirmed and unconfirmed cases separately. Assessment of trends also requires validation that procedures for diagnosis and recording have not changed, such as laboratory confirmation or revision of the HMISs, and should also examine trends in other conditions to confirm that trends are not simply caused by changes in availability, accessibility, affordability, or quality of services.
| HOW CAN WE GATHER BETTER INFORMATION IN THE FUTURE? |
|
|
|---|
Sentinel sites. Trend estimation could be limited to selected health facilities, including some in the private sector, that are assisted in obtaining good quality information, with burden estimation based on parasitologically confirmed cases for a defined catchment population that has good access to the facility. Other indicators, including anemia, low birth weight, severe malaria, convulsions, and deaths, could also be tracked, and these routinely collected data supplemented by occasional household surveys. Sentinel sites can be chosen according to the results of malaria risk stratification to enable easier extrapolation of results nationally. A disadvantage of sentinel sites is that they can become unrepresentative if the information they generate leads to more intensive local interventions. One way to overcome this is to "rotate" sentinel sites (periodically replace a number of sites with other locations).
Quasi-population estimates of morbidity.
A recent development in monitoring intervention coverage has been to consider using children attending immunization clinics as a sample in which to ask questions from caregivers on whether their child slept under a bednet the night previously (or how children with fever were treated; M. Otten, personal communication). It has been proposed to add questions to the routine EPI report forms when children attend for the third dose of DPT (typically 10 weeks to 6 months old) or measles (9 months and over). Such a way of measuring intervention coverage is potentially biased, but coverage rates of malaria interventions have proven to be similar between vaccinated and unvaccinated children (unpublished data). It is possible that child morbidity could be monitored in a similar way, because analysis of DHS data suggests that estimates of prevalence of anemia and fever, measured in immunized children, are similar to those obtained for the population as a whole (Figure 3
). Several questions regarding the acceptability and effectiveness of monitoring for malaria at immunization clinics need to be considered, but children attending well-baby clinics have previously provided a continuous assessment of malaria morbidity at a local level, including parasite prevalence.27,28
|
| CONCLUSION |
|
|
|---|
Exploration of sentinel site methodology and the use of indirect methods may enhance future estimates of disease burden and trends. However, even if better data were available, it is uncertain whether it would make a difference to the operation of programs. Even now, the availability of data often exceeds the use made of it. The lack of use reflects more general weaknesses in planning and monitoring in the health sector, which needs to be addressed if monitoring is to influence decisions regarding resource allocation and use. Investment in data collection without a commensurate effort in decision-making processes is unlikely to yield significant returns; ultimately, it is quality of decision rather than quality of data that will help to reduce the malaria burden.
Received December 27, 2006. Accepted for publication July 5, 2007.
Disclosure: The authors are staff members of the WHO. The authors alone are responsible for the views expressed in this publication and they do not necessarily represent the decisions, policy, or views of the WHO.
* Address correspondence to Richard E. Cibulskis, 20 Avenue Appia, CH-1211 Geneva 27, Switzerland. E-mail: cibulskisr{at}who.int ![]()
Authors addresses: Richard Cibulskis and Maru Aregawi, Global Malaria Program, World Health Organization, 20 Avenue Appia, CH-1211 Geneva 27, Switzerland. Telephone: 41-22-791-2667, Fax: 41-22-791-4824, E-mail: cibulskisr{at}who.int. David Bell and Eva-Maria Christophel, World Health Organization, Regional Office for the Western Pacific, P.O. Box 2932, 1000 Manila, Philippines. Jeffrey Hii, World Health Organization, P.O. Box 22, Honiara, Solomon Islands. Charles Delacollette, World Health Organization, c/o Ministry of Public Health, Tiwanon Road, Muang, Nonthaburi 11000, Thailand. Nathan Bakyaita, World Health Organization, Regional Office for Africa, Cité du Djoué, P.O. Box 06, Brazzaville, Congo.
| REFERENCES |
|
|
|---|
This article has been cited by other articles:
![]() |
C. Biedron, M. Pagano, B. L Hedt, A. Kilian, A. Ratcliffe, S. Mabunda, and J. J Valadez An assessment of Lot Quality Assurance Sampling to evaluate malaria outcome indicators: extending malaria indicator surveys Int. J. Epidemiol., February 1, 2010; 39(1): 72 - 79. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. G. Breman, M. S. Alilio, and N. J. White Defining and Defeating the Intolerable Burden of Malaria III. Progress and Perspectives Am J Trop Med Hyg, December 1, 2007; 77(6_Suppl): vi - xi. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |