HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in ISI Web of Science Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (1) Citing Articles via Google Scholar Google Scholar Articles by Nahlen, B. L. Articles by Low-Beer, D. Search for Related Content PubMed Articles by Nahlen, B. L. Articles by Low-Beer, D.

Building to Collective Impact: The Global Fund Support for Measuring Reduction in the Burden of Malaria

ABSTRACT

TOP ABSTRACT INTRODUCTION CONCLUSION REFERENCES

 
The Global Fund to Fight AIDS, Tuberculosis, and Malaria was established in 2002 to fund substantial scaling-up coverage of proven and effective interventions to reduce infection, illness, and deaths in those communities most at risk. As of December 2006 the Global Fund has committed $2.6 billion over 5 years to support malaria prevention and control in 85 countries. The Global Fund has worked closely with Roll Back Malaria partners to develop consensus on a set of outcome and impact indicators that have been incorporated into malaria grant agreements. Although the Global Fund has recommended that 5–10% of grant funds be invested in improving the capacity of the national monitoring and evaluation systems, an average of only 3.9% is invested in these systems. Several countries are already demonstrating reductions in the malaria burden. To sustain the scale-up in funding to support malaria interventions, countries must ensure that resources are used now to show robust, systematic, and regular measurement of impact on the burden of malaria.

INTRODUCTION

TOP ABSTRACT INTRODUCTION CONCLUSION REFERENCES

 
The Global Fund to Fight AIDS, Tuberculosis, and Malaria was established in 2002 as the result of a global consensus that a new mechanism was needed to finance a massive and rapid international effort to prevent infection from the three diseases and provide treatment of those already infected. The Global Fund’s commitment to reducing the burden of the three diseases is clearly stated in the founding framework document: "The purpose of the Fund is to attract, manage, and disburse additional resources through a new public–private partnership that will make a sustainable and significant contribution to the reduction of infections, illness, and death, thereby mitigating the impact caused by HIV/AIDS, tuberculosis, and malaria in countries in need, and contributing to poverty reduction as part of the Millennium Development Goals".¹ In addition to clearly underlining the importance of showing impact, the Global Fund has provided unprecedented financing for malaria prevention and control.² As of December 2006, the Global Fund had already disbursed $865 million out of the $2.6 billion committed to support 126 malaria grants (including approved grants that are not yet signed) in 85 countries (Figure 1) over a 5-year period. Presently the Global Fund is the major source of external financing for malaria prevention and treatment globally, providing almost two thirds of the total amount.

View larger version (26K): [in this window] [in a new window]       FIGURE 1. Global Fund grants to support malaria prevention and control.

A core part of the Global Fund architecture is the Technical Evaluation Reference Group (TERG),³ which provides independent advice to the Board and Secretariat on monitoring and evaluation approaches and practices. In regard to impact evaluation, the TERG has clearly stated that, in assessing reduction in the burden of malaria morbidity and mortality as a result of country efforts to scale up coverage of prevention and control, the Global Fund should not attempt to evaluate the efforts of its contributions alone, but rather focus on the joint contributions of all relevant partners. Therefore, in working toward malaria goals and targets stated by RBM,⁴ the United Nations,⁵ the African Heads of State at the Abuja meeting in 2000,⁶ and the World Health Organization⁷ (Box 1), the Global Fund supports measurement of the "collective impact" of the work of the national program and implementing partners. This article lays out the important elements of its evaluation framework, the performance-based funding model, approaches to measuring impact supported by the Global Fund, and opportunities for use of Global Fund grants to support these activities.

KEY MALARIA CONTROL GOALS AND TARGETS Global Roll Back Malaria Partnership Strategic Plan By 2010 80% of people at risk for malaria are protected, thanks to locally appropriate vector control methods such as insecticide-treated nets (ITNs) and, where appropriate, indoor residual spraying (IRS) and, in some settings, other environmental and biological methods 80% of malaria patients are diagnosed and treated with effective antimalarial medicines (e.g., artemisinin-based combination therapy (ACT) within one day of the onset of illness) In areas where transmission is stable, 80% of pregnant women receive intermittent preventive treatment (IPT) Malaria burden is reduced by 50% compared to 2000 By 2015 Malaria morbidity and mortality are reduced by 75% in comparison with 2005, not only by national aggregate but particularly among the poorest groups across all affected countries Malaria-related MDGs are achieved, not only by national aggregate but also among the poorest groups across all affected countries Universal and equitable coverage with effective interventions United Nations Millennium Development Goals Goal 6, Target 8: to have halted by 2015 and begun to reverse the incidence of malaria and other major diseases Indicator 21. Prevalence and death rates associated with malaria Indicator 22. Proportion of population in malaria-risk areas using effective malaria prevention and treatment measures Abuja coverage targets (from the African Summit on Roll Back Malaria, April 2000) By 2005: At least 60% of those suffering from malaria should be able to access and use correct, affordable, and appropriate treatment within 24 hours of the onset of symptoms At least 60% of those at risk of malaria, particularly pregnant women and children under 5 years of age, should benefit from suitable personal and community protective measures such as ITNs At least 60% of all pregnant women who are at risk of malaria, especially those in their first pregnancies, should receive IPT World Health Assembly 2005 To establish national policies and operational plans to ensure that at least 80% of those at risk of, or suffering from malaria, benefit from major preventive and curative interventions by 2010 in accordance with WHO technical recommendations to ensure a reduction in the burden of malaria of at least 50% by 2010 and 75% by 2015

 

Evaluation framework of the Global Fund. The Global Fund has a 4-tiered implementation framework, spanning from the grant operation issues to measuring impact in terms of effects on disease-associated mortality and morbidity (Figure 2). The Global Fund evaluates the performance of its operational structures, such as the speed of disbursements, the grants it funds in terms of increasing people reached by services, and the effectiveness of country and partnership systems through which it implements (e.g., by measuring indicators for aid effectiveness).⁸ Ultimately the evaluation framework builds toward disease impact, including declining incidence and prevalence and mortality of HIV, TB, and malaria.

View larger version (26K): [in this window] [in a new window]       FIGURE 2. Global Fund Evaluation Pyramid.

Global Fund performance-based funding model. In establishing the framework for its performance-based funding model, the Global Fund has committed to harmonizing country reporting, data standards, and reporting platforms in a single monitoring and evaluation system. The Global Fund has developed an effective system for receiving proposals and managing and monitoring grants based on principles of accountability, transparency, and country ownership. All information on performance of each grant, together with the original grant proposal and legal agreement, are available on the Global Fund website (www.theglobalfund.org). The Global Fund implements performance-based funding according to targets and indicators defined and agreed to in the initial grant agreement. Funds are disbursed based on reported evidence of progress in meeting these targets. The typical grant funding is approved for a period of 5 years. This period is divided into 2 phases: initially, funds are committed for the first 2 years ("Phase 1") after which its performance is evaluated through an extensive review process. If performance in the first 2 years of the grant is considered adequate, additional funds are committed for the remaining 3 years ("Phase 2").

Early in the grant cycle as program activities are just beginning to scale-up, the primary focus of reporting is on input, process, and output indicators. Disbursement of funds is related to the speed of implementation rather than to a fixed calendar. If activities supported by the grant are implemented more rapidly than expected, funding can be accelerated. On the other hand, if performance in Phase 1 is inadequate and it is likely that the slow pace of implementation will continue during Phase 2 of the grant, additional funds may be withdrawn and reallocated to other grants that have demonstrated better performance. Ultimately, the success of the Global Fund will be determined by the contribution its investments have made, in coordination with the contributions of other partners, on reducing morbidity and mortality due to the 3 diseases over the course of the 5-year funding cycle. To measure this impact across its portfolio, the Global Fund ensures that grants entering Phase 2 of funding include impact measurement among performance indicators on which the grant recipients are required to report before the end of the 5-year grant cycle.

At 24 months in the grant life cycle, the Global Fund Secretariat conducts a complete review of grant performance, taking into account both quantitative results in meeting targets as well as contextual information, to decide on whether to continue funding for the remaining 3 years of the grant life cycle.⁹ As of November 2006, a total of 53 malaria grants had been evaluated for Phase 2 funding. They provide an important window into the performance and challenges of Global Fund investments (individual grant performance information is available at www.theglobalfund.org). Overall, 15% of the performance on malaria grants were rated as excellent (compared with 23% for all grants for the 3 diseases), 55% were satisfactory, 23% were inadequate, and 8% were unacceptable (Figure 3). Performance of malaria grants was hindered in the early stages of program implementation by significant procurement delays for long-lasting insecticide treated mosquito nets (ITNs) and for artemisinin-based combination treatments (ACTs). These delays were in part due to global supply issues, as well as to the need for national procurement systems to be further streamlined for more rapid action. However, once procurement delays and other early challenges were overcome, there are many examples of malaria grant implementation picking up speed and overcoming the initial delays.

View larger version (18K): [in this window] [in a new window]       FIGURE 3. Malaria grant performance ratings compared with all grants.

Global Fund support for impact evaluation. The Global Fund recognizes that reaching a high level of coverage of populations most affected by malaria with effective prevention such as ITNs will result in demonstrable reductions in the malarial illness and deaths within a relatively short period of time.¹¹ Countries such as Burundi, Eritrea, and Zanzibar have made major gains over the past 3–4 years in successfully scaling-up ITNs and access to more effective treatment with ACTs. These countries are already reporting dramatic impact on the malaria burden, with Burundi documenting a 39% reduction, Eritrea a 50% reduction, and Zanzibar a 34% reduction in malaria cases since 2000.⁸

As an active member of the RBM Monitoring and Evaluation Reference Group (MERG, www.rollbackmalaria.org), the Global Fund works closely with WHO and other technical partners in developing consensus on a set of outcome and impact indicators that are consistent with RBM guidance and the Millennium Development Goals. The indicators and measures to show impact recommended by the MERG have been included as priority components of its multi-partner monitoring and evaluation toolkit¹² (Table 1). Evaluation of impact on the disease burden focuses on reduction in malaria cases and deaths.

All-cause under-5 mortality is best measured by nationally representative household surveys such as the Demographic and Health Surveys¹³ (DHS) and the UNICEF Multiple Indicator Cluster Surveys¹⁴ (MICS), in addition to national census data when available. Both the DHS and the MICS include standardized questions on use of prevention and treatment as well as all-cause mortality among children under 5 years of age. The sample framework and size for a typical nationally representative household survey such as DHS is adequate to assess reductions of 15% or greater in under-5 mortality.¹⁵ To supplement data on all-cause under-5 mortality, the prevalence of childhood anemia¹⁶ and parasitemia are potentially useful survey-based indicators; DHS includes an option of including fingerstick blood sampling for malaria parasitemia screening and hemoglobin measurement. Coverage indicators are also measured in DHS and MICS, as well as in the Malaria Indicator Survey (MIS).¹⁷ The time trends in all-cause child mortality and intervention coverage could be used together to model the trend in malaria-specific mortality (and morbidity) in children under 5 years of age.¹⁸ Despite the complexity and costs involved, more malaria-endemic countries are conducting population-based surveys to provide the necessary data. However, DHS and MICS are usually conducted at 5-year intervals, and further investments will be required for additional survey data to better inform the evaluation of impact within the 2010 and 2015 time frames required by the RBM and MDG initiatives.

In areas where the overall healthcare system is more developed, where the majority of patients access the formal healthcare system, and where malaria diagnosis is generally laboratory-confirmed, malaria cases and deaths reported in the HIS may provide a good indication of the time trend in malaria incidence and malaria-attributable deaths, provided that reporting completeness is stable over time. It is unlikely, however, that even in these areas the national HIS would capture the full burden of morbidity and mortality. Thus, these areas could also benefit from investment in assessment of completeness of reporting of malaria cases and deaths.

The Global Fund has recommended that 5–10% of grant funds should be targeted to strengthening capacity for monitoring and evaluation systems.⁵ Thus, the US $2.6 billion committed for malaria grants in the first 6 rounds of funding provides the potential for a combined US$ 130–260 million to strengthen malaria monitoring and evaluation systems during this same time period in recipient countries. However, by mid 2006, across the entire grant portfolio, an average of only 3.9% of funds was being invested in monitoring and evaluation activities; thus, there is a large reservoir of potential financial support for strengthening monitoring and evaluation systems that remains untapped. The Global Fund works closely with the Health Metrics Network (www.who/int/healthmetrics) in a common effort to direct disease-specific investments to assist with strengthening the overall country HIS. At the country level, the RBM partnership in support of the National Malaria Control Program may engage in a variety of activities to build toward impact evaluation. These activities may include regular assessment of the completeness of reported data through HIS to produce better estimates of cases and deaths, as well as promotion of intermittent population-based surveys. Global Fund grant funds targeted for monitoring and evaluation are quite flexible and can be used for a range of activities, from assessment of surveillance systems to support for surveys to addition of laboratory testing where needed (Table 2).

1. Assess the portion of the grant spent on monitoring and evaluation, and justify if this is not in the 5–10% recommended range
   
2. With partners, carry out an assessment of the strengths and weaknesses and priority needs of the monitoring and evaluation system (a Monitoring and Evaluation Systems Strengthening Tool¹⁹ has been developed by the Global Fund with major partners to facilitate this process)
   
3. Define investments to strengthen the national HIS so that data is routinely reported at each level of the system with a known level of completeness
   
4. Use Global Fund money to support population-based surveys (e.g., DHS, MICS, MIS) as needed. These surveys should provide baselines and updates every 2–3 years
   
5. Ensure that analytical capacity is supported to analyze and report on the results of national data sets and surveys
   
6. Provide funds to support operational research to ensure " learning by doing" as interventions scale-up toward impact
   

Five-year evaluation of the Global Fund. In approving the Monitoring and Evaluation (M&E) Strategy in 2003, the Board of the Global Fund called for " a first major evaluation of the Fund’s overall performance against its goals and principles after at least one full grant funding cycle has been completed" . At its 14^th meeting in early November 2006, the Global Fund Board approved a framework document on the scale and scope of the Five-Year Evaluation.²⁰ One of three study areas for this ambitious evaluation addresses the overarching question: " What is the overall reduction of the burden of AIDS, tuberculosis, and malaria and what is the Global Fund’s contribution to that reduction?"

The impact evaluation component will involve a comprehensive assessment, focused on at least 20 selected countries,²¹ of the collective scale-up of prevention and treatment programs, and the reduction in overall disease burden of HIV/AIDS, tuberculosis, and malaria. Where possible, the share of Global Fund contributions relative to overall investments, and to other major contributors, will be mapped. The evaluation is not, however, focused on attribution of impact to any particular donor. Rather, the intention of this ambitious undertaking is to assess the overall impact of national programs, showing the contribution of all major sources of financial support, including the Global Fund as well as national and other international partners. Again, a major challenge to this is the fact that in many countries where large investments by the funding partners correspond with heavy malaria disease burden, the health infrastructure tends to be weak and reliable data are seldom readily available. Because most national malaria control programs in these high-burden countries have only recently received major financial support to scale-up activities, baseline data on the malaria burden may be non-existent or outdated. Thus, without investment in collection of relevant, good-quality baseline and follow-up data, the accurate quantification of significant malaria disease trends— the very foundation of an impact evaluation— will be difficult.

In at least 8 of the 20 selected countries there will be significant new investments to fill targeted data and information gaps through primary data collection in 2007.²¹ A major objective of the impact evaluation is to strengthen country capacity and systems for ongoing impact measurement. Thus, in addition to the existing grant monitoring and evaluation budgets in these countries, at least 75% of the impact evaluation budget will be made available for country-level investments in capacity strengthening. The final report on the impact evaluation will be presented to the Board in November 2008. The Global Fund intends for these collaborative efforts over the next 2 years to create an impetus for a sustained focus on impact evaluation that will extend beyond the initial group of countries and well into the next decade.

CONCLUSION

TOP ABSTRACT INTRODUCTION CONCLUSION REFERENCES

 
The Global Fund shares the goals of its partners to work collectively towards decreasing illness and deaths due to malaria, in line with the efforts of Roll Back Malaria partners and the Millennium Development Goals. In addition, the Global Fund is making unprecedented financial resources available to strengthen systems for surveillance, monitoring and impact evaluation. Global Fund grants in support of national programs should contribute to the intervention and impact measurement efforts defined by key partners and agreed to by countries. In all countries that are recipients of Global Fund grants there will be ongoing efforts to build more robust systems to capture trends in the coverage of malaria prevention and treatment tolls and subsequent decreases in the burden of malaria.

Countries urgently need the support of Roll Back Malaria technical partners in line with guidance from the MERG to define the key impact measurement tools, to prioritize areas for strengthening monitoring and evaluation systems, and to provide budgeted impact evaluation plans into which a portion of the 5– 10% of Global Fund program resources can be invested.

Countries also must embrace the importance of measuring impact and ensuring that baselines and surveys are in place as soon as possible. Substantial investments in scaling-up coverage of interventions should be accompanied by similar commitment and ambition to scale-up malaria impact evaluation efforts. Impact evaluation also provides critical information on how to better manage scaling-up of activities that still require evidence of effectiveness on a wider, national scale. In addition, the recent major increases in funding for malaria prevention and control are likely to be sustained only if trends toward significantly fewer cases of malarial illness and death are demonstrable in at least a few countries within the next 2– 3 years. The performance-based funding system of the Global Fund has strong incentives to promote flexibility in implementation, as long as countries continually prove the results and the impact of these investments. To sustain the scale-up in funding to support malaria interventions, partners and countries must ensure that resources are used now to show robust, systematic, and regular measurement of impact.

Received December 27, 2006. Accepted for publication June 28, 2007.

^* Address correspondence to Bernard Nahlen, Room 3.6-18 RRB, Washington DC 20523. E-mail: bnahlen{at}usaid.gov

Authors’ addresses: Bernard Nahlen, Room 3.6-18 RRB, Washington DC 20523, Tel: 202-712-5915, Fax: 202-216-3702, E-mail: bnahlen{at}usaid.gov. Daniel Low-Beer, Global Fund, Chemin de Blandonnet, 1214 Vernier, Geneva, Switzerland, Telephone: 41-22-791-1929, Fax: 41-22-791-1701.

REFERENCES

TOP ABSTRACT INTRODUCTION CONCLUSION REFERENCES

 

1. The Global Fund to Fight AIDS, Tuberculosis and Malaria, 2002. The framework document of the Global Fund to Fight, AIDS, Tuberculosis and Malaria. Geneva. Available at: www.theglobalfund.org/en/files/publicdoc/Framework. Accessed November 15, 2006.
2. World Health Organization and United Nations Children’s Fund 2005. World Malaria Report 2005. Geneva: World Health Organization. Report No. WHO/HTM/MAL/2005.1102. Available at: http://rbm.who.int/wmr2005. Accessed November 15, 2006.
3. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Technical evaluation reference group. Available at: www.the-globalfund.org/en/about/terg/. Accessed November 1, 2006.
4. Roll Back Malaria, 2005. Global Strategic Plan 2005– 2015. Geneva. Available at: http://www.rollbackmalaria.org/forumV/docs/gsp_en.pdf. Accessed November 15, 2006.
5. United Nations, 2005. UN millennium development goals. Available at: http://www.un.org/millenniumgoals/. Accessed November 15, 2006.
6. Roll Back Malaria, 2000. The African Summit on Roll Back Malaria. Geneva. Available at: http://www.rbm.who.int/docs/abuja_declaration_final.htm. Accessed November 15, 2006.
7. World Health Organization, 2005. World Health Assembly 2005 Resolutions and Decisions, WHA58.2. Geneva. Available at: http://www.who.int/gb/ebwha/pdf_files/WHA58/WHA58_2-en.pdf. Accessed November 15, 2006.
8. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Investing in Impact: Mid-Year Results Report. ISBN: 92-92224-050-1. Geneva: Global Fund to Fight Aids, Tuberculosis and Malaria.
9. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Guidelines for performance-based funding. Available at: http://www.theglobalfund.org/en/files/funds_raised/performance/phase2_qa.pdf. Accessed May 15, 2006.
10. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Rolling continuation channel. Available at: http://www.theglobalfund.org/en/files/boardmeeting14/GF-BM-14FinalDecisions.pdf. Accessed November 15, 2006.
11. Lengeler C, 2004. Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database of Systematic Reviews 2: CD000363.
12. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Monitoring and Evaluation Tool Kit, 2nd edition. ISBN 92-9224-029-3. Available at: http://www.theglobalfund.org/en/about/policies_guidelines/. Accessed November 1, 2006.
13. ORC MACRO-Measure DHS+. Demographic and Health Surveys (DHS). Measure DHS, 2006. Calverton, Maryland. Available at: www.measuredhs.com. Accessed December 6, 2006.
14. United Nations Children’s Fund, 2006. Multiple Indicator Cluster Surveys (MICS-2). New York, NY. Available at: www.childinfo.org/mics/mics3/. Accessed December 6, 2006.
15. Korenromp EL, Arnold F, Williams BG, Nahlen BL, Snow RW, 2004. Monitoring trends in under-5 mortality rates through national birth surveys. Int J Epidemiol 33: 1293–1301.[Abstract/Free Full Text]
16. Korenromp EL, Armstrong-Schellenberg JR, Williams BG, Nahlen BL, Snow RW, 2004. Impact of malaria control on childhood anaemia in Africa—a quantitative review. Trop Med Int Health 9: 1050–1065.[Web of Science][Medline]
17. Roll Back Malaria Monitoring and Evaluation Reference Group, 2005. Malaria Indicator Survey (MIS). Available at: http://www.who.int/malaria/docs/mis/cc9.pdf. Accessed October 15, 2006.
18. Jones G, Steketee RW, Black RE, Bhutta ZA, Morris SS and the Bellagio Chile Survival Study Group, 2003. How many child deaths can we prevent this year? Lancet 362: 65–71.[Web of Science][Medline]
19. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Monitoring and evaluation systems strengthening tool. Available at: http://www.theglobalfund.org/pdf/guidelines/M+E_Systems_Strengthening_Tool.pdf. Accessed November 1, 2006.
20. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2006. Technical background document on the scale and scope of the five-year evaluation of the Global Fund to Fight AIDS, Tuberculosis and Malaria. Available at: http://www.theglobalfund.org/en/files/terg/14_tech_report.pdf. Accessed November 15, 2006.
21. Global Fund to Fight AIDS, Tuberculosis and Malaria, 2007. Country selection process for the five-year evaluation. Available at: http://www.theglobalfund.org/en/files/terg/co_selection.pdf. Accessed May 15, 2007.

This article has been cited by other articles:

				J. G. Breman, M. S. Alilio, and N. J. White Defining and Defeating the Intolerable Burden of Malaria III. Progress and Perspectives Am J Trop Med Hyg, December 1, 2007; 77(6_Suppl): vi - xi. [Full Text] [PDF]

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in ISI Web of Science Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via ISI Web of Science (1) Citing Articles via Google Scholar Google Scholar Articles by Nahlen, B. L. Articles by Low-Beer, D. Search for Related Content PubMed Articles by Nahlen, B. L. Articles by Low-Beer, D.