INTRODUCTION
Diarrheal diseases cause a tremendous burden of illness in developing countries. The annual burden of diarrheal disease is estimated at 3.5 billion episodes and results in 1.8 million deaths in children worldwide.1,2 Prior reviews by Esrey and others3,4 and two systematic reviews5,6 suggest that between 20% and 35% of diarrhea episodes may be prevented by improved drinking water. Together, these findings have motivated the development and testing of numerous locally adapted water interventions and low-cost technologies to provide safe drinking water in developing countries. The systematic review of Fewtrell and others5 of water, sanitation, and hygiene interventions in developing countries found that point-of-use water treatment may be one of the most efficacious strategies to reduce diarrhea among people who lack access to safe water. The comprehensive review conducted by Clasen and others6 largely confirmed the findings by Fewtrell and others, reporting that point-of-use water treatment reduces diarrhea in people of all ages and in children < 5 years old.
A widely disseminated and tested method to improve the microbiologic quality of drinking water in the household is the use of dilute chlorine solution. Point-of-use chlorine disinfection uses one of two possible types of chlorine: sodium or calcium hypochlorite. Both compounds can be produced locally in developing countries. They are inexpensive, easy to distribute and use, and effective against most bacterial and viral pathogens.7 When added to water in tightly covered containers, volatilization is minimal, and chlorine disinfectants provide residual protection for many hours to days.7 The limitations of chlorine disinfection include limited effectiveness against parasites and reduced effectiveness, strong odor, and disagreeable taste in the presence of large quantities of organic material in the treated water.8 Chlorine disinfection is often combined with storage in a safe container (to prevent recontamination) and educational and motivational campaigns. This multi-faceted intervention, named the Safe Water System (SWS), was developed by the Centers for Disease Control and Prevention (CDC) and the Pan American Health Organization (PAHO).8–11 For the purpose of this study, we define point-of-use chlorine treatment as the addition of sodium or calcium hypochlorite to drinking water in the absence of a combined flocculant. We make this restriction because the treatment process differs sufficiently with the addition of a flocculant for us to consider the combined flocculant/disinfectant a separate intervention.
Here, we present the results of a systematic review and meta-analysis in which we evaluated the effects of point-of-use chlorine disinfection on the quality of water stored in the household and the evidence for health effects among children in less-developed countries. After the submission of the initial version of this manuscript, Clasen and others6 published their comprehensive systematic review that covers water quality interventions broadly and includes point-of-use chlorine treatment in children as subgroups in their analyses. Our review was conducted independently from the review by Clasen and others and, at points where the two analyses overlap, provides a rare opportunity to validate the two studies—an exercise that would be avoided, typically, to reduce duplication of research effort. The results presented here build on the review by Clasen and others by comparing health outcomes with water quality outcomes—a common proxy for health impacts. We also provide insight into the incremental effects of combining chlorine disinfection with safe storage and education and the effect of study length on the interventions’ impact on child diarrhea. Where appropriate, we use meta-analysis to derive summary effect estimates. We also use meta-analysis techniques to explore possible sources of heterogeneity in the effect estimates to better understand the varying results.
MATERIALS AND METHODS
Search strategy.
Database searches were conducted using the Cochrane Library, EMBASE, LILACS, Medline, and Web of Science with the keywords summarized in Table 1. The search conducted for this review targeted publications that addressed two primary outcomes: diarrheal disease in children and stored water quality. Two organizational web-sites were also searched: the Centers for Disease Control and Prevention’s (CDC) Safe Water System website (www.cdc.gov/safewater) and the World Health Organization’s (WHO) household water treatment and safe storage website (http://www.who.int/household_water/en). The final literature search was conducted on March 30, 2006. This review is limited to articles indexed before that date and to articles in English, Spanish, or French (the languages spoken by the authors). All titles and abstracts (if available) were examined, and the relevant articles were retrieved for review. After the database search, the bibliographies of relevant articles were searched to identify additional studies. No restrictions were put on study design, but studies were only analyzed if they included a comparison group for the intervention.
Selection criteria and data extraction.
Four selection criteria were applied to relevant studies: 1) the study was designed to evaluate point-of-use chlorine treatment of drinking water, defined as treatment with sodium or calcium hypochlorite in the absence of a combined flocculant; 2) the study took place in a less-developed country, defined as any country not within a Class A region in the 2002 World Health Report12; 3) the study was published in a refereed journal (to maintain quality through peer review and to improve transparency); and 4) the study included an outcome related to diarrheal disease in children (< 18 years old) or stored water quality.
Data related to the intervention and outcomes were extracted, tabulated, and, if appropriate, pooled using meta-analysis. The authors independently conducted unblinded, duplicate data extraction for a random sample of 50% of the publications using standardized forms and definitions. The duplicate entries had perfect correspondence in the subset of publications, so duplicate entry for the remaining publications was not conducted. If multiple articles described the same study, we extracted design details and used the most recent results in the analyses. As a conservative measure, if a single intervention trial included multiple arms with chlorine treatment, we reported data from all arms, but only one arm was included in meta-analyses. In cases where a single study reported results for multiple chlorine intervention arms, the most complete intervention (defined by the education or safe storage components) was used in the analyses. If a study reported multiple water quality estimates, the average of the estimates was used in the analysis. If a single study provided age-stratified estimates, the estimate from the youngest age category was used in the analysis of child diarrhea. If investigators did not report risk measures, we extracted the original data from the article and calculated the appropriate measure of relative risk (odds ratio, incidence density ratio, or cumulative incidence ratio) with a 95% confidence interval using standard techniques.13 If authors published adjusted relative risk estimates, our analysis used the estimate that adjusted for the most covariates. For all analyses, relative risks are expressed such that values < 1.0 indicate a reduction in disease or improvement in water quality that results from point-of-use chlorine treatment of drinking water. The comparison group in all analyses is traditional water use (no intervention treatment).
We evaluated the quality of each study using a set of criteria suggested by Blum and Feachem14 and previously implemented by Fewtrell and others.5 Health outcome studies were deemed poor quality if they had any of the following design flaws: inadequate or inadequately designed control groups, no clear measurement or control of confounders, no specific definition of diarrhea or the gastrointestinal health outcome used, or a recall period between the occurrence of illness and the recording of illness > 2 weeks. No study was excluded from the analysis on the basis of the quality criteria, but if possible, quality was examined as a source of heterogeneity between the results.
Meta-analysis.
The meta-analysis portion of the review focuses on two primary outcomes from point-of-use drinking water treatment using chlorine: 1) the intervention’s impact on child diarrhea and 2) stored water quality, assessed using the proportion of stored water samples with no detectable Escherichia coli. Mean concentrations of indicator bacteria were not analyzed in the water quality meta-analyses because only one study reported variances for bacteria concentration effect estimates.15
We pooled and analyzed risk estimates from selected studies using Stata software (version 9; Stata Corp., College Station, TX). We pooled health results across multiple measures of relative risk after determining that the outcomes were sufficiently rare in the study populations and assuming that exposure did not have a large effect on person-time at risk.13,16 We used fixed-effects and random-effects models with weights equal to the inverse of the variance to calculate a pooled effect of chlorine treatment on diarrhea incidence and water quality.17 We used a Mantel-Haenszel heterogeneity test using inverse variance weights to test for heterogeneity across study results. If the test for heterogeneity across study results was significant (defined conservatively as P < 0.20), we used random-effects estimates to summarize the data. We evaluated publication bias using the Begg test, with P < 0.20 indicating the potential presence of bias.18 The influence of individual studies was evaluated by serially excluding each result and re-estimating the pooled effect.
Subgroup analyses and meta-regression were used to explore possible sources of heterogeneity across study results. Specifically, study quality, the length of the intervention, the setting of the intervention (rural, peri-urban, or urban), baseline diarrhea rates in the control group, use of a safe storage container in the intervention, inclusion of an educational or motivational component in the intervention, and proportion of stored water samples in the intervention group with detectable free chlorine (a measure of compliance) were defined a priori as potential sources of heterogeneity and, where possible, explored in the analysis. All significance tests were evaluated using a conservative Bonferroni correction for multiple hypothesis tests (dividing the α level of 0.05 by the number of comparisons).
RESULTS
Search results.
The broad search criteria identified 17,058 publications. An initial title screen yielded 856 publications that were screened by abstract (if available). A total of 50 publications were reviewed in full, and 22 publications (representing 20 studies) met the inclusion criteria. Publications were excluded because they were reviews or editorials (13),5,8,10,11,19–27 did not have diarrhea or water quality outcomes (6),28–33 were not published in refereed journals (4),34–37 did not have child health outcomes (2),38,39 or did not test point-of-use chlorine treatment (3).40–42 The final studies were conducted in 13 different countries and a variety of settings (Tables 2 and 3). Of the final 22 publications, 12, representing 10 studies, included child health outcomes and diarrhea was the only health endpoint (Table 2).43–54 We validated our search results by applying our selection criteria to the population of studies identified by Clasen and others6 and found perfect correspondence. The definition of children varied across studies, with the youngest age definition < 1 year and the oldest age definition < 15 years. With one exception,45 all studies showed a protective effect of point-of-use chlorine treatment on child diarrhea (Table 2). A single study measured diarrhea outcomes but did not provide child-specific estimates.55 It was used in the water quality analysis, but it was not included in the child health outcome meta-analysis. A single study provided estimates stratified by HIV status, and the estimate for HIV negative children was used in the meta-analysis.48
Eight studies included both child health and water quality outcomes,43,45,48–53 and 10 additional studies included only water quality outcomes.15,55–63 By all measures of indicator bacteria (E. coli, fecal coliforms, total coliforms), point-of-use chlorine treatment dramatically improved stored water quality in the 18 studies (Table 3).
Two studies included multiple intervention arms with point-of-use chlorine treatment; in both cases, only one arm from each trial was included in the pooled effect estimates. Reller and others51 included chlorine treatment arms with and without safe storage, and the treatment arm with safe storage (the more extensive intervention) was included in the analysis. Luby and others46 included chlorine treatment arms with safe storage in an imported vessel and safe storage with a local vessel. The treatment arm with the imported vessel was included in the analysis because the length of study using that intervention arm was longer (34 versus 26 weeks), and the local vessel was not part of the originally planned trial. We also excluded from our analysis the second year of follow-up in the original intervention arm of Luby and others because the intervention population during the second year of the study was a mixed set of new and long-term participants; this mixed level of experience in the intervention group during the second year was inconsistent with other studies included in this review.
Quality of publications.
Two studies did not have a specific definition of diarrhea and instead had mothers in the study define episodes of diarrhea for their children.43,51 Of the remaining nine studies deemed to have adequate outcome definitions, eight defined an episode of diarrhea as the occurrence of either three or more loose or watery stools or one bloody stool, in a 24 hour period, and one defined an episode as a significant change in bowel habits marked by an increased frequency or decreased consistency.45 In all studies, outcomes were reported by the mother, and there were no data with which the possibility of resulting measurement error of the outcome could be assessed. With regard to our second quality criteria, Sobsey and others53 described control for potential confounders during the analysis phase but only presented unadjusted risk estimates in the published article. However, the paper published by Sobsey and others summarizes two intervention trials, one that was included separately in this review50 and a second that was not published in a refereed journal but was readily available online. The second study, which took place in Bangladesh, was also published by Handzel as a PhD dissertation with detailed methods and adjusted risk estimates.44 We chose a conservative approach by using the adjusted risk estimate from Handzel in the analysis because its point estimate was similar to the unadjusted estimate (0.67 versus 0.78), but its variance was three times larger, likely reflecting a proper adjustment for repeated measurements on individuals.44
Diarrhea in children.
Point-of-use chlorine treatment of drinking water reduced diarrhea in children in 9 of 10 studies identified, and the effect was statistically significant in 5 of the studies (Figure 1). The Mantel-Haentzel test for heterogeneity indicated that there was significant heterogeneity across studies (X2(9) = 38.10, P < 0.001). In addition, the I2 statistic, which estimates the fraction of the variation in the effect estimate caused by heterogeneity, indicated that heterogeneity accounted for 76% of the variation in these data.64 As a result of this observed heterogeneity, a random effects model was used to calculate a pooled effect estimate.65 The pooled effect estimate across the 10 studies indicated that point-of-use treatment of drinking water with chlorine reduces diarrhea in children by 29% (relative risk, 0.71; 0.58–0.87). There was no evidence of publication bias based on the Begg test (Z = −0.63, P = 0.53), and sensitivity analysis indicated that no single study had a disproportionate impact on the summary effect estimate (results available from the authors).
There were a sufficient number of studies to evaluate possible sources of heterogeneity in the effect using subgroup and meta-regression analyses. Inclusion of a safe-storage vessel and inclusion of an educational or motivational component in the intervention were perfectly collinear in the data: every study that included safe storage also included education or motivation. It is impossible to disentangle their independent effects using these data, but it was still possible to conduct analysis on their joint effect. Similar near-collinearity between safe storage, education, and rural setting was also present in the data: of the five studies conducted in a rural setting, three did not include safe storage or education. Because of this lack of variability in the study designs, we recommend that results from the subgroup analyses of setting and safe storage/education should be used for hypothesis generation only.
Restricting the analysis to only high-quality studies (adequate control group, control for confounders, clear outcome definition, and < 2-week recall period) resulted in a relative risk estimate of 0.66 (0.51–0.87).45–50,52,53 Additional subgroup analyses suggest an enhanced effect of safe storage and education and urban or peri-urban settings. The pooled random effects estimate from the seven studies that included safe storage and education was 0.65 (0.46–0.80),46–48,50–53 which was larger than the pooled estimate for chlorine treatment alone (without safe storage or education; relative risk, 0.87; 0.62–1.22).43,45,49 The three studies conducted in urban or peri-urban settings showed a larger effect (relative risk, 0.63; 0.50–0.80).46,47,50,53 than the five studies that were conducted in rural settings (relative risk, 0.89; 0.71–1.13).43,45,48,49,51 Subgroup analyses of the effect by child age definition yielded similar results to the pooled analysis but with less precision because of fewer studies: < 5 years (relative risk, 0.71; 0.56–0.89)43,45,47–53; < 3 years (relative risk, 0.81; 0.61–1.06)43,45,47,48,50,51; < 2 years (relative risk, 0.80; 0.59–1.08)43,45,47,50,51; < 1 year (relative risk, 0.69; 0.44–1.09).47,50,51
We did not evaluate underlying risk as a possible source of heterogeneity because the variance in the log baseline rates of diarrhea in control groups across studies was sufficiently small (μ = 1.12, σ = 1.53) to bias their use as a measure of underlying risk caused by regression to the mean.66 Although Bayesian techniques exist to address this issue, they are beyond the scope of this analysis, given its relatively small number of studies.66
In this analysis, there are 10 studies with child diarrhea outcomes and a large degree of heterogeneity between estimates (I2 = 0.76), a scenario that may reduce the validity of meta-regression models with multiple covariates.67 Consequently, we conducted only bivariate analyses using the continuous covariates of intervention length and proportion of water samples with detectable free chlorine with the understanding that they should be used mainly for hypothesis generation. This is consistent with the overall limitation of observational analyses, which in this context cannot evaluate causal relationships between trial level attributes.68
Figure 2 plots the effect size against study length and the fraction of water samples with detectable free chlorine (a measure of compliance). The meta-regression of the bivariate association between intervention length (weeks) and child diarrhea identified an attenuation of the reduction of child diarrhea among studies of longer length (relative risk of a 10-week increase, 1.07; 0.96–1.19; N = 10 studies, τ2 = 0.0661; proportion of heterogeneity explained = 0.23). The intervention’s effectiveness was enhanced among studies with a larger fraction of water samples with detectable free chlorine, a measure of compliance (relative risk of a 10% increase, 0.90; 0.77–1.05; N = 6 studies, τ2 = 0.0767; proportion of heterogeneity explained = 0.20). Neither result is statistically significant at the 95% confidence level after Bonferroni correction.
Water quality.
Consistent with its effect on child diarrhea, point-of-use treatment of drinking water with chlorine improved water quality in nearly all studies and all measurements reviewed (Table 3). There exists significant heterogeneity in the effect across water quality studies (X2(9) = 98.48, P < 0.001; I2 = 0.91) and so we used a random-effects model to estimate a pooled effect of the intervention on the probability of testing positive for E. coli contamination in stored water samples (Figure 3). Across the 10 studies, the intervention led to an 80% reduction in the proportion of stored water samples with detectable E. coli (relative risk, 0.20; 0.13–0.30). The results from the Begg test indicated that there was no evidence of publication bias in water quality studies (Z = −0.98, P = 0.33), and sensitivity analysis indicated that no single study had a disproportionate impact on the summary effect estimate (results available from the authors).
Subgroup analyses produced highly consistent effect estimates across all study subgroups. Restricting the analysis to just randomized controlled field trials by excluding the two controlled experimental studies56,57 resulted in a relative risk of 0.21 (0.14–0.32). The eight studies that included safe storage and education in addition to chlorine disinfectant had a pooled relative risk of 0.19 (0.12–0.31),48,50,51,53,55,57,58,61 and the two studies that did not include safe storage or education (chlorine alone) had a pooled relative risk of 0.25 (0.19–0.32).43,56 The observed differences between rural and urban/peri-urban settings in the intervention’s effect on child diarrhea were not apparent in the E. coli contamination outcome. The pooled relative risk of E. coli contamination among the five rural studies was 0.21 (0.12–0.38).43,48,51,56,61 Among the five urban and peri-urban studies, the relative risk was 0.18 (0.10–0.33).50,53,55,57,58 There was minimal difference in the effect estimates and confidence intervals between studies that measured the proportion of samples with detectable E. coli and studies that measured the proportion of samples with > 1 E. coli per 100 mL (results available from the authors).
DISCUSSION
One difficulty of systematic reviews and meta-analyses is their attempt to synthesize results from data that were collected under widely varying conditions. In this review, the intervention of interest—point-of-use chlorine treatment of drinking water to improve water quality and reduce diarrhea in children—was implemented using different strategies in a large number of developing countries around the world (Tables 2 and 3). Although it is important to be aware of this potential pitfall in meta-analysis, our finding of a near-universal protective effect across very different conditions, populations, and investigators suggests that the intervention effectively reduces diarrhea in children. Similarly strong evidence of a beneficial effect was also seen when we used E. coli contamination as the outcome.
The pooled effect of point-of-use chlorine treatment on child diarrhea indicates a 29% reduction in risk (relative risk, 0.71; 0.58–0.87) compared with traditional practices (Figure 1). The results from this review are consistent with findings from two broader reviews of water interventions in developing countries.5,6 Fewtrell and others5 found a pooled effect for household water treatment of 0.65 (0.48–0.88). This consistency is probably because of important overlap: 5 of the 12 studies included in the pooled estimate calculated by Fewtrell and others were also included in this analysis.45,49,50,52,53 Our search results and findings are also consistent with those of Clasen and others,6 although direct comparison is difficult because they report results stratified by measure of relative risk and include multiple arms from the same trials in some of their comparisons. Clasen and others6 reported pooled effects in children < 5 years that range between 0.48 (0.33–0.68) and 0.91 (0.82–1.02). Our pooled estimate for children < 5 years (relative risk, 0.71; 0.56–0.89) falls near the center of this distribution, which would be predicted because the estimates are derived from the same population of studies. Taken together, these findings support a growing consensus that household water treatment methods may be a key transitional precursor to large capital water projects for the large fraction of the world’s population who currently lacks access to clean water.8 At the very least, such treatment methods offer an evidence-supported choice for interim protection while millions of families continue to await large-scale system-wide projects.
The difference between the intervention’s impact on water quality (relative risk, 0.20; 0.13–0.30) and child diarrhea (relative risk, 0.71; 0.58–0.97) likely arises from imperfect compliance and competing, non–water-borne causes of diarrheal disease. Indeed, we observed larger reductions in child diarrhea with better compliance (Figure 3B) as did Clasen and others.6 It is also possible that alternate pathways such as person-to-person or environment-to-person may be important for infants and school aged children. Even among water-borne pathogens, E. coli is just one of many pathogens that cause diarrhea. Point-of-use chlorine treatment is not highly effective against parasites,8 and if parasites are an important cause of gastrointestinal infection, the reductions in E. coli contamination would not translate directly into health effects. The large difference in the intervention’s impact between water quality and child diarrhea suggests that water quality is an insufficient surrogate for child health improvements in this context.
An important limitation of nearly all the health outcome studies in this review is that the outcomes were reported by participants, and in all but one study,45 the control groups were not blinded to the intervention. This combination of factors can potentially lead to differential misclassification of the outcome if participants or assessors realize that the reduced diarrhea is a “desirable outcome” of the intervention.69 If differential misclassification occurs, it would likely bias the effect away from the null, and the estimated effect sizes may be larger than their true values. The single-blinded study in our analysis45 found no effect of the intervention, which is consistent with this potential problem. A second blinded trial from Gambia34 that was not published in refereed journals but was reported in the review by Clasen and others6 also found no effect of point-of-use chlorine treatment in children (relative risk, 1.05; 0.25–4.35). The challenge in this context is that it is impossible to blind participants to the use of improved vessels or educational materials—potentially important complementary interventions for chlorine treatment. Where possible, participants should be blinded to their treatment assignments, and if blinding is impossible, trials would be improved by validation studies to estimate the degree of bias resulting from the use of unblinded, self-reported outcomes.
We found heterogeneity across studies in both diarrhea and water quality outcome measures. Although our subgroup analyses and meta-regression results explain some of the variability between health outcome studies, much of the heterogeneity likely arises from site-specific differences in cultural practices, pre-intervention conditions, and underlying risk from water exposure. We view the results of the heterogeneity analyses as primarily hypothesis-generating because of the small number of studies and the relatively small amount of variability in the design across studies. Some of this homogeneity in design is an artifact of our analysis groupings. For example, there is large variability in the form of education included with the chlorine water treatment intervention: Semenza and others52 provided hygiene education to intervention households (no additional information specified), but Luby and others47 had an extensive education and motivational component, which combined twice-weekly visits to intervention households with community education using slides, videos, and pamphlets. Ideally our analysis would account for this type of variability, but it is impossible to do so without a larger number of studies.
An important question raised by our analysis is whether the large health impacts observed during shorter trials persist over longer periods. With two exceptions, nearly all of the trials to date have been relatively short—the longest was 20 months and the median length was 6 months (Table 2). Figure 3 shows an attenuated effect in the reduction of child diarrhea among longer trials, but this finding lacks a causal interpretation and could be confounded by other trial attributes.68 This trial-level data contrasts with the hypothesis that technical mastery and habituation of the interventions increases with time, so increased effectiveness should be observed with longer follow-up; a hypothesis with some support from individual-level data.46,47,70 However, an alternate hypothesis is that the diminished effectiveness of the intervention over longer time periods could result from gradual lack of interest among participants leading to lower compliance, or ultimately, abandonment of the intervention. It could also result from variable effectiveness of the intervention across different seasons. For example, the longest study in this review documented negligible differences between intervention and control group diarrhea prevalence during the peak of the rainy season but found large differences during other seasons.47 This type of common seasonal trend could diminish the measured health effects observed in longer trials compared with shorter trials if the shorter trials were conducted during seasons in which the differences were greatest. Only long-term follow-up of health and behavioral outcomes among individuals can resolve this important question. Further advances in this field will also require validation of self-reported health outcomes and assessment of long-term acceptability and sustainability of health impacts shown by the shorter trials identified in this review. Ultimately the development of strategies for large-scale programmatic dissemination of this water treatment method must incorporate these findings into their design and evaluation.
Search terms used to identify studies, following the PICO format
Patient | ||||
Child | Developing countries | |||
Childhood | Pediatric | |||
Children | ||||
Intervention | ||||
Chemical disinfectants | Disinfectant | Inactivation | Sanitation | Water purification |
Chlorate | Disinfection | Motivational interviewing | Sodium hypochlorite | Water quality |
Chlorination | Drinking water | Point of use | Storage | Water treatment |
Chlorine | Drinking water storage | Safe storage | Vessel | |
Chlorite | Hypochlorite | Safe water | Water | |
Comparison (None specified) | ||||
Outcome | ||||
Campylobacter | Cryptosporidium parvum oocysts | Enteric viruses | Gastrointestinal | Salmonella |
Cholera | Diarrhea | Enteroviruses | Giardia | Shigella |
Coliform counts | Diarrheal disease | Escherichia coli | Helicobacter pylori | Vibrio cholerae |
Contamination | Diarrhoea | Fecal | Hepatitis | Waterborne pathogens |
Cryptosporidium | Domestic contamination | Fecal contamination | Heterotrophic bacteria | |
Cryptosporidium parvum | E. coli | Gastro intestinal | Rotaviruses |
Studies of point of use chlorine water treatment with child diarrhea outcomes
Reference | Country (setting) | Study length | Number of households* | Safe storage | Education | Age group | Measure | Estimate (95% CI)† |
---|---|---|---|---|---|---|---|---|
* Intervention group + control group. | ||||||||
† With the exception of Lule and others 2004, the comparison group is traditional use. In Lule and others 2004, the comparison group is traditional use with sanitation and hygiene education. | ||||||||
‡ Calculated. | ||||||||
§ Result used for overall meta-analysis of pooled effect in children. | ||||||||
¶ Omitted from meta-analysis because of multiple trial arms in a single study. | ||||||||
** Education started at week 12 after poor initial compliance. | ||||||||
†† Calculated by combining estimates from two stratified groups. | ||||||||
All studies are randomized controlled trials. CIR, cumulative incidence ratio; IDR, incidence density ratio; OR, odds ratio; PR, prevalence ratio; NR, not reported. | ||||||||
Kirchhoff and others 198545 | Brazil (rural) | 18 weeks | 20 | None | None | < 2 years 2–4 years 5–9 years 10 years All ages | RR‡ RR‡ RR‡ RR‡ RR‡ | 1.16 (0.88–1.53)§ 0.71 (0.47–1.08) 1.80 (1.02–3.17) 1.78 (0.95–3.34) 1.07 (0.88–1.31) |
Mahfouz and others 199549 | Saudi Arabia (rural) | 26 weeks | 171 | None | None | < 5 years | OR | 0.51 (0.26–1.00)§ |
Semenza and others 199852 | Uzbekistan (unstated) | 9.5 weeks | 120 | Imported vessel | Hygiene education | < 5 years All ages | RR RR | 0.33 (0.19–0.57)§ 0.15 (0.07–0.31) |
Quick and others 199950 Sobsey and others 200353 Venczel, 199754 | Bolivia (peri-urban) | 21 weeks | 127 | Imported vessel | Hygiene education | < 1 years 1–4 years 5–14 years 15–44 years 45 years All ages | RR‡ RR‡ RR‡ RR‡ RR‡ OR | 0.46 (0.36–0.60)§ 0.95 (0.79–1.15) 0.40 (0.23–0.69) 0.87 (0.40–1.92) 0.37 (0.14–0.98) 0.57 (0.39–0.84) |
Reller and others 200351 | Guatemala (rural) | 52 weeks | 196 | Imported vessel | Weekly visits motivation/edu.** | < 1 year All ages | OR OR | 0.92 (0.66–1.30)§ 0.97 (0.76–1.26) |
Reller and others 200351 | Guatemala (rural) | 52 weeks | 193 | None | Weekly visits motivation/educ.** | < 1 year All ages | OR OR | 0.77 (0.56–2.08)¶ 0.74 (0.59–0.92) |
Sobsey and others 200353 Handzel, 199844 | Bangladesh (urban) | 35 weeks | 275 | Imported vessel | 3 × per week Reinforcement | < 5 years | OR | 0.67 (0.53–0.83)§ |
Luby and others 200446 | Pakistan (urban) | 34 weeks | 152 | Imported vessel | Slides, videos, pamphlets, weekly visits | < 15 years | RR†† | 0.71 (0.52–0.96)§ |
Luby and others 200446 | Pakistan (urban) | 26 weeks | 205 | Local vessel | Slides, videos, pamphlets, weekly visits | < 15 years | IDR | 0.60 (0.37–0.84)¶ |
Crump and others 200543 | Kenya (rural) | 20 weeks | 404 | None | None | < 2 years All ages | RR‡ RR‡ | 0.83 (0.71–0.98)§ 0.74 (0.67–0.82) |
Lule and others 200548 | Uganda (rural) | 87 weeks | 392 | Imported vessel | Hygiene & sanitation education | < 3 years (HIV−) 3–12 years (HIV−) 13–59 years (HIV−) > 59 years (HIV−) All ages (HIV−) < 5 years (HIV+) ≥ 5 years (HIV+) All ages (HIV+) All participants | IDR IDR IDR IDR IDR IDR IDR IDR IDR | 0.90 (0.51–1.59)§ 0.60 (0.38–0.94) 1.15 (0.57–2.33) 0.41 (0.16–1.02) 0.84 (0.58–1.22) 0.70 (0.23–2.10) 0.79 (0.62–0.98) 0.75 (0.59–0.94) 0.80 (0.64–1.00) |
Luby and others 200647 | Pakistan (urban) | 34 weeks | 547 | Local vessel | Slides, videos, pamphlets, bi-weekly visits | < 1 year 1–2 years 2–5 years 5–15 years > 15 years All ages | PR PR PR PR PR PR | 0.80 (0.52–1.14)§ 0.68 (0.43–1.00) 0.54 (0.31–0.86) 0.33 (0.02–0.80) 0.45 (0.03–1.32) 0.45 (0.20–0.82) |
Studies of point of use chlorine water treatment with water quality outcomes
CFU per 100 mL water* | Number (%) of stored water samples with detectible E. coli | |||||||
---|---|---|---|---|---|---|---|---|
Reference, by indicator bacteria | Country (setting) | Safe storage | Measure | Baseline | Intervention | Percentage of intervention samples with detectible free chlorine | Control | Intervention |
* CFU, colony–forming units. Samples from stored water except the baseline estimates from Crump and others 2004, which are measurements from source water. | ||||||||
† Proportion of samples with > 1 E. coli per 100 mL of drinking water. | ||||||||
‡ Excluded from meta-analysis because number of samples in control group not reported. | ||||||||
§ Included in over-all meta-analysis. | ||||||||
¶ Omitted from meta-analysis due to multiple trial arms in a single study. | ||||||||
RCT, randomized controlled trial; EXP, controlled experiment; CS, cross-sectional; NA, not applicable; NR, not reported. | ||||||||
Eschericia coli | ||||||||
Mahfouz and others 199549 | Saudi Arabia (rural) | None | NR | NR | NR | 100 | NR (100) | 15 (3)‡ |
Quick and others 199615 | Bolivia (peri-urban) | Imported vessel | Geometric Mean | 28 | 2.2 | 93 | NR | NR |
Daniels and others 199957 | Guinea-Bissau (urban) | Imported vessel | Geometric Mean | 6,200 | 0 | NA | 29 (97) | 0 (0)§ |
Quick and others 199950 Sobsey and others 200353 | Bolivia (peri-urban) | Imported vessel | Median | 9,200 | 0 | 77 | 61 (94) | 21 (34)§ |
Lubv and others 200158 | Pakistan (urban) | Imported vessel | Geometric Mean | 7 | 0.5 | 91 | 295 (76) | 6 (3)†,§ |
Mong and others 200159 | Madagascar (rural) | Local vessel | Median | 13 | 0 | 45 | NR | NR |
Ogutu and others 200160 | Kenya (rural) | None | Median | 100 | 0 | NA | NR | 2 (20) |
Ogutu and others 200160 | Kenya (rural) | Imported vessel | Median | 100 | 0 | NA | NR | 0 (0) |
Quick and others 200255 | Zambia (peri-urban) | Imported vessel | Median | 44 | 0 | 78 | 19 (95) | 12 (31)§ |
Rangel and others 200361 | Guatemala (rural) | Imported vessel | Geometric Mean | 324 | 6 | 83 | 57 (95) | 5 (8)†,§ |
Reller and others 200351 | Guatemala (rural) | Imported vessel | Median | 73 | NR | 44 | 239 (93) | 88 (39)†,§ |
Reller and others 200351 | Guatemala (rural) | None | Median | 53 | NR | 36 | 239 (93) | 106 (49)¶ |
Sobsey and others 200353 Handzel, 199844 | Bangladesh (urban) | Imported vessel | Geometric Mean | 39 | 1 | 89 | 440 (55) | 103 (13)§ |
Crump and others 200456 | Kenya (rural) | None | Mean | 3,938 | 0.5 | NA | 28 (93) | 5 (17)†,§ |
Crump and others 200543 | Kenya (rural) | None | Mean | 116 | NR | 61 | 166 (86) | 44 (22)†,§ |
Lule and others 200548 | Uganda (rural) | Imported vessel | Median Mean | 248 5,117 | 23 504 | NR | 43 (54) | 4 (7)§ |
Fecal Coliforms | ||||||||
Kirchhoff and others 198545 | Brazil (rural) | None | Mean | 1,600,000 | 7,000 | NR | ||
Quick and others 199615 | Bolivia (peri-urban) | Imported vessel | Geometric Mean | 34 | 2.2 | 93 | ||
Semenza and others 199852 | Uzbekistan (unstated) | Imported vessel | Mean | 54 | 52 | 73 | ||
Sobel and others 199863 | Guatemala (urban) | Imported vessel | Geometric Mean | 7 | 2 | NR | ||
Roberts and others 200162 | Malawi (refugee camp) | None | Mean | 625 | 250 | NA | ||
Total Coliforms | ||||||||
Sobel and others 199863 | Guatemala (urban) | Imported vessel | Geometric Mean | 54 | 3 | |||
Daniels and others 199957 | Guinea-Bissau (urban) | Imported | Geometric vessel | 34,000,000 Mean | 360 | NA | ||
Luby and others 200158 | Pakistan (urban) | Imported vessel | Geometric Mean | 9,397 | 47 | 91 | ||
Crump and others 200456 | Kenya (rural) | None | Mean | 25,553 | 12 | NA |

Random effects meta-analysis of point-of-use chlorine drinking water treatment and child diarrhea.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354

Random effects meta-analysis of point-of-use chlorine drinking water treatment and child diarrhea.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354
Random effects meta-analysis of point-of-use chlorine drinking water treatment and child diarrhea.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354

The effect of point-of-use chlorine treatment on child diarrhea by length of intervention (A) and proportion of intervention households with detectable free chlorine (B). The area of each circle reflects the study weight in the random effects meta-analysis.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354

The effect of point-of-use chlorine treatment on child diarrhea by length of intervention (A) and proportion of intervention households with detectable free chlorine (B). The area of each circle reflects the study weight in the random effects meta-analysis.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354
The effect of point-of-use chlorine treatment on child diarrhea by length of intervention (A) and proportion of intervention households with detectable free chlorine (B). The area of each circle reflects the study weight in the random effects meta-analysis.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354

Random effects meta-analysis of point-of-use chlorine drinking water treatment and E. coli contamination of stored water.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354

Random effects meta-analysis of point-of-use chlorine drinking water treatment and E. coli contamination of stored water.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354
Random effects meta-analysis of point-of-use chlorine drinking water treatment and E. coli contamination of stored water.
Citation: The American Journal of Tropical Medicine and Hygiene Am J Trop Med Hyg 76, 2; 10.4269/ajtmh.2007.76.354
Address correspondence to John M. Colford Jr., Division of Epidemiology, School of Public Health, University of California, Berkeley, 140 Warren Hall 7360, Berkeley, CA 94720-7360. E-mail: jcolford@berkeley.edu
Authors’ addresses: Benjamin F. Arnold, Division of Epidemiology, School of Public Health, University of California, Berkeley, 140 Warren Hall 7360, Berkeley, CA 94720-7360, E-mail: benarnold@berkeley.edu. John M. Colford Jr., Division of Epidemiology, School of Public Health, University of California, Berkeley, 140 Warren Hall 7360, Berkeley, CA, 94720-7360, E-mail: jcolford@berkeley.edu.
Acknowledgments: We are grateful for the useful comments that Catherine Wright provided during preparation of the manuscript. We also appreciate the detailed and constructive feedback provided by the editors and referees of this journal.
REFERENCES
- 1↑
Kosek M, Bern C, Guerrant RL, 2003. The global burden of diarrhoeal disease, as estimated from studies published between 1992 and 2000. Bull World Health Organ 81 :197–204.
- 2↑
World Health Organization, 2005. The World Health Report 2005. Geneva: World Health Organization.
- 3↑
Esrey SA, Feachem RG, Hughes JM, 1985. Interventions for the control of diarrhoeal diseases among young children: Improving water supplies and excreta disposal facilities. Bull World Health Organ 63 :757–772.
- 4↑
Esrey SA, Potash JB, Roberts L, Shiff C, 1991. Effects of improved water supply and sanitation on ascariasis, diarrhoea, dracunculiasis, hookworm infection, schistosomiasis, and trachoma. Bull World Health Organ 69 :609–621.
- 5↑
Fewtrell L, Kaufmann RB, Kay D, Enanoria W, Haller L, Col-ford JM Jr, 2005. Water, sanitation, and hygiene interventions to reduce diarrhoea in less developed countries: A systematic review and meta-analysis. Lancet Infect Dis 5 :42–52.
- 6↑
Clasen T, Roberts I, Rabie T, Schmidt W, Cairncross S, 2006. Interventions to improve water quality for preventing diarrhoea. Cochrane Database Syst Rev 3 :CD004794.
- 7↑
Sobsey MD, 1989. Inactivation of health-related microorganisms in water by disinfection processes. Water Sci Technol 21 :179–195.
- 8↑
Mintz E, Bartram J, Lochery P, Wegelin M, 2001. Not just a drop in the bucket: Expanding access to point-of-use water treatment systems. Am J Public Health 91 :1565–1570.
- 9
Centers for Disease Control, 2005. Safe Water Systems for the Developing World: A Handbook for Implementing Household-Based Water Treatment and Safe Storage Projects. Atlanta, GA: Centers for Disease Control and Prevention.
- 10↑
Reiff FM, Roses M, Venczel L, Quick R, Witt VM, 1996. Low-cost safe water for the world: a practical interim solution. J Public Health Policy 17 :389–408.
- 11↑
Thompson T, Sobsey M, Bartram J, 2003. Providing clean water, keeping water clean: an integrated approach. Int J Environ Health Res 13 (Suppl 1):S89–S94.
- 14↑
Blum D, Feachem RG, 1983. Measuring the impact of water-supply and sanitation investments on diarrheal diseases—problems of methodology. Int J Epidemiol 12 :357–365.
- 15↑
Quick RE, Venczel LV, Gonzalez O, Mintz ED, Highsmith AK, Espada A, Damiani E, Bean NH, De HEH, Tauxe RV, 1996. Narrow-mouthed water storage vessels and in situ chlorination in a Bolivian community: A simple method to improve drinking water quality. Am J Trop Med Hyg 54 :511–516.
- 16↑
Greenland S, 1987. Interpretation and choice of effect measures in epidemiologic analyses. Am J Epidemiol 125 :761–768.
- 17↑
Egger M, Davey Smith G, Altman D, 2001. Systematic Reviews in Healthcare. Meta-analysis in Context. London: BMJ Books.
- 18↑
Begg CB, Mazumdar M, 1994. Operating characteristics of a rank correlation test for publication bias. Biometrics 50 :1088–1101.
- 19↑
Clasen TF, Cairncross S, 2004. Editorial: Household water management: refining the dominant paradigm. Trop Med Int Health 9 :187–191.
- 20
Gundry S, Wright J, Conroy R, 2004. A systematic review of the health outcomes related to household water quality in developing countries. J Water Health 2 :1–13.
- 21
Macy J, Quick R, 2002. The safe water system—a household-based water quality intervention program for the developing world. Water Conditioning Purification Mag 44 :1–4.
- 22
Makutsa P, Nzaku K, Ogutu P, Barasa P, Ombeki S, Mwaki A, Quick RE, 2001. Challenges in implementing a point-of-use water quality intervention in rural Kenya. Am J Public Health 91 :1571–1573.
- 23
Mintz ED, Reiff FM, Tauxe RV, 1995. Safe water treatment and storage in the home. A practical new strategy to prevent water-borne disease. JAMA 273 :948–953.
- 24
Quick R, 2003. Changing community behaviour: experience from three African countries. Int J Environ Health Res 13 (Suppl 1):S115–S121.
- 25
Sobsey M, 2002. Managing Water in the Home: Accelerated Health Gains From Improved Water Supply. Geneva: World Health Organization.
- 26
Tumwine JK, 2005. Clean drinking water for homes in Africa and other less developed countries. BMJ 331 :468–469.
- 27↑
Wright J, Gundry S, Conroy R, 2004. Household drinking water in developing countries: A systematic review of microbiological contamination between source and point-of-use. Trop Med Int Health 9 :106–117.
- 28↑
Dunston C, McAfee D, Kaiser R, Rakotoarison D, Rambeloson L, Hoang AT, Quick RE, 2001. Collaboration, cholera, and cyclones: A project to improve point-of-use water quality in Madagascar. Am J Public Health 91 :1574–1576.
- 29
Glynn MK, Friedman CR, Gold BD, Khanna B, Hutwagner L, Iihoshi N, Revollo C, Quick R, 2002. Seroincidence of Helicobacter pylori infection in a cohort of rural Bolivian children: acquisition and analysis of possible risk factors. Clin Infect Dis 35 :1059–1065.
- 30
Macy JT, Quick RE, 1998. Evaluation of a novel drinking water treatment and storage intervention in Nicaragua. Rev Panam Salud Publica 3 :135–136.
- 31
Rowe AK, Angulo FJ, Roberts L, Tauxe R, 1998. Chlorinating well water with liquid bleach was not an effective water disinfection strategy in Guinea-Bissau. Int J Environ Health Res 8 :339–340.
- 32
Thevos AK, Kaona FA, Siajunza MT, Quick RE, 2000. Adoption of safe water behaviors in Zambia: Comparing educational and motivational approaches. Educ Health (Abingdon) 13 :366–376.
- 33↑
Thevos AK, Quick RE, Yanduli V, 2000. Motivational interviewing enhances the adoption of water disinfection practices in Zambia. Health Promot Internation 15 :207–214.
- 34↑
Austin C, 1994. Chlorinating household water in Gambia. 20th WEDC Conference. Colombo, Sri Lanka; August 22–26, 1994.
- 35
Leonard CW, 1993. The Provision of Safe Drinking Water for Low Income Border Communities Using Appropriate Water Purification/Waste Water Techniques. El Paso, TX: University of Texas at El Paso/Center for Environmental Resource Management.
- 36
Liebman A, 1995. The Provision of Safe Drinking Water for Low Income Border Communities Using Appropriate Water Purification/Waste Water Techniques. El Paso, Texas: University of Texas at El Paso.
- 37↑
Quick R, 1997. A new strategy for waterborne disease transmission. 23rd WEDC Conference. Durbin, South Africa.
- 38↑
Deb BC, Sircar BK, Sengupta PG, De SP, Mondal SK, Gupta DN, Saha NC, Ghosh S, Mitra U, Pal SC, 1986. Studies on interventions to prevent eltor cholera transmission in urban slums. Bull World Health Organ 64 :127–131.
- 39↑
Reller ME, Mong YJ, Hoekstra RM, Quick RE, 2001. Cholera prevention with traditional and novel water treatment methods: An outbreak investigation in Fort-Dauphin, Madagascar. Am J Public Health 91 :1608–1610.
- 40↑
Alvarez M, Lopez B, Mendoza C, Rangel J, Luby SF, Klein R, 2003. Drinking water microbiology results, using a combination method of flocculation and chlorination, in control households vs. intervention households, San Juan Sacatepequez, Guatemala, 2000. Epidemiology 14 :S31.
- 41
Jensen PK, Ensink JH, Jayasinghe G, van der Hoek W, Cairn-cross S, Dalsgaard A, 2003. Effect of chlorination of drinking-water on water quality and childhood diarrhoea in a village in Pakistan. J Health Popul Nutr 21 :26–31.
- 42↑
Chiller TM, Mendoza CE, Lopez MB, Alvarez M, Hoekstra RM, Keswick BH, Luby SP, 2006. Reducing diarrhoea in Guatemalan children: Randomized controlled trial of flocculant-disinfectant for drinking-water. Bull World Health Organ 84 :28–35.
- 43↑
Crump JA, Otieno PO, Slutsker L, Keswick BH, Rosen DH, Hoekstra RM, Vulule JM, Luby SP, 2005. Household based treatment of drinking water with flocculant-disinfectant for preventing diarrhoea in areas with turbid source water in rural western Kenya: Cluster randomised controlled trial. BMJ 331 :478.
- 44↑
Handzel T, 1998. The Effect of Improved Drinking Water Quality on the Risk of Diarrhoeal Disease in an Urban Slum of Dhaka, Bangladesh: A Home Chlorination Intervention Trial. Chapel Hill, NC: University of North Carolina.
- 45↑
Kirchhoff LV, McClelland KE, Do Carmo Pinho M, Araujo JG, De Sousa MA, Guerrant RL, 1985. Feasibility and efficacy of in-home water chlorination in rural North-eastern Brazil. J Hyg (Lond) 94 :173–180.
- 46↑
Luby SP, Agboatwalla M, Hoekstra RM, Rahbar MH, Billhimer W, Keswick BH, 2004. Delayed effectiveness of home-based interventions in reducing childhood diarrhea, Karachi, Pakistan. Am J Trop Med Hyg 71 :420–427.
- 47↑
Luby SP, Agboatwalla M, Painter J, Altaf A, Billhimer W, Keswick B, Hoekstra RM, 2006. Combining drinking water treatment and hand washing for diarrhoea prevention, a cluster randomised controlled trial. Trop Med Int Health 11 :479–489.
- 48↑
Lule JR, Mermin J, Ekwaru JP, Malamba S, Downing R, Ransom R, Nakanjako D, Wafula W, Hughes P, Bunnell R, Kaharuza F, Coutinho A, Kigozi A, Quick R, 2005. Effect of home-based water chlorination and safe storage on diarrhea among persons with human immunodeficiency virus in Uganda. Am J Trop Med Hyg 73 :926–933.
- 49↑
Mahfouz AA, Abdel-Moneim M, al-Erian RA, al-Amari OM, 1995. Impact of chlorination of water in domestic storage tanks on childhood diarrhoea: a community trial in the rural areas of Saudi Arabia. J Trop Med Hyg 98 :126–130.
- 50↑
Quick RE, Venczel LV, Mintz ED, Soleto L, Aparicio J, Gironaz M, Hutwagner L, Greene K, Bopp C, Maloney K, Chavez D, Sobsey M, Tauxe RV, 1999. Diarrhoea prevention in Bolivia through point-of-use water treatment and safe storage: A promising new strategy. Epidemiol Infect 122 :83–90.
- 51↑
Reller ME, Mendoza CE, Lopez MB, Alvarez M, Hoekstra RM, Olson CA, Baier KG, Keswick BH, Luby SP, 2003. A randomized controlled trial of household-based flocculant-disinfectant drinking water treatment for diarrhea prevention in rural Guatemala. Am J Trop Med Hyg 69 :411–419.
- 52↑
Semenza JC, Roberts L, Henderson A, Bogan J, Rubin CH, 1998. Water distribution system and diarrheal disease transmission: A case study in Uzbekistan. Am J Trop Med Hyg 59 :941–946.
- 53↑
Sobsey MD, Handzel T, Venczel L, 2003. Chlorination and safe storage of household drinking water in developing countries to reduce waterborne disease. Water Sci Technol 47 :221–228.
- 54↑
Venczel L, 1997. Evaluation and Application of a Mixed Oxidant Disinfection System for Waterborne Disease Prevention. Chapel Hill, NC: University of North Carolina.
- 55↑
Quick RE, Kimura A, Thevos A, Tembo M, Shamputa I, Hutwagner L, Mintz E, 2002. Diarrhea prevention through household-level water disinfection and safe storage in Zambia. Am J Trop Med Hyg 66 :584–589.
- 56↑
Crump JA, Okoth GO, Slutsker L, Ogaja DO, Keswick BH, Luby SP, 2004. Effect of point-of-use disinfection, flocculation and combined flocculation-disinfection on drinking water quality in western Kenya. J Appl Microbiol 97 :225–231.
- 57↑
Daniels NA, Simons SL, Rodrigues A, Gunnlaugsson G, Forster TS, Wells JG, Hutwagner L, Tauxe RV, Mintz ED, 1999. First do no harm: Making oral rehydration solution safer in a cholera epidemic. Am J Trop Med Hyg 60 :1051–1055.
- 58↑
Luby S, Agboatwalla M, Raza A, Sobel J, Mintz E, Baier K, Rahbar M, Qureshi S, Hassan R, Ghouri F, Hoekstra RM, Gangarosa E, 2001. A low-cost intervention for cleaner drinking water in Karachi, Pakistan. Int J Infect Dis 5 :144–150.
- 59↑
Mong Y, Kaiser R, Ibrahim D, Rasoatiana, Razafimbololona L, Quick RE, 2001. Impact of the safe water system on water quality in cyclone-affected communities in Madagascar. Am J Public Health 91 :1577–1579.
- 60↑
Ogutu P, Garrett V, Barasa P, Ombeki S, Mwaki A, Quick RE, 2001. Seeking safe storage: A comparison of drinking water quality in clay and plastic vessels. Am J Public Health 91 :1610–1611.
- 61↑
Rangel JM, Lopez B, Mejia MA, Mendoza C, Luby S, 2003. A novel technology to improve drinking water quality: A microbiological evaluation of in-home flocculation and chlorination in rural Guatemala. J Water Health 1 :15–22.
- 62↑
Roberts L, Chartier Y, Chartier O, Malenga G, Toole M, Rodka H, 2001. Keeping clean water clean in a Malawi refugee camp: a randomized intervention trial. Bull World Health Organ 79 :280–287.
- 63↑
Sobel J, Mahon B, Mendoza CE, Passaro D, Cano F, Baier K, Racioppi F, Hutwagner L, Mintz E, 1998. Reduction of fecal contamination of street-vended beverages in Guatemala by a simple system for water purification and storage, handwashing, and beverage storage. Am J Trop Med Hyg 59 :380–387.
- 64↑
Higgins JP, Thompson SG, 2002. Quantifying heterogeneity in a meta-analysis. Stat Med 21 :1539–1558.
- 66↑
Thompson SG, Smith TC, Sharp SJ, 1997. Investigating underlying risk as a source of heterogeneity in meta-analysis. Stat Med 16 :2741–2758.
- 67↑
Higgins JPT, Thompson SG, 2004. Controlling the risk of spurious findings from meta-regression. Stat Med 23 :1663–1682.
- 68↑
Thompson SG, Higgins JP, 2002. How should meta-regression analyses be undertaken and interpreted? Stat Med 21 :1559–1573.
- 69↑
ManunEbo M, Cousens S, Haggerty P, Kalengaie M, Ashworth A, Kirkwood B, 1997. Measuring hygiene practices: A comparison of questionnaires with direct observations in rural Zaire. Trop Med Int Health 2 :1015–1021.
- 70↑
Luby SP, Agboatwalla M, Painter J, Altaf A, Billhimer WL, Hoekstra RM, 2004. Effect of intensive handwashing promotion on childhood diarrhea in high-risk communities in Pakistan: A randomized controlled trial. JAMA 291 :2547–2554.