Volume 92, Issue 3
  • ISSN: 0002-9637
  • E-ISSN: 1476-1645



Health surveillance assistants (HSAs) in Malawi have provided community case management (CCM) since 2008; however, program monitoring remains challenging. Mobile technology holds the potential to improve data, but rigorous assessments are few. This study tested the validity of collecting CCM implementation strength indicators through mobile phone interviews with HSAs. This validation study compared mobile phone interviews with information obtained through inspection visits. Sensitivity and specificity were measured to determine validity. Using mobile phones to interview HSAs on CCM implementation strength indicators produces accurate information. For deployment, training, and medicine stocks, the specificity and sensitivity of the results were excellent (> 90%). The sensitivity and specificity of this method for drug stock-outs, supervision, and mentoring were lower but with a few exceptions, still above 80%. This study provided a rigorous assessment of the accuracy of implementation strength data collected through mobile technologies and is an important step forward for evaluation of public health programs.

[open-access] This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


Article metrics loading...

The graphs shown below represent data from March 2017
Loading full text...

Full text loading...



  1. Commission on Information and Accountability for Women's and Children's Health, 2011. Keeping Promises, Measuring Results. Final Report of the Commission. Available at: http://www.everywomaneverychild.org/images/content/files/accountability_commission/final_report/Final_EN_Web.pdf. Accessed October 25, 2013. [Google Scholar]
  2. International Telecommunication Union. Key 2005–2013 ICT Data for the World, by Region and Level of Development: Mobile-cellular subscriptions, 2013. Available at: http://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx. Accessed October 25, 2013.
  3. Kallander K, Tibenderana JK, Akpogheneta OJ, Strachan DL, Hill Z, ten Asbroek AHA, Conteh L, Kirkwood B, Meek SR, , 2013. Mobile health (mhealth) approaches and lessons for increased performance and retention of community health workers in low-and middle-income countries: a review. J Med Internet Res 15: 115.[Crossref] [Google Scholar]
  4. Independent Expert Review Group on Information and Accountability for Women's and Children's Health, 2012. Every Woman, Every Child: From Commitments to Action: The First Report of the Independent Expert Review Group (IERG) on Information and Accountability for Women's and Children's Health 2012. Available at: http://www.who.int/woman_child_accountability/ierg/reports/2012/IERG_report_low_resolution.pdf. Accessed October 25, 2013. [Google Scholar]
  5. Bryce J, Victora CG, Boerma T, Peters DH, Black RE, , 2011. Evaluating the scale-up for maternal and child survival: a common framework. In Health 3: 139146.[Crossref] [Google Scholar]
  6. Asangansi I, Macleod B, Meremikwu M, Arikpo I, Roberge D, Hartstock B, Mboto I, , 2013. Improving the routine HMIS in Nigeria through mobile technology for community data collection. J Health Inform Dev Ctries 7: 7687. [Google Scholar]
  7. FHI 360 Satellife, 2011. ICT for Health. Empowering Health Workers to Save Lives. Uganda Health Information Network. Available at: http://www.healthnet.org/uhin. Accessed November 8, 2013. [Google Scholar]
  8. FHI 360 Satellife, 2012. ICT for Health. Empering Health Workers to Save Lives. Mozambique Health Information Network. Available at: http://www.healthnet.org/mhin. Accessed November 8, 2013. [Google Scholar]
  9. Independent Evaluation Team, National Statistics Office of Malawi and Institute for International Programs, Johns Hopkins University, 2011. Measuring CCM Implementation Strength: Report of Findings from a Pilot of Study; Catalytic Initiative Rapid Scale-Up Program, Malawi 2011. Baltimore, MD: Johns Hopkins University. [Google Scholar]
  10. US Census Bureau, 2012. Census and Survey Processing System (CSPro): version 5.0. Washington, DC: US Census Bureau.
  11. StataCorp, 2011. Stata Statistical Software: Release 12. College Station, TX: StataCorp LP. [Google Scholar]
  12. Bland JM, Altman DG, , 1999. Measuring agreement in method comparison studies. Stat Methods Med Res 8: 135160.[Crossref] [Google Scholar]
  13. Institute for International Programs at Johns Hopkins University, Malawi National Statistics Office, Malawi Ministry of Health and Save the Children, 2013. CCM Implementation Strength Measurement: Validation of Mobile Phone Interviews with Health Surveillance Assistants in Malawi 2013. Available at: http://www.jhsph.edu/departments/international-health/centers-and-institutes/institute-for-international-programs/projects/traction/Malawi_IS_CVS_report_final.pdf. Accessed February 11, 2014. [Google Scholar]
  14. OANDA Corporation, 2013. Historical Exchange Rate. Available at: http://www.oanda.com/currency/converter/. Accessed November 11, 2013. [Google Scholar]
  15. Campbell N, Schiffer E, Buxbaum A, McLean E, Perry C, Sullivan TM, , 2014. Taking knowledge for health the extra mile: participatory evaluation of a mobile phone intervention for community health workers in Malawi. Glob Health Sci Pract 2: 2334.[Crossref] [Google Scholar]
  16. Mahmud N, Rodriguez J, Nesbit J, , 2010. A text message-based intervention to bridge the health care communication gap in the rural developing world. Technol Health Care 18: 137144. [Google Scholar]
  17. Braun R, Catalani C, Wimbush J, Isaelski D, , 2013. Community health workers and mobile technology: a systematic review of the literature. PLoS One 8: e65772.[Crossref] [Google Scholar]
  18. Victora CG, Black RE, Boerma JT, Bryce J, , 2011. Measuring impact in the Millennium Development Goal era and beyond: a new approach to large-scale effectiveness evaluations. Lancet 377: 8595.[Crossref] [Google Scholar]
  19. D'Adamo M, Short Fabic M, Ohkubo S, , 2012. Meeting the health information needs of health workers: what have we learned? J Health Commun 17 (Suppl 2): 2329.[Crossref] [Google Scholar]

Data & Media loading...

  • Received : 25 Jun 2014
  • Accepted : 02 Dec 2014
  • Published online : 04 Mar 2015

Most Cited This Month

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error