Volume 100, Issue 6
  • ISSN: 0002-9637
  • E-ISSN: 1476-1645



Approximately 3 million children younger than 5 years living in low- and middle-income countries (LMICs) die each year from treatable clinical conditions such as pneumonia, dehydration secondary to diarrhea, and malaria. A majority of these deaths could be prevented with early clinical assessments and appropriate therapeutic intervention. In this study, we describe the development and initial validation testing of a mobile health (mHealth) platform, MEDSINC, designed for frontline health workers (FLWs) to perform clinical risk assessments of children aged 2–60 months. MEDSINC is a web browser–based clinical severity assessment, triage, treatment, and follow-up recommendation platform developed with physician-based Bayesian pattern recognition logic. Initial validation, usability, and acceptability testing were performed on 861 children aged between 2 and 60 months by 49 FLWs in Burkina Faso, Ecuador, and Bangladesh. MEDSINC-based clinical assessments by FLWs were independently and blindly correlated with clinical assessments by 22 local health-care professionals (LHPs). Results demonstrate that clinical assessments by FLWs using MEDSINC had a specificity correlation between 84% and 99% to LHPs, except for two outlier assessments (63% and 75%) at one study site, in which local survey prevalence data indicated that MEDSINC outperformed LHPs. In addition, MEDSINC triage recommendation distributions were highly correlated with those of LHPs, whereas usability and feasibility responses from LHP/FLW were collectively positive for ease of use, learning, and job performance. These results indicate that the MEDSINC platform could significantly increase pediatric health-care capacity in LMICs by improving FLWs’ ability to accurately assess health status and triage of children, facilitating early life-saving therapeutic interventions.

[open-access] This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


Article metrics loading...

The graphs shown below represent data from March 2017
Loading full text...

Full text loading...



  1. UNICEF Bucher K, Dooley T, Little C, Gonzalez Romo C, Sethna Z, Tamagni J, , 2015. Beyond averages-learning from the MDGs. , eds. Progress for Children. New York, NY: WHO. [Google Scholar]
  2. Watkins K, UNICEF et al eds.; , 2016. The State of the World’s Children 2106: A Fair Chance for Every Child. New York, NY: WHO. [Google Scholar]
  3. WHO, 2016. Global Strategy on Human Resources for Health: Workforce 2030. New York, NY: World Health Organization. [Google Scholar]
  4. Campbell J, Dussault G, Buchan J, Pozo-Martin F, Guerra Arias M, Leone C, Siyam A, Cometto G, WHO, eds.; , 2014. A Universal Truth: No Health without a Workforce. New York, NY: World Health Organization. [Google Scholar]
  5. Rambaud-Althaus C, Shao A, Samaka J, Swai N, Perri S, Kahama-Maro J, Mitchell M, D’Acremont V, Genton B, , 2017. Performance of health workers using an electronic algorithm for the management of childhood illness in Tanzania: a pilot implementation study. Am J Trop Med Hyg 96: 249257. [Google Scholar]
  6. Agarwal S, Rosenblum L, Goldschmidt T, Carras M, Goal N, Labrique AB, , 2016. Mobile Technology in Support of Frontline Health Workers: A Comprehensive Overview of the Landscape, Knowledge Gaps and Future Directions. Baltimore, MD: Johns Hopkins University Global mHealth Initiative. [Google Scholar]
  7. Gove S, Tamburlini G, Molyneux E, Whitesell P, Campbell H, , 1999. Development and technical basis of simplified guidelines for emergency triage assessment and treatment in developing countries. WHO Integrated Management of Childhood Illness (IMCI) referral care project. Arch Dis Child 81: 473477. [Google Scholar]
  8. WHO United Nations Children’s Fund, , 2012. WHO/UNICEF Joint Statement - Integrated Community Case Management (iCCM): An Equity-Focused Strategy to Improve Access to Essential Treatment Services for Children. New York, NY: World Health Organization, United Nations Children’s Fund, 18. [Google Scholar]
  9. Hardy V, 2017. The added value of a mobile application of community case management on referral, re-consultation and hospitalization rates of children aged under 5 years in two districts in Northern Malawi: study protocol for a pragmatic, stepped-wedge cluster-randomized controlled trial. Trials 18: 475. [Google Scholar]
  10. Haque F, 2017. Evaluation of a smartphone decision-support tool for diarrheal disease management in a resource-limited setting. PLoS Negl Trop Dis 11: e0005290. [Google Scholar]
  11. Keitel K, 2017. A novel electronic algorithm using host biomarker point-of-care tests for the management of febrile illnesses in Tanzanian children (e-POCT): a randomized, controlled non-inferiority trial. PLoS Med 14: e1002411. [Google Scholar]
  12. Horwood C, Vermaak K, Rollins N, Haskins L, Nkosi P, Qazi S, , 2009. An evaluation of the quality of IMCI assessments among IMCI trained health workers in South Africa. PLoS One 4: e5937. [Google Scholar]
  13. Mitchell M, Hedt-Gauthier BL, Msellemu D, Nkaka M, Lesh N, , 2013. Using electronic technology to improve clinical care - results from a before-after cluster trial to evaluate assessment and classification of sick children according to Integrated Management of Childhood Illness (IMCI) protocol in Tanzania. BMC Med Inform Decis Mak 13: 95. [Google Scholar]
  14. Agarwal S, Perry HB, Long LA, Labrique AB, , 2015. Evidence on feasibility and effective use of mHealth strategies by frontline health workers in developing countries: systematic review. Trop Med Int Health 20: 10031014. [Google Scholar]
  15. Lee SH, Nurmatov UB, Nwaru BI, Mukherjee M, Grant L, Pagliari C, , 2016. Effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries: systematic review and meta-analysis. J Glob Health 6: 010401. [Google Scholar]
  16. Byrt T, Bishop J, Carlin JB, , 1993. Bias, prevalence and kappa. J Clin Epidemiol 46: 423429. [Google Scholar]
  17. Cohen J, , 1960. A coefficient of agreement for nominal scales. Educ Psychol Meas 20: 3746. [Google Scholar]
  18. Gwet KL, , 2008. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol 61: 2948. [Google Scholar]
  19. Gwet KL, , 2014. Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement among Raters. Gaithersburg, MD: Advanced Analytics, LLC. [Google Scholar]
  20. Wongpakaran N, Wongpakaran T, Wedding D, Gwet KL, , 2013. A comparison of Cohen’s kappa and Gwet’s AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples. BMC Med Res Methodol 13: 61. [Google Scholar]
  21. Agarwal S, LeFevre AE, Lee J, L’Engle K, Mehl G, Sinha C, Labrique A, WHO mHealth Technical Evidence Review Group, , 2016. Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ 352: i1174. [Google Scholar]
  22. Bhattacharyya A, Chatterjee C, Chatterjee S, Dasgupta S, , 2012. A comparative study of the management decisions by IMNCI algorithm and by pediatricians of a teaching hospital for the children between 2 months to 5 years. Indian J Community Med 37: 174179. [Google Scholar]
  23. Kundra S, Singh T, Chhatwal J, , 2008. Utility of Indian adVAaptation of Integrated Management of Childhood Illness (IMCI) algorithm. Indian J Pediatr 75: 781785. [Google Scholar]
  24. Shewade HD, Aggarwal AK, Bharti B, , 2013. Integrated management of neonatal and childhood illness (IMNCI): skill assessment of health and integrated child development scheme (ICDS) workers to classify sick under-five children. Indian J Pediatr 80: 448454. [Google Scholar]
  25. Davalos MC, Samuels K, Meyer AN, Thammasitboon S, Sur M, Roy K, Al-Mutairi A, Singh H, , 2017. Finding diagnostic errors in children admitted to the PICU. Pediatr Crit Care Med 18: 265271. [Google Scholar]
  26. Singh H, Giardina TD, Meyer AN, Forjuoh SN, Reis MD, Thomas EJ, , 2013. Types and origins of diagnostic errors in primary care settings. JAMA Intern Med 173: 418425. [Google Scholar]
  27. Bekhof J, Reimink R, Bartels IM, Eggink H, Brand PL, , 2015. Large observer variation of clinical assessment of dyspnoeic wheezing children. Arch Dis Child 100: 649653. [Google Scholar]
  28. Jensen EA, Panitch H, Feng R, Moore PE, Schmidt B, , 2016. Interobserver reliability of the respiratory physical examination in premature infants: a multicenter study. J Pediatr 178: 8792. [Google Scholar]
  29. Tulaimat A, Patel A, Wisniewski M, Gueret R, , 2016. The validity and reliability of the clinical assessment of increased work of breathing in acutely ill patients. J Crit Care 34: 111115. [Google Scholar]
  30. Mulaudzi MC, , 2015. Adherence to case management guidelines of Integrated Management of Childhood Illness (IMCI) by healthcare workers in Tshwane, South Africa. S Afr J Child Health 9: 8992. [Google Scholar]
  31. Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, Patel V, Haines A, , 2013. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med 10: e1001363. [Google Scholar]
  32. Adepoju IO, Albersen BJ, De Brouwere V, van Roosmalen J, Zweekhorst M, , 2017. mHealth for clinical decision-making in sub-Saharan Africa: a scoping review. JMIR Mhealth Uhealth 5: e38. [Google Scholar]
  33. Aranda-Jan CB, Mohutsiwa-Dibe N, L’oukanova S, , 2014. Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa. BMC Public Health 14: 188. [Google Scholar]
  34. Shuchman M, , 2014. The promise and pitfalls of global mHealth. CMAJ 186: 11341135. [Google Scholar]

Data & Media loading...

  • Received : 30 Oct 2018
  • Accepted : 11 Mar 2019
  • Published online : 15 Apr 2019

Most Cited This Month

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error