INTRODUCTION
Classified as neglected tropical diseases, visceral and tegumentary leishmaniases are important public health problems. The estimated number of new cases worldwide ranges from 600,000 to 1 million for tegumentary leishmaniasis and from 50,000 to 90,000 for visceral leishmaniasis, with a mortality rate of 7%.1,2 Most cases of visceral leishmaniasis occur in East Africa, Southeast Asia, and Brazil, which account for more than 95% of the new cases reported.1 These diseases are associated with direct and indirect costs for health services. Carvalho et al.3 evaluated the total cost of visceral leishmaniasis care in Brazil in 2014, which was US$14 million, with total medical costs of approximately US$1.9 million.3,4 Factors that reduce morbidity and mortality and consequently the impact of the two clinical presentations of the disease are an early diagnosis and the initiation of appropriate specific treatment.5–8
In this scenario, the introduction of new information and communication technologies (ICTs) that can help health professionals with the early diagnosis and appropriate treatment, even in remote endemic areas, is necessary. It is estimated that 2.71 billion people in the world use smartphones, and approximately 3.9 billion own mobile devices with Internet connection.9 Brazil has 242 million active customers of mobile network operators, which has become a global communication platform with varied possibilities for interaction.10,11 In the healthcare area, this technology permits to establish professional connections among specialists to share opinions and to collaborate with screening, diagnosis, and patient management.12 Within this context, applications designed for a specific purpose can facilitate decision-making and can have a positive impact during consultation because they are easy to use considering the mobility of the professional.13–15 In addition to the exchange of information and connection with people around the world, these tools are able to reduce patient waiting times and can integrate multi-professional teams by permitting long- and short-range communication.16
The aim of this study was to describe LeishCare®, an app designed for the management of individuals with a suspicion of leishmaniasis that can be used by health professional in endemic areas. We describe the software development process and the main features of the app, as well as the results regarding user perception and satisfaction with LeishCare® over one year of availability and use in endemic areas located in the state of Minas Gerais, Brazil.
MATERIAL AND METHODS
Development and distribution of the app.
For the definition of software content and programming, a technical committee was formed that consisted of an engineer, an information technology analyst, doctors, and a biologist. The app was developed for smartphones running Android as the operating system. The main reason for choosing Android was that it is currently the top-selling system in the world and is used on the simplest to the most sophisticated devices,17 thus providing a widely available app free of charge.
The minimum specifications of the devices for running the software are a camera with at least 2 megapixels, Android 4.4 or higher, an 800-MHz processor, a 3.5-inch screen, and an accelerometer. The recommended extra resources for better utilization are Bluetooth and Internet access for data-sharing.18
Before the distribution of LeishCare® in endemic areas, a pilot study was conducted with the prototype of the app in endemic areas located in the northern region of Minas Gerais, Brazil. The adjustments resulting from this study were configuration for agility and increasing the range of use on different devices.19
Finally, the software received the name LeishCare® and has the following features: 1) to catalog signs observed in patients with a suspicion of leishmaniasis and to record the evolution of skin lesions using photo filters, with subsequent creation of a chart. This feature allows us to visualize, insert, or edit data of the patients in the chart using a speech recognition tool or the keyboard of the device. After each consultation is filed in the medical records, a list of the consultations performed is generated, and each consultation can be selected within the folder; 2) to enter the data into the chart and to potentially share these records with other professionals who have the app installed to help with diagnosis and treatment. These data can be shared via Bluetooth, e-mail, or applications that allow file sharing between devices on which the LeishCare® software is installed; 3) to calculate a score set to identify the risk of death from visceral leishmaniasis based on the health risk assessment adopted by the Brazilian Ministry of Health.20,21 Based on the clinical and laboratory data of the patients, the severity parameters are marked on this tab. Once these data have been entered, clicking on the “calculate” button estimates the risk of evolution to death; and 4) to provide texts with informative and reference guides on leishmaniasis (Figure 1).
LeishCare® is the intellectual property of the Federal University of Triângulo Mineiro (UFTM), registration number 512019000045-5. Since August 2019, after data collection for the present study ended, the app was available free of charge on Play Store through the following link: https://play.google.com/store/apps/details?id=com.uftm.gerson.healsis.
Evaluation procedures of LeishCare® in endemic areas.
Endemic areas where the app was made available.
The LeishCare® care app was made available in three Brazilian municipalities with different endemicity profiles: area of intense and old transmission of visceral and tegumentary leishmaniases (Montes Claros), area of moderate and more recent transmission of visceral and tegumentary leishmaniases (Paracatu), and area recently established as endemic for visceral and tegumentary leishmaniases, with report of the first autochthonous case in 2017 (Lavras).
Distribution of LeishCare® to health professionals in endemic areas.
In each area, the local technical bodies were responsible for identifying the health professionals who could participate in the study. These professionals were invited to the first face-to-face meeting for the purpose of 1) leishmaniasis training provided by an expert on the topic, and 2) presenting LeishCare® and details of its features.
After this first meeting that occurred between April and May 2018, a semi-structured questionnaire was applied to evaluate the health professionals’ expectations about the possible future use of LeishCare®. At the end of the meeting, professionals who were interested in participating in the prospective phase of the study provided their individual mobile phone number through which the link for installation of the app was made available. Virtual support to answer users’ questions was maintained throughout the study period. The prospective phase consisted of another two face-to-face meetings held 6 and 12 months after the first meeting, in which the perception of the professionals on using LeishCare® was evaluated (Figure 2).
Assessment tools to measure the perception of health professionals on LeishCare®.
Evaluation of expectations.
A self-administered semi-structured questionnaire containing the following fields was used: 1) previous use of an app for professional support (if yes, how did the professional evaluate its performance), 2) expectations regarding the use of an app aimed at facilitating the diagnosis and management of leishmaniasis (Likert scale responses: very positive, positive, negative, very negative, and indifferent), 3) whether the professional believes that information technologies are helpful in the health professions (Likert scale responses: strongly disagree, disagree, agree, and strongly agree), 4) prediction of difficulties arising from the use of the app (no/yes—text entry field), and 5) prediction of gains resulting from the use of the app (no/yes—text entry field).
Evaluation of user perception.
Two instruments were used for this evaluation, which were applied at 6 and 12 months after distribution of the app. These instruments were only applied to those professionals who, at the time of assessment, had reported the installation of LeishCare® and were, therefore, considered users of the app.
Semi-structured satisfaction questionnaire. contains the following variables: 1) opinion about the information provided by the app (Likert-type scale responses: adequate, insufficient, further information needed, excessive, and too much information), 2) utility attributed by the user to the information provided by the app (Likert scale responses: very useful, useful, of little help, and I do not know), 3) estimated frequency of access to the app (Likert scale responses: often, even when not attending suspicious patients; every time when attending a suspicious patient; sometimes; and I did not access), 4) overall user satisfaction with the app (Likert scale responses: very satisfied, satisfied, dissatisfied, and very dissatisfied), 5) performance evaluation of the app for the management of patients with leishmaniasis (Likert scale responses: excellent, good, regular, and none), 6) indication of strengths of the app (text entry field), and 7) indication of aspects that could be improved (text entry field).
Self-perception of competence gain. designed to measure the user’s perception of competence gains attributed to the use of the app following the method described by Bhanji et al.22 The self-administered instrument consists of a list of competencies for which the users were asked to rate their self-perception of proficiency “before” and “after” using LeishCare® on a Likert scale: 0 = no competence, 1 = little competence, 2 = competent, and 3 = expert. For the “after” field, the professional should consider only potential gains arising from the use of the app. The following competencies were evaluated: 1) ability to use a mobile device for improving professional practice, 2) understanding the different clinical presentations of leishmaniasis in the municipality, 3) ability to extract information for clinical practice by means of a mobile app, 4) ability to communicate virtually with leishmaniasis experts, and 5) motivation of using the virtual environment to solve clinical problems. At the end of this instrument, the user was asked to provide an overall assessment of the app (Likert scale responses: 1) positively exceeded my expectation, 2) fulfilled my expectation, 3) indifferent, and 4) worse than expected. In the last question of the instrument (open ended), the user could write about what he/she liked most about using the app and what could be improved.
Data analysis.
For the analysis of expectations, only questionnaires that were completely filled out in the first meeting were considered. Regarding the 6- and 12-month assessments, only subjects who had installed LeishCare® on their mobile phones and who had properly filled out all fields of the two instruments (satisfaction and self-perception of gains) were included in the analysis.
The results were analyzed descriptively by calculating absolute and relative frequencies and by analysis for content identification. Thematic analysis was performed according to Bardin.23 The categories were established after thorough analysis of the answers and content organization. Content analysis resulted in the formation and categorization of recording units and context units.23–26
Self-perceived competence gain was assessed based on the difference between how the professionals rated themselves before and after using the app for each item. A competence gain in each item was defined when the health professional added one point or higher to the score of the competence scale described earlier.
Ethical considerations.
This study was approved by the Ethics Committee on Research Involving Humans of UFTM (Approval number 1.667.477) in accordance with the requirements of Resolution 466/12 (Brasil, 2012).27 All professionals were informed about the objectives of the study and agreed to participate by signing the free informed consent form.
RESULTS
Evaluation of expectations.
One hundred two professionals participated in the evaluation of expectations. Of these, 62 (60.8%) reported not having previously used any application/information technology and 96 (94.1%) responded to have very positive (n = 57) or positive (n = 39) expectations regarding the use of LeishCare®. Among the 40 (39.2%) professionals who had already used application suites, the most common softwares were Whitebook (39%) and GestaTools (16%), followed by other applications designed for the calculation of doses and scores such as SafeDose, the Framingham Risk Score, and body mass index. Fifty-three (52%) professionals agreed that information technology is important for the health professions and 49 (48%) agreed strongly with this statement. Eighty-seven (85.3%) professionals did not predict difficulties arising from the use of LeishCare®. Fifteen (14.7%) professionals reported that they might have difficulties with its use. The difficulties predicted for the use of LeishCare® were concerns about Internet access, restrictions regarding the use of the iOS operating system, potential installation problems, insufficient computer skills, and difficulties in the handling and adaptation of the app. Regarding the prediction of gains arising from the use of the app, 93 (92.1%) professionals believed that there would be gains from its use and 8 (7.9%) did not predict any gains.
Evaluation of satisfaction and self-perception of gains.
The first evaluation of satisfaction and self-perception of gains occurred 6 months after the distribution of LeishCare®. On that occasion, 16 users responded adequately to both assessment instruments. After 12 months, complete results were obtained for 20 users, and nine of them had already been evaluated at 6 months.
Satisfaction.
Most subjects in the two assessments considered the information provided by the app to be adequate and useful and reported to be satisfied with LeishCare®. There were varied responses to the item’s frequency of access, performance in case management, strengths, and aspects to be improved (Table 1).
User satisfaction with LeishCare® after 6 and 12 months of use
6 months (n = 16), n (%) | 12 months (n = 20), n (%) | |
---|---|---|
Information provided | ||
Adequate | 13 (81.3) | 19 (95) |
Insufficient | 0 (0.0) | 0 (0.0) |
Excessive | 3 (18.8) | 0 (0.0) |
Others | 0 (0.0) | 1 (5) |
Usefulness of information | ||
Very useful | 6 (37.5) | 7 (35) |
Useful | 9 (56.3) | 11 (55) |
Of little help | 1 (6.3) | 2 (10) |
I don’t know | 0 (0.0) | 0 (0.0) |
Frequency of access | ||
Often | 0 (0.0) | 1 (5) |
Every time when attending a suspicious patient | 1 (6.3) | 7 (35) |
Sometimes | 10 (62.5) | 10 (50) |
I did not access | 5 (31.3) | 2 (10) |
Satisfaction | ||
Very satisfied | 2 (12.5) | 6 (30) |
Satisfied | 12 (75) | 13 (65) |
Dissatisfied | 2 (12.5) | 0 (0.0) |
Very dissatisfied | 0 (0.0) | 1 (5) |
Performance in case management | ||
Excellent | 3 (18.8) | 8 (40) |
Good | 6 (37.5) | 7 (35) |
Regular | 0 (0.0) | 0 (0.0) |
None | 7 (43.8) | 5 (25) |
Strengths | ||
Visual | 3 (18.8) | 5 (25) |
Content quality | 9 (56.3) | 10 (50) |
Possibility of interaction | 3 (18.8) | 4 (20) |
Others | 1 (6.3) | 1 (5) |
Aspects to be improved | ||
Visual | 5 (31.3) | 4 (20) |
Content quality | 0 (0.0) | 3 (15) |
Possibility of interaction | 6 (37.5) | 9 (45) |
Others | 5 (31.3) | 4 (20) |
Source: The authors, 2019.
Comparing the results of satisfaction evaluation at 6 and 12 months, small changes in perception were identified for the nine users who participated in the two assessments, with an increase in the frequency of access and a more positive evaluation of the app. In the free text question of the satisfaction instrument, the professionals were asked what they liked most about LeishCare®. Content analysis evaluating all open responses (6 and 12 months) identified 23 recording units divided into nine topics that gave origin to three categories. The first category “usability and functionality” refers to the features available in the app such as calculation of the visceral leishmaniasis score, reference guides, and capturing photographs; it also portrays the user’s perception regarding the utility of LeishCare® in health services, as expressed in the following statements: User 1: “Work has really improved a lot. The app is very useful because it is very easy, accessible, and it has a very quick feedback for some questions we ask, so it is very useful for us, especially in our region that has a high prevalence of the disease.” User 2: “I used LeishCare® more to consult the guides and it was also very useful for calculating the score. I was unable to register the patient; I see it as a feature that may require more daily practice; I find it interesting though but I did not use it.” User 3: “Regarding the app, I think that it was useful; however, here, due to the perception of our health system, I think it was more useful in the hospital environment (…). Today I see that the primary care team has to be more qualified and I think that the public health structure itself has to provide more resources because today, for example, if I suspect a case of leishmaniasis, I can only refer this patient to a hospital since our health services do not provide a rapid test; the serology for leishmaniasis is often not that reliable and the result takes a while; access to the test is difficult. Regarding the myelogram, too, I cannot get this myelogram if it is not in a hospital environment, which is bad, right (…), but I think we have to try to change this reality, we have to try together with the health service directors to create a flow that is more accessible to the patient and family doctor.”
The second category “applicability” refers to the possibility of interactions with other professionals to clarify doubts about the disease, culminating in the acquisition of knowledge and facilitating the diagnosis. The following statements portray this reality: User 1: “The app raises our awareness to investigate and think about leishmaniasis as a differential diagnosis of anemia and fever conditions.” User 2: “It is a way to mobilize, encourage, and unite professionals to improve learning and knowledge about patients with leishmaniasis.” User 3: “Better understanding of the disease, interaction with other professionals, more knowledge of the digital information exchange format.”
The third category “available platform” refers to the possibilities of access and operating systems desired by professionals who use iOS devices or who have a more diverse academic background. This category is portrayed by the following statements: User 1: “As pointed out, the app should include veterinary professionals; one way to do this is to add content about dogs with zoonotic potential. Adding information about the main clinical signs, treatment, types of diagnosis, and interactions with other veterinary professionals. It would also be interesting to disseminate the app in veterinary clinics in endemic regions of the disease.” User 2: “Used on iOS.”
Self-perception of gain.
With respect to competence gains related to the use of LeishCare®, the users reported gains attributed to the app for all items investigated. At 6 months after distribution of the app, the highest frequency of self-perceived competence gains was observed for the items: “ability to communicate virtually with leishmaniasis experts”; “ability to use a mobile device for improving professional practice,” and “motivation for using the virtual environment to solve clinical problems.” After 12 months of use, the highest frequency of self-perceived competence gain was found for the items “ability to extract information for clinical practice by means of a mobile app” and “motivation of using the virtual environment to solve clinical problems” (Table 2).
User self-perception of the acquisition of competencies/skills attributed to the use of LeishCare®
Comparison before/after with gain > 1 | ||
---|---|---|
Competence | 6 months (n = 16), n (%) | 12 months (n = 20), n (%) |
Ability to use a mobile device for improving professional practice | 10 (62.5) | 11 (55) |
Understanding the different clinical presentations of leishmaniasis in the municipality | 7 (43.8) | 9 (45) |
Ability to extract information for clinical practice by means of a mobile app | 9 (56.3) | 14 (70) |
Ability to communicate virtually with leishmaniasis experts | 11 (68.8) | 11 (55) |
Motivation of using the virtual environment to solve clinical problems | 10 (62.5) | 13 (65) |
Source: The authors, 2019.
Analysis of the self-perceived acquisition of competencies and skills arising from the use of LeishCare® among the nine users who participated in the two assessments showed gain in all items investigated. These gains were more expressive after 12 months.
In the overall evaluation of LeishCare® after 6 months, 7 (43.8%) users reported that the app exceeded their expectations in a positive manner, 7 (43.8%) reported that the app fulfilled their expectations, and for 2 users (12.5%), the app was indifferent. In the 12-month assessment, 9 (45%) users reported that the app exceeded their expectations in a positive manner, 10 (50%) reported that the app fulfilled their expectations, and for one user (5%), the app was indifferent (Figure 3).
The acceptance of LeishCare® differed between the three municipalities despite their similar health service structure. In Paracatu, there was interest to unite health professionals from different categories and care levels. In Lavras, the app was targeted mainly at health professionals working in primary care. Finally, in Montes Claros, the app was restricted to professionals commonly attending cases with a suspicion of leishmaniases. This profile may have interfered with adherence to the project and with the impact of the app in different scenarios.
DISCUSSION AND CONCLUSION
The present study reports the results of a multidisciplinary approach to develop an innovative, free-of-charge product designed to help with the management of a neglected disease. LeishCare® was developed to meet important demands of leishmaniasis-endemic areas such as secure information sharing, prognostic assessment of severe visceral leishmaniasis, and follow-up of tegumentary leishmaniasis lesions.
Delivering an application for professional practice requires the evaluation of the software by its potential users. Thus, in addition to the distribution of LeishCare®, the expectations, satisfaction, and self-perception of competence gains resulting from the use of the app were evaluated. In this regard, the first aspect to be considered is the distinction between the positive expectation for using an app and its effective use. Analysis of user expectation showed that several professionals were receptive to the use of the app; however, evaluation of its application in practice after 6 and 12 months revealed that most of them had not even installed the app. It should be noted that most professionals with positive expectations had never used any application in their professional practice. Within this context, the user results observed may not be representative of most health professionals in endemic areas. On the other hand, it is possible that there is space and support for the introduction of new ICTs in remote areas.
The lack of full use of LeishCare® might be associated with the natural resistance to using ICTs in human health care. In a study conducted in Belgium, Mutebi and Devroey28 reinforce this inference by showing that less than half of the surveyed physicians were familiar with healthcare softwares, although most of them considered the Internet and apps to be sources of information. On the other hand, using apps on mobile devices can have a major impact on health care. Because of their widespread popularity, these devices facilitate access to information and keep users connected and, at the same time, up to date.15,29,30 Within this context, creating virtual tools and disseminating them among health professionals seem to be an interesting approach to change the scenarios of endemic diseases. It is important to take advantage of the potential of mobile telephony for improving public health; however, there is no substitution of the contact between professionals and their patients.13 Apps are increasingly being used to facilitate rapid communication within teams through private group conversations, improving multi-professional involvement.31–33 Despite the low frequency of LeishCare® use for this purpose, this feature will probably be more accessed over time, considering the relatively short interval between distribution of the app and the random occurrence of leishmaniasis.
One noteworthy aspect of the LeishCare® app is the possibility to easily calculate a score set to identify the risk of death even without Internet access. This score was developed by Costa et al.34 based on the data of 883 patients with visceral leishmaniasis evaluated in Teresina, Piauí, Brazil. The authors identified factors associated with progression to severe disease and death. The score was subsequently validated in another 1,031 patients. In 2011, the Brazilian Ministry of Health adopted this score at the national level, which is even used as a criterion for the prescription of high-cost medication such as liposomal amphotericin.21 In 2016, the Kala-Cal® software was launched, which can be used for calculation of the severity score and is available on the site of the Brazilian Society of Tropical Medicine. The reason for inclusion of this severity score in the features of LeishCare® was to expand the calculation of this score, regardless of Internet access. Because the score has been adopted as a reference by the Brazilian Ministry of Health, its inclusion was considered an additional attraction for using the app. This was confirmed because the possibility of calculating a score set to identify the risk of death was considered a major strength of the app.
The most innovative feature of the app was the development of an image filter system based on the photographs of a tegumentary leishmaniasis lesion. The possibility of taking serial photos that permit their comparison and subsequent availability in graphics interchange format allows us to monitor treatment efficiency. Although this feature has not been widely used in the present study by the health professionals of the endemic areas, it is an interesting tool for researchers to evaluate the therapeutic response in this disease. Zenteno et al.35 proposed the combination of two control and monitoring models to reduce the incidence of tegumentary leishmaniasis. The first model uses an automated tool designed to streamline laboratory procedures for analysis of the parasites. The second model is a protocol for monitoring the evolution of treatment. This protocol comprises three stages: superficial skin modeling and reconstruction, subcutaneous exploration based on textural characteristics, and volumetric segmentation. This is an elegant model which, however, requires 3D and ultrasonic scanners whose use is unfeasible in endemic areas with few resources.
According to Guidini,36 the current main challenge in developing and distributing an app is to interpret what users consider important and what motivates them to access the tool with a certain frequency. To use and interpret the data present in an app, the user requires technical competence to understand the content accessed.31,37,38 Studies involving mobile health applications have gained more visibility in the scientific world, including the identification of knowledge acquisition, attitudes, and skills in case management.39–42 In the present study, analysis of the self-perception of gains arising from the use of LeishCare® demonstrated the subjective perception of positive effects of the app. In addition, 75% of the professionals considered the software “excellent/good” for the management of their patients.
The implementation of new technological tools in endemic leishmaniasis scenarios may enable early diagnosis and consequently improve professional performance. However, analysis of the users’ criticisms about the app shows that its use needs to be combined with the appropriate infrastructure to provide support to professionals. Within this context, the performance of an ICT tool in real practice can be affected by the underlying work conditions of a health professional.43
In conclusion, LeishCare® was well accepted in endemic areas and may be used by health professionals in their daily practice. The app has benefits for its users even when applied on a small scale. The delivery of a free software stems from the initiative of a Brazilian public university to contribute to the development of technologies for neglected diseases. The release of LeishCare® on Google Play will permit further evaluation of the utility of this tool over time. Despite the positive expectation before the implementation of LeishCare®, our results indicated low adherence of health professional to the installation and routine use of the app. This fact represents a challenge to the creation of digital networks for the management of health problems in Brazil. Many healthcare applications have been made available, but their impact among users is rarely assessed. Hence, it is necessary to address the need of combining the availability of digital technology tools with the assessment of their real acceptance and utility for professionals, especially in areas endemic for infectious and parasitic diseases.
Acknowledgments:
We thank Adriana Vilela da Cunha and Danilo Ulhoa for their support during the study in Paracatu; Joziana Muniz de Paiva Barçante, Richardson Costa Carvalho, and Thales Augusto Barçante for their help provided in Lavras; Agna Soares da Silva Menezes, Bartolomeu Teixeira Lopes, Jamille Fernandes Lula, Josianne Dias Gusmão, Luciano Freitas Fernandes, and Núbia Pereira da Silva for their support in Montes Claros.
REFERENCES
- 1.↑
World Health Organization (WHO), 2019. Leishmaniasis. Geneva, Switzerland: WHO. Available at: https://www.who.int/en/news-room/fact-sheets/detail/leishmaniasis.
- 2.↑
Pan American Health Organization (PAHO). Información General: Leishmaniasis. Available at: https://www.paho.org/hq/index.php?option=com_content&view=article&id=9417:2014-informacion-general-leishmaniasis&Itemid=40370&lang=en. Accessed August 20, 2019.
- 3.↑
Carvalho IPSF, Peixoto HM, Romero GAS, Oliveira MRF, 2017. Cost of visceral leishmaniasis care in Brazil. Trop Med Int Health 22: 1579–1589.
- 4.↑
Assis TSM, Rabello A, Cota G, Werneck GL, Azeredo-da-Silva ALF, 2019. Cost–effectiveness analysis of diagnostic-therapeutic strategies for visceral leishmaniasis in Brazil. Rev Soc Bras Med Trop 52: e20180272.
- 5.↑
Chappuis F, Sundar S, Hailu A, Ghalib H, Rijal S, Peeling RW, Alvar J, Boelaert M, 2007. Visceral leishmaniasis: what are the needs for diagnosis, treatment and control? Nat Rev Microbiol 5: 873–882.
- 6.
Burza S, Simon LC, Marleen B, 2018. Leishmaniasis. Lancet 392: 951–970.
- 7.
Sundar S, Rai M, 2002. Laboratory diagnosis of visceral leishmaniasis. Clin Diagn Lab Immunol 9: 951–958.
- 8.↑
Singh OP, Sundar S, 2015. Developments in diagnosis of visceral leishmaniasis in the elimination era. J Parasitol Res 2015: 239469.
- 9.↑
Bankmycell, 2019. Global Smartphone Penetration Data. How Many People Have Phones in the World? Available at: https://www.bankmycell.com/blog/how-many-phones-are-in-the-world. Accessed February 15, 2020.
- 10.↑
Oliveira ARF, Alencar MSM, 2017. O uso de aplicativos de saúde para dispositivos móveis como fontes de informação e educação em saúde. RDBCI 15: 234–245.
- 11.↑
Visvanathan A, Hamilton A, Brady RRW, 2012. Smartphone apps in microbiology is better regulation required? Clin Microbiol Infect 18: 218–220.
- 13.↑
Boulos MNK, Wheeler S, Tavares C, Jones R, 2011. How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX. Biomed Eng Online 10: 24.
- 14.
Payne KFB, Wharrad H, Watts K, 2012. Smartphone and medical related App use among medical students and Junior doctors in the United Kingdom (UK): a regional survey. BMC Med Inform Decis Mak 12: 121.
- 15.↑
Wood CS, Thomas MR, Budd J, Mashamba-Thompson TP, Herbst K, Pillay D, Peeling RW, Johnson AM, McKendry RA, Steves MM, 2019. Taking connected mobile-health diagnostics of infectious diseases to the field. Nature 566: 467–474.
- 16.↑
Lopes JE, Heimann C, 2016. Uso das tecnologias da informação e comunicação nas ações médicas a distância: um caminho promissor a ser investido na saúde pública. J Health Inform 8: 26–30.
- 17.↑
Gartner, February 2018. Market Share: Final PCs, Ultra Mobiles and Mobile Phones, All Countries, 4Q17. Available at: https://www.gartner.com/en/newsroom/press-releases/2018-02-22-gartner-says-worldwide-sales-of-smartphones-recorded-first-ever-decline-during-the-fourth-quarter-of-2017. Accessed March 1, 2019.
- 18.↑
Fonseca-Junior GS, 2018. Desenvolvimento de um Software para Dispositivos Móveis Visando Auxiliar no Manejo de Indivíduos Doentes, Utilizando Imagens Digitais para Estudo de Sua Evolução. Dissertação, (Mestrado Profissional em Inovação Tecnológica) – Universidade Federal do Triângulo Mineiro, Uberaba, p. 53.
- 19.↑
Ambrozio RB, Fonseca-Junior GS, Jorge DC, Teixeira LAS, 2018. Expectativa de profissionais de saúde sobre o uso de aplicativo para auxílio no diagnóstico e manejo de indivíduos com Leishmaniose. Braz J Infect Dis 22: 33–144.
- 20.↑
Secretaria de Vigilância em Saúde, Ministério da Saúde, Brasil, 2016. Coordenação-Geral de Desenvolvimento da Epidemiologia em Serviços. Elkhoury ANSM, Costa CHN, Costa DL, Badaró F, Romero GAS, Costa JML, Lindoso JÂL, Luz KG, Sousa-Gomes ML, Cavalcante MH, Pompílio MA, Cechinel MP, Rocha RL, Dietze R, Guimarães de Carvalho SF, Alves WA, eds. Guia de Vigilância em Saúde: [recurso eletrônico]/Ministério da Saúde, Secretaria de Vigilância em Saúde, Coordenação Geral de Desenvolvimento da Epidemiologia e Serviços, 1st edition. Brasília: Ministério da Saúde, 773.
- 21.↑
Departamento de Vigilância Epidemiológica, Secretaria de Vigilância em Saúde, Ministério da Saúde, Brasil, 2011. Leishmaniose Visceral: Recomendações Clínicas para Redução da Letalidade/Ministério da Saúde. Brasília: Ministério da Saúde, Secretaria de Vigilância em Saúde. Departamento de Vigilância Epidemiológica, 78 (Série A. Normas e Manuais Técnicos).
- 22.↑
Bhanji F, Gottesman R, Grave W, Steinert Y, Winer LR, 2012. The retrospective pre–post: a practical method to evaluate learning from educational program. Acad Emerg Med 19: 189–194.
- 24.
Minayo MCS, Minayo-Goméz C, 2003. Difíceis e possíveis relações entre métodos quantitativos e qualitativos nos estudos de problemas de saúde. Goldenberg P, Marsiglia RMG, Gomes MHA, Orgs. O Clássico e o Novo: Tendências, Objetos e Abordagens em Ciências Sociais e Saúde. Rio de Janeiro: Fiocruz.
- 25.
Minayo MCS, 2012. Análise qualitativa: teoria, passos e fidedignidade. Ciência Saúde 17: 621–623.
- 26.↑
Minayo MCS, 2008. O Desfio Do Conhecimento: Pesquisa Qualitativa Em Saúde, 11th edition. São Paulo: Hucitec, 407.
- 27.↑
Comissão Nacional de Ética em Pesquisa (CONEP), 2012. Resolução No. 466. Available at: http://conselho.saude.gov.br/resolucoes/2012/Reso466.pdf. Accessed March 1, 2017.
- 28.↑
Mutebi I, Devroey D, 2018. Perceptions on mobile health in the primary healthcare setting in Belgium. mHealth 4: 44.
- 29.↑
Mercês JMR, Redeiro MMP, 2016. A importância dos dispositivos móveis como estratégia para a formação e desenvolvimento de profissionais de Saúde. In: Congresso Internacional ABED de Educação à distância 22. Anais… Águas de Lindóia, São Paulo, Brazil: ABED, art. 306, pp. 1–9.
- 30.↑
Sherwin-Smith J, Pritchard-Jones R, 2012. Medical applications: the future of regulation. Bull R Coll Surg Engl 94: 12.
- 31.↑
Cho J, Park D, Lee HE, 2014. Cognitive factors of using health apps: systematic analysis of relationships among health consciousness, health information orientation, ehealth literacy, and health app use efficacy. J Med Internet Res 16: e125.
- 32.
Nikolic A, Wickramasinghe N, Claydon-Platt D, Balakrishnan V, Smart P, 2018. The use of communication apps by medical staff in the Australian health care system: survey study on prevalence and use. JMIR Med Inform 6: e9.
- 34.↑
Costa DL, Rocha RL, Chaves EBF, Batista VGV, Costa HL, Costa CHN, 2016. Predicting death from kala-azar: construction, development, and validation of a score set and accompanying software. Rev Soc Bras Med Trop 46: 728–740.
- 35.↑
Zenteno O, Zvietcovich F, Zapata D, Maruenda H, Valencia BM, Llanos A, Arevalo J, Montero M, Lavarello R, Castaneda B, 2017. An integrated protocol for the research and monitoring of cutaneous leishmaniasis. IEEE Lat Am Trans 15: 2164–2170.
- 36.↑
Guidini PAA, 2018. Comunicação com o mercado por meio de aplicativos: desafios e oportunidades. Signos Do Consumo 10: 59–69.
- 37.↑
Venkatesh V, Morris MG, Davis GB, Davis FD, 2003. Reviewed user acceptance of information technology: toward a unified view. MIS Q 27: 425–478.
- 38.↑
Schaper LK, Pervan GP, 2007. ICT and OTs: a model of information and communication technology acceptance and utilisation by occupational therapists. Int J Med Inform 76: S212–S221.
- 39.↑
Hilty DM, Chan S, Torous J, Luo J, Boland RJ, 2019. A telehealth framework for mobile health, smartphones, and apps: competencies, training, and faculty development. J Technol Behav Sci 4: 106–123.
- 40.
Hilty DM, Chan S, 2018. Human behavior with mobile health: smartphone/devices, apps and cognition. Psychol Cogn Sci Open J 4: 36–47.
- 41.
Reyes J, Washio Y, Teitelman A, Stringer M, 2018. Usability and acceptability of ever healthier women, a mobile application to enhance informed health choices. J Obstet Gynecol Neonatal Nurs 47: 853–861.
- 42.↑
Grindrod KA, Li M, Gates A, 2014. Evaluating user perceptions of mobile medication management applications with older adults: a usability study. JMIR mHealth and eHealth 2: e11.
- 43.↑
Marin HF, 2012. Sistemas de Informação em saúde: considerações gerais. J Health Inform 2: 20–24.