User experience analysis of e-TB Manager, a nationwide electronic tuberculosis recording and reporting system in Ukraine

Niranjan Konduri, Kelly Sawyer, Nataliya Nizova
ERJ Open Research 2017 3: 00002-2017; DOI: 10.1183/23120541.00002-2017

This article has a correction. Please see:

Abstract

Ukraine has successfully implemented e-TB Manager nationwide as its mandatory national tuberculosis registry after first introducing it in 2009. Our objective was to perform an end-of-programme evaluation after formal handover of the registry administration to Ukraine's Centre for Disease Control in 2015.

We conducted a nationwide, cross-sectional, anonymous, 18-point user experience survey, and stratified the registry's transaction statistics to demonstrate usability.

Contrary to initial implementation experience, older users (aged >50 years), often with limited or no computer proficiency prior to using the registry, had significantly better user experience scores for at least six of the 12 measures compared to younger users (aged 18–29 years). Using the registry for >3 years was associated with significantly higher scores for having capacity, adequacy of training received and satisfaction with the registry. Of the 5.9 million transactions over a 4-year period, nine out of 24 oblasts (regions) and Kiev city accounted for 62.5% of all transactions, and corresponded to 59% of Ukraine's tuberculosis burden. There were 437 unique active users in 486 rayons (districts) of Ukraine, demonstrating extensive reach.

Our key findings complement the World Health Organization and European Respiratory Society's agenda for action on digital health to help implement the End TB Strategy.

Abstract

User experience analysis of Ukraine's nationwide tuberculosis registry by @N_Konduri et al. http://ow.ly/CLJJ309YnkP

Introduction

The agenda for action of the World Health Organization (WHO) and the European Respiratory Society (ERS) for the End TB Strategy seeks digital health solutions to help advance patient care and improve surveillance and completeness of reporting on treatment outcomes [1]. Digital or electronic health applications to manage multidrug resistant tuberculosis (MDR-TB) can contribute to large-scale implementation of new diagnostics and novel medicines, particularly in resource-constrained countries [2]. One such electronic, web-based system is e-TB Manager, which manages much of the information needed by a country's national TB control programme. Developed by Management Sciences for Health (MSH, Arlington, VA, USA) with funding from the United States Agency for International Development (USAID), e-TB Manager integrates data across all aspects of TB control, including information on presumptive cases, patients, medicines, laboratory testing, diagnosis, treatment and outcome [3]. First developed and implemented in Brazil in 2004, e-TB Manager has been steadily implemented in more than a dozen resource-constrained countries including Ukraine, which is among the 30 high-burden MDR-TB countries worldwide, and the second highest in the European region [4]. After the institutionalisation of e-TB Manager following the end of international and south-to-south technical support in a given country, the source code and technical documentation is handed over to local authorities.

In 2008, as Ukraine confronted its growing TB and MDR-TB burden, it had no electronic system for its vast TB programmes, which were managed by various government agencies, including the state penitentiary system. The quality of the existing paper-based information systems varied. TB control was hampered by weak information, tracking and reporting systems. In response to a request from Ukraine's Ministry of Health, the USAID-funded Strengthening Pharmaceutical Systems programme, implemented by MSH, conducted an initial assessment of customisation needs for e-TB Manager and developed a version suitable for Ukraine. In 2009, e-TB Manager was piloted in six oblasts (regions). A 2010 WHO review of Ukraine's TB programme acknowledged e-TB Manager's beneficial role in supporting management decisions on improving programme performance, including information on case notification and treatment outcomes [5]. In 2010 and 2011, MSH continued to refine e-TB Manager based on user and Ministry of Health feedback, stabilised the platform to ensure continuous access, and trained pilot oblast users in data entry and use. In 2012, in accordance with Ukrainian law on patient confidentiality and information security, the state service of special communication and information protection issued a security certificate for e-TB Manager. With certification complete, the Ministry of Health designated e-TB Manager as the official “national TB registry”. A companion Ministry of Health order specified official adoption, authorisation and requirements for use as well as reports to be produced.

Despite the Euromaidan revolution and socioeconomic crisis, the registry was implemented in all 24 oblasts of Ukraine and the city of Kiev by 2014. In October 2015, following >7 years of international assistance and partnership, the USAID-funded Systems for Improved Access to Pharmaceuticals and Services (SIAPS) Programme, implemented by MSH, handed over the administration of the registry to the Ministry of Health's Ukrainian Centre for Disease Control (UCDC) [6]. The operation and maintenance of the registry is now funded partially by the government of Ukraine and partially by the Global Fund to Fight AIDS, Tuberculosis and Malaria. The objective of this article is to present key findings from our end-of-programme evaluation and share lessons learned from an implementer perspective, sought by the WHO/ERS task force statement, and for donors alike [7–10].

Methods

Our end-of-programme evaluation, part of the institutionally approved work plan and conducted according to the principles of the Declaration of Helsinki [11], drew upon selected usability methods [12]. We retrieved data to demonstrate the usability of the registry through a stratified analysis of geographical and anonymous TB health unit transaction statistics. No patient-related data were analysed. In addition, we retrieved and translated cross-sectional data from the UCDC that measured completeness of reporting by comparing paper-based records with those from the registry. A cross-sectional, anonymous, nationwide survey was conducted to assess the overall user experience of the registry. Our adapted questionnaire had six items on user characteristics, 12 core questions with a 0–7 scale (strongly disagree to strongly agree), and an open text box for comments (see online supplementary material) [13]. The UCDC administered the user experience survey in September and October 2015 and provided the survey's hyperlink to all active users.

Data analysis

Our hypothesis was that years of experience using the registry and years of experience working in the TB programme could influence user experience positively, as reflected in mean scores for the dependent variables (12 core questions). If a user is not knowledgeable about programmatic and clinical management of MDR-TB and its associated recording and reporting procedures necessary for both paper-based systems and electronic applications, the job can be difficult [14, 15]. During the registry's initial implementation, older physicians and health workers resisted using the registry, had limited or no computer proficiency or preferred paper-based systems. During nationwide implementation, the UCDC expected better quality and timeliness of reporting from the rayons (cities and districts of administration) of Ukraine. Therefore, we compared the mean scores of the core questions among user groups based on years of experience using the registry, years working in a TB programme, age and location. We used t-tests to compare the mean scores among two groups of users and ANOVA to compare more than two groups using Tukey's post hoc test [16]. We also investigated three-way interactions and provided effect size values [17]. Statistical analysis was performed using SPSS (version 22.0; SPSS, Chicago, IL, USA). Only completed responses for all required questions were analysed. Anonymous, open-text comments were coded and analysed based on frequency and correlation of paired themes using NVivo 11 (QSR International, Melbourne, Australia) and presented visually [18].

Results

Survey findings

We received 329 responses from 565 active users (58.2% initial response rate), of which 303 included completed responses to all required questions (53.6% usable response rate). Cronbach's α was 0.81 for all 12 questions, and 0.85 for the 10 questions without the two reverse-worded questions, which indicated the questionnaire's high internal consistency. Table 1 provides demographic data of the respondents. Users with >3 years of experience using the registry generally had higher scores than those with <2.5 years of experience, and significance was detected for six out of 12 questions (table 2). Users with <2 years of experience working in the TB programme had relatively lower mean scores for all questions than those with more experience (table 3). For the two reverse-worded questions (Q9 and Q10), where lower scores are better and indicate the level of disagreement, those with 5–10 years of experience had the lowest scores and differed significantly from those with <2 years of experience.

View this table:
TABLE 1

Demographic characteristics of respondents

View this table:
TABLE 2

Comparison of responses by number of years using the national tuberculosis (TB) registry

View this table:
TABLE 3

Comparison of responses by number of years worked in the national tuberculosis (TB) programme

Users aged >50 years had higher scores for at least eight questions and differed significantly from users aged 18–29 years for six out of the 12 questions (table 4). Users aged 30–39 years differed from their peers in their opinion that the registry does not help identify errors or inaccuracies in patient files (Q10), and the difference from users aged 18–29 years was significant. The comparison of mean scores between users at the oblast and rayon levels is presented in the online supplementary material. Significant findings for the three-way ANOVA examining the effects of years using the registry and years working in a TB programme, each with age and location, are presented in table 5. While there were main effects for years of experience using the registry with the selected variables and predominantly significant two-way interactions, the effect size, as expressed in η2, was small. There was a medium effect size for age with years working in the TB programme concerning the belief that generating reports using a paper system is faster than the registry. Figures 1⇓–3 and table 6 present the qualitative analysis of the relationship between major themes based on feedback from 74 out of 303 respondents.

View this table:
TABLE 4

Comparison of responses by age categories

View this table:
TABLE 5

Significant findings of three-way ANOVA

View this table:
TABLE 6

Correlation of key themes

FIGURE 1
FIGURE 1

Most frequent words and phrases based on user comments about the registry. Word cloud representing the most frequent words based on 74 user comments about the registry. The font size represents how frequently the terms occur. Only stemmed words were utilised, with a minimum length of three words; the word “registry” was not included in this analysis.

FIGURE 2
FIGURE 2

Major themes from the user comments. Comments from 74 users were coded into 11 major themes. #: server or registry platform; : paper-based reports and registry data fields; +: suggestions on registry structure.

FIGURE 3
FIGURE 3

Dendrogram: themes clustered by word similarity. Themes clustered by word similarity: the dendogram is the result of a cluster analysis of user comments that clustered selected themes together if they have many words in common. Similar items are clustered together on the same branch and different items are positioned further apart. #: server or registry platform; : suggestions on registry structure; +: paper-based reports and registry data fields.

Stratified usability analysis

Figure 4 presents the distribution of active users and average transactions per active user for each oblast stratified by TB burden. For example, the Lviv oblast with 91 active users had an average transaction of 3000 per active user, compared to the Mykolaiv oblast with half as many active users with an average transaction of 10 000 per active user. Nine out of 24 oblasts and Kiev city accounted for 62.5% of user transactions and 59% of Ukraine's TB burden. Online supplementary table S4 lists anonymous usability statistics among active registry users since inception for all 24 oblasts and Kiev (5.90 million cumulative transactions). As of June 2016, there were nearly 2000 registered users across 722 registered TB units nationwide. However, only 1319 users across 647 active TB units are considered active, because they logged at least one transaction in the previous 12 months. The highest average transactions per TB unit occurred in the Donetsk oblast (27 110), followed by Kiev city (19 037). Online supplementary table S4 highlights the extent of the registry's nationwide user coverage beyond oblast and city administration, particularly in rayons, towns and other cities. Figure 5 illustrates cumulative usability statistics for selected data fields from the registry's case module among the top 10 TB units by transaction volume. The UCDC-monitored, -analysed and -reported data on correspondence of paper-based records with the registry is provided in the online supplementary material.

FIGURE 4
FIGURE 4

Usability statistics among active users of the national tuberculosis (TB) registry by TB burden. Each oblast (region) lists the number of active registry users in June 2016. Numbers in parentheses indicate average transactions per user in thousands (k). For example, the Kherson oblast with a medium TB burden has 50 active users with an average of 6000 transactions per user. Registry transactions are cumulative, from 2011 to June 2016 (online supplementary material). Nine out of 24 oblasts and Kiev accounted for 62.5% of cumulative transactions and 59% of the TB burden.

FIGURE 5
FIGURE 5

Usability statistics among top 10 tuberculosis (TB) units by transaction type for key data fields. This figure presents anonymous cumulative transaction statistics for selected data fields from the registry's case module from January 2012 to May 2016. The top 10 out of 647 active TB health units, accounting for nearly a third of the total cumulative transaction volume (5.9 million) are presented (online supplementary material). DST: drug susceptibility testing; LPA: line probe assay.

Discussion

Our study sheds light on several factors associated with overall user experience and usability of the registry. Users gave high ratings to the registry's ability to help improve case management. Upon entering the registry, a dashboard presents real-time data for the patients being managed at that facility in areas such as case notification, treatment progress, medicines adherence, status of medicines and diagnostic supplies and tags to flag data quality issues. From an oblast administrator perspective, the chief TB doctor responsible for validating treatment protocols can easily review individual cases and laboratory results, validate the treatment regimen, remotely monitor adherence to clinical guidelines and take corrective action by using alerts embedded in the registry. Users strongly agreed that the information needed for case management is available in the registry. This is not surprising, given that the number of cases entered in the registry substantially increased from 120 472 in 2014 to 227 657 in 2016. A WHO assessment found that the proportion of missing information in the registry did not exceed 10% [19]. Complemented by the UCDC's analysis of data correspondence of paper-based reports with that of the registry (online supplementary material) and the usability statistics, the survey findings confirm that changes in the human element and behaviour change over time were important factors in users embracing the registry. Users with >3 years of experience with the registry at the rayon level, or aged >50 years had significantly higher mean scores for agreeing that information is available in the registry. By contrast, oblast-level users had significantly lower scores, possibly because these users are generally supervisors or administrators responsible for aggregating data, and are more likely to detect data quality issues such as for accuracy or completeness.

Users with >3 years of registry experience had significantly higher scores than users with less experience for satisfaction, capacity, adequacy of training received and perceived reliability of the registry; this finding is associated with longer use of electronic applications [20]. There was also a main effect on having capacity for number of years using the registry and number of years working in a TB programme, suggesting that with more use and experience, regardless of age, the user eventually gets comfortable with the registry and understands UCDC recording and reporting expectations. Contrary to the finding of another study [21], we found that older users generally had a positive user experience according to many of the variables and differed significantly from users aged 18–29 years, while another study reported no effect for age [22]. The WHO has promoted electronic TB recording and reporting to improve surveillance and support meaningful decision making based on access to accurate, timely and useful information [23]. Consequently, there was generally a high rating for improved workplace productivity due to the registry, particularly among older users. Management and clinical decisions can be made easily, reducing time to decision, as was briefly described in one oblast of Ukraine [24]. One chief TB doctor reported that the time taken to initiate antiretroviral therapy among TB patients dropped from 104 days to 48 days due to the registry.

With system issues (e.g. slow server or too many registry updates) being the dominant theme among user comments (figures 1–3), younger users probably have unmet expectations, including the need for more computers to minimise sharing. Compared to users aged 18–29 years, older users probably have lower expectations and have experienced tougher working conditions [25]. The USAID SIAPS programme and the Global Fund to Fight AIDS, Tuberculosis and Malaria initially supported the purchase of 534 computers, but our survey found a moderate correlation between physician resistance and computer access (figures 1–3 and online supplementary material), which is consistent with previous studies [26]. Over the years, the UCDC has kept pace with necessary programmatic changes based on WHO guidelines and updated reporting requirements and upgraded the registry based on user feedback. From 2012 to 2016, 137 system updates were made for continuous quality improvement of the registry. The 10 most recent registry updates with pictorial instructions is a good example of e-learning methodologies promoted by the WHO and ERS [27]. A dedicated staff at the UCDC's national helpdesk fields on average 150 phone calls and emails a week, and after updates are released, this can jump to >1200 calls and emails each week. Yet, regardless of user characteristics, the overall mean scores on support and infrastructure were low. Additionally, there was a high level of user disagreement, as expressed in low mean scores on not needing more training and the moderate correlation of retraining needs with physician resistance, system issues and data quality (figures 1–3 and online supplementary table S3). Despite a relatively high score on having capacity, users expect annual training that can also serve to share experiences and improve data quality and reporting. However, training budgets in resource-constrained public-sector settings are limited. Increasing usage presents new challenges in the provision of user support. On-the-job mentoring, refresher training and supportive supervision contribute to a better user experience.

Our study findings have implications for other implementers interested in applying digital health applications in resource-constrained settings. In our experience, building sustained user (individual) and institutional capacity took >5 years, particularly when dealing with poor computer literacy, resistance to change and infrastructure challenges, among others. More research must be undertaken to investigate the root cause of persistent physician resistance. Future studies must compare differences between nurses, laboratory technicians, statisticians/data analysts, pharmacists and administrators. Such analysis could contribute to the development of an implementation model based on workflow design and job responsibilities for digital health application in other resource-constrained settings.

As with any observational study, our findings must be interpreted with caution (online supplementary material). Some or many of the findings presented here may have been addressed by the UCDC in the months following the cross-sectional survey. Although 66% of nearly 2000 registered users (June 2016 data) were considered active based on at least one transaction in the previous 12 months, a limitation of the usability statistics is that we do not account for passive users. We are unable to determine the registered passive users who could be senior ministry personnel who occasionally view the data, supervisors who only generate reports, university staff or researchers, who do not perform transactions, but were nevertheless granted access to the registry.

This is the first elaborate country-level study on user experience and usability of e-TB Manager in resource-constrained settings, and, to our knowledge, the first from Ukraine in the English language. Our end-of-programme findings are significant, given that Ukraine's global ranking on overall government usage of information communication technologies (ICTs) declined from 56 in 2009 to 124 in 2015 [28]. Ukraine's global ranking for political and regulatory environment for ICTs also declined from 95 in 2009 to 122 in 2015 (the same years as the nationwide scale-up of the registry). Notably, at the time of the survey, there were 565 active users, and this increased to 1319 active users over the following 9 months, illustrating the expansion of the registry to more TB units and rayons of Ukraine and increasing usage. The UCDC, now part of the public health centre, provided strong leadership and commitment to implementing the national TB registry despite political unrest, military conflict and socioeconomic challenges while confronting the MDR-TB burden [29–31]. In conclusion, Ukraine's experience and resilience in implementing its national TB registry using the e-TB Manager platform is testament to the WHO/ERS's digital health agenda to help implement the End TB Strategy and a model for other resource-constrained countries.

Supplementary material

Supplementary Material

Please note: supplementary material is not edited by the Editorial Office, and is uploaded as it has been supplied by the author.

00002-2017_Online_Supplement

Disclosures

Supplementary Material

N. Konduri 00002-2017_Konduri

N. Nizova 00002-2017_Nizova

K. Sawyer 00002-2017_Sawyer

Acknowledgements

We gratefully acknowledge the Ukrainian Centre for Disease Control (now part of the Public Health Centre) for its support of the end-of-programme evaluation conducted by the US Agency for International Development (USAID) Systems for Improved Access to Pharmaceuticals and Services (SIAPS) Program of Management Sciences for Health (MSH). The authors extend thanks to Juanita Folmsbee and Alexandra Brodovskaya for their management support and to Artem Dancheko and Alexey Kurasov for validating the Ukrainian version of the survey (SIAPS Program, Pharmaceuticals and Health Technologies Group, MSH, Kiev, Ukraine). We thank Slavik Miroshnychenko (consultant interpreter, Kiev, Ukraine) for helping with translation of user comments into English. We thank L. Gustavo V. Bastos (Global Drug Facility, Stop TB Partnership, Geneva, Switzerland), the former global technical lead of e-TB Manager, for contributing to the survey design of the multicountry study, which included Ukraine. Susan Gillespie (Pharmaceuticals and Health Technologies Group, MSH, Arlington, VA, USA) and Mia Roca Alcover (MSH, Medford, MA, USA) are appreciated for their support in the production of this manuscript. The authors are grateful to the anonymous reviewer(s) whose feedback improved the presentation of this work.

Footnotes

  • This article has been revised according to the correction published in this issue of ERJ Open Research.

  • This article has supplementary material available from openres.ersjournals.com

  • Support statement: This work was supported by the US Agency for International Development (USAID) (Washington, DC, USA) cooperative agreement number AID-OAA-A-11-00021. No funding bodies had any role in the study design, data collection, analysis or decision to publish. The findings, opinions and conclusions in this article are those of the authors, and do not necessarily represent the views and opinions of the Public Health Centre, Ministry of Health of Ukraine, Management Sciences for Health, SIAPS, USAID or the US Government. Funding information for this article has been deposited with the Crossref Funder Registry.

  • Conflict of interest: Disclosures can be found alongside this article at openres.ersjournals.com

  • Received January 3, 2017.
  • Accepted March 5, 2017.

This article is open access and distributed under the terms of the Creative Commons Attribution Non-Commercial Licence 4.0.

References

  1. ↵
    World Health Organization, European Respiratory Society. Digital Health for the End TB Strategy: an Agenda for Action. Geneva, WHO, 2015.
  2. ↵
    1. Falzon D,
    2. Timimi H,
    3. Kurosinski P, et al.
    Digital health for the End TB Strategy: developing priority products and making them work. Eur Respir J 2016; 48: 29–45.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    USAID SIAPS Program. e-TB Manager. Management Sciences for Health, Arlington, VA. http://siapsprogram.org/tools-and-guidance/e-tb-manager Date last accessed: February 22, 2017.
  4. ↵
    World Health Organization (WHO). Global Tuberculosis Report 2016. Geneva, WHO, 2016.
  5. ↵
    1. de Colombani P,
    2. Veen J
    . Review of the National Tuberculosis Programme in Ukraine. Copenhagen, World Health Organization Regional Office for Europe, 2011. www.euro.who.int/__data/assets/pdf_file/0007/142369/e95006.pdf Date last accessed: February 22, 2017.
  6. ↵
    USAID SIAPS Program. Institutionalizing e-TB Manager as a national TB registry in Ukraine. Management Sciences for Health, Arlington VA. http://siapsprogram.org/2015/11/04/institutionalizing-e-tb-manager-as-a-national-tb-registry-in-ukraine/ Date last accessed: February 22, 2017. Date last updated: November 4, 2015.
  7. ↵
    United States Agency for International Development. USAID Evaluation Policy 2011. Washington, DC, United States Agency for International Development. Updated October 2016.
  8. The Global Fund. The Role of the Global Fund. Supporting Countries to Build Resilient and Sustainable Systems for Health. Geneva, The Global Fund to Fight AIDS, Tuberculosis and Malaria, 2015.
  9. The White House. National Action Plan for Combating Multidrug-Resistant Tuberculosis. Washington, DC, 2015.
  10. ↵
    United States Government. Global TB Strategy 2015–2019. Washington DC, United States Government, 2015.
  11. ↵
    World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA 2013; 310: 2191–2194.
    OpenUrlCrossRefPubMed
  12. ↵
    US Department of Health & Human Services. What and Why of Usability. www.usability.gov Date last accessed: February 22, 2017.
  13. ↵
    1. Were MC,
    2. Emenyonu N,
    3. Achieng M, et al.
    Evaluating a scalable model for implementing electronic health records in resource-limited settings. J Am Med Inform Assoc 2010; 17: 237–244.
    OpenUrlAbstract/FREE Full Text
  14. ↵
    1. Minnery M,
    2. Contreras C,
    3. Pérez R, et al.
    A cross sectional study of knowledge and attitudes towards tuberculosis amongst front-line tuberculosis personnel in high burden areas of Lima, Peru. PLoS One 2013; 8: e75698.
    OpenUrl
  15. ↵
    1. van der Werf MJ,
    2. Langendam MW,
    3. Huitric E, et al.
    Knowledge of tuberculosis-treatment prescription of health workers: a systematic review. Eur Respir J 2012; 39: 1248–1255.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Kao LS,
    2. Green CE
    . Analysis of variance: is there a difference in means and what does it mean? J Surg Res 2008; 144: 158–170.
    OpenUrlCrossRefPubMed
  17. ↵
    1. Lakens D
    . Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol 2013; 4: 863.
    OpenUrlCrossRefPubMed
  18. ↵
    1. Woods M,
    2. Paulus T,
    3. Atkins DP, et al.
    Advancing qualitative research using qualitative data analysis software (QDAS)? Reviewing potential versus practice in published studies using ATLAS.ti and NVivo, 1994–2013. Soc Sci Comput Rev 2016; 34: 597–617.
    OpenUrlCrossRef
  19. ↵
    1. Hovhannesyan A,
    2. Motrich I,
    3. Dadu A
    . Tuberculosis in Ukraine: Epidemiological Impact Analysis. Copenhagen, World Health Organization Regional Office for Europe, 2015.
  20. ↵
    1. Menachemi N,
    2. Powers TL,
    3. Brooks RG
    . Physician and practice characteristics associated with longitudinal increases in electronic health records adoption. J Healthc Manag 2011; 56: 183–197.
    OpenUrlPubMed
  21. ↵
    1. Wylie MC,
    2. Baier RR,
    3. Gardner RL
    . Perceptions of electronic health record implementation: a statewide survey of physicians in Rhode Island. Am J Med 2014; 127: 1010.e21–1010.e27.
    OpenUrlCrossRef
  22. ↵
    1. Dünnebeil S,
    2. Sunyaev A,
    3. Blohm I, et al.
    Determinants of physicians’ technology acceptance for e-health in ambulatory care. Int J Med Inform 2012; 81: 746–760.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Timimi H,
    2. Falzon D,
    3. Glaziou P, et al.
    WHO guidance on electronic systems to manage data for tuberculosis care and control. J Am Med Inform Assoc 2012; 19: 939–941.
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. Konduri N
    . Empowerment and Sustainability: Web-based Technology for Tuberculosis Care. The Lancet Global Health Blog. http://globalhealth.thelancet.com/2016/10/24/empowerment-and-sustainability-web-based-technology-tuberculosis-care Date last accessed: February 22, 2017. Date last updated: October 24, 2016.
  25. ↵
    1. Konduri N
    . Ending Tuberculosis in Ukraine: Motivated Frontline Health Workers are Key in Achieving WHO Goals. The Lancet Global Health Blog. http://globalhealth.thelancet.com/2015/12/18/ending-tuberculosis-ukraine-motivated-frontline-health-workers-are-key-achieving-who Date last accessed: February 22, 2017. Date last updated: December 8, 2015.
  26. ↵
    1. Fritz F,
    2. Tilahun B,
    3. Dugas M
    . Success criteria for electronic medical record implementations in low-resource settings: a systematic review. J Am Med Inform Assoc 2015; 22: 479–488.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    Ukraine Centre for Disease Control. National TB Registry Release Updates. http://ucdc.gov.ua/en/pages/diseases/tuberculosis/register_of_patients. Date last accessed: February 22, 2017.
  28. ↵
    1. Dutta S,
    2. Geiger T,
    3. Lanvin B
    . The Global Information Technology Report. ICTs for Inclusive Growth. Geneva, World Economic Forum and INSEAD, 2015.
  29. ↵
    1. Pavlova O,
    2. Moskalyk D
    . Improvement of the information management system by the use of the e–TB Manager 2013. Panel presentation for: Using information and tools for effective decision making. 1st Conference on Pharmaceutical Management for TB and M/XDR-TB for WHO European Region. Antalya, Turkey, 10–13 December, 2013.
  30. USAID SIAPS Program. e-TB Manager Promotes Treatment Quality and Evidence-Based Forecasting of TB Medicines in Ukraine. 2015. Technical Brief. Management Sciences for Health, Arlington VA. http://siapsprogram.org/publication/e-tb-manager-promotes-treatment-quality-and-evidence-based-forecasting-of-tb-medicines-in-ukraine/ Date last accessed: February 22, 2017. Date last updated: October 13, 2016.
  31. ↵
    Eurasian Harm Reduction Network. Quote from Nataliya Nizova, Head of UCDC. Regional high-level dialogue on Addressing the tuberculosis and multi-drug resistant tuberculosis in EECA: opportunities and challenges. 2015. www.harm-reduction.org/30-september-session-3-addressing-tuberculosis-and-multi-drug-resistant-tuberculosis-eeca Date last accessed: February 22, 2017.
Back to top
Email
Print
Citation Tools
User experience analysis of e-TB Manager, a nationwide electronic tuberculosis recording and reporting system in Ukraine
Niranjan Konduri, Kelly Sawyer, Nataliya Nizova
ERJ Open Research Apr 2017, 3 (2) 00002-2017; DOI: 10.1183/23120541.00002-2017
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

Subjects