Skip to main content

Main menu

  • Home
  • Current issue
  • Early View
  • Archive
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Institutional open access agreements
    • Peer reviewer login
  • Alerts
  • Subscriptions
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

User menu

  • Log in
  • Subscribe
  • Contact Us
  • My Cart

Search

  • Advanced search
  • ERS Publications
    • European Respiratory Journal
    • ERJ Open Research
    • European Respiratory Review
    • Breathe
    • ERS Books
    • ERS publications home

Login

European Respiratory Society

Advanced Search

  • Home
  • Current issue
  • Early View
  • Archive
  • Authors/reviewers
    • Instructions for authors
    • Submit a manuscript
    • Institutional open access agreements
    • Peer reviewer login
  • Alerts
  • Subscriptions

Assessing usability of QIAreach QuantiFERON-TB platform in a high tuberculosis prevalence, low-resource setting

Conceptor Kaaba, Maria Ruperez, Barry Kosloff, Nduku Ndunda, Kwame Shanaube, Helen Ayles on behalf of the TREATS Study Team
ERJ Open Research 2021 7: 00511-2021; DOI: 10.1183/23120541.00511-2021
Conceptor Kaaba
1Zambart, Lusaka, Zambia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Conceptor Kaaba
  • For correspondence: conceptor@zambart.org.zm
Maria Ruperez
2London School of Hygiene and Tropical Medicine, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Barry Kosloff
1Zambart, Lusaka, Zambia
2London School of Hygiene and Tropical Medicine, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nduku Ndunda
3Cepheid Middle East, a Danaher company FZ LLC, Dubai, United Arab Emirates
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kwame Shanaube
1Zambart, Lusaka, Zambia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helen Ayles
1Zambart, Lusaka, Zambia
2London School of Hygiene and Tropical Medicine, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

QIAreach QuantiFERON-TB is a portable IGRA with the potential to improve accessibility of TB infection diagnosis in low-resource settings https://bit.ly/3nTzolf

To the Editor:

The World Health Organization (WHO) estimates that 1.8 billion people, close to a quarter of the world's population are infected with Mycobacterium tuberculosis [1]. Despite substantial declines in tuberculosis (TB) incidence over the past decade, Zambia still has the seventh highest TB incidence in sub-Saharan Africa and remains one of the 30 WHO high TB-burden priority countries [2]. In 2019, there were ∼59 000 new individuals with active TB disease in Zambia (incidence rate of 333 per 100 000 per year), which resulted in 15 400 TB-related deaths, of which 62% were among people living with HIV [2].

Management of TB infection represents a neglected component of national TB programmes [3]. A reliable diagnosis followed by successful TB preventive therapy is crucial to reach the End TB strategy goals and to eliminate TB [4, 5]. Tuberculin skin test (TST) and interferon-γ release assays (IGRAs) are the main diagnostic tools for TB infection diagnosis, however, both present strengths and limitations [6]. The TST requires two visits, is not easy to administer and is influenced by conditions, including bacille Calmette–Guérin vaccination, that can reduce the skin reactivity [7–9]. IGRAs were demonstrated to overcome the drawbacks of TST [10]. To date, two IGRA tests are recommended by the WHO: T-SPOT.TB (Oxford Immunotec, Abingdon, UK) and QuantiFERON-TB Gold Plus (QFT-Plus; QIAGEN, Hilden, Germany) [11].

The QFT-Plus is a new generation IGRA that uses innovative antigens that elicit both CD8 and CD4 T-cell responses, enabling a more comprehensive assessment of cell-mediated immune response to TB infection [12, 13]. The need for established laboratory infrastructure and trained personnel represent one of the main barriers for the implementation of QFT-Plus in low-resource settings [14]. QIAGEN has recently developed a new lateral flow immunoassay for the diagnosis of TB infection, the QIAreach QuantiFERON-TB (QIAreach QFT) assay. The prototype QIAreach QFT is a semi-automated assay that uses the same TB2 tube as QFT-Plus to detect interferon-γ in plasma released from both CD4 and CD8 T-cells. After incubation, without the need to perform enzyme-linked immunosorbent assay (ELISA), the sample is analysed on a portable platform, eHubs, performing up to eight tests in 20 min, providing a final qualitative result (positive, negative, or error) [15, 16].

In this study we aimed to assess the usability of the prototype QIAreach QuantiFERON platform in a high TB prevalence, low-resource setting. We report the results of the prototype QIAreach QFT assay usability study conducted in 2019 across six laboratories in Zambia using whole blood collected from participants enrolled in the Tuberculosis Reduction through Expanded Antiretroviral Treatment and Screening (TREATS) infection cohort study.

The study was conducted across six laboratories situated in four provinces of Zambia. The six laboratories were the Zambart Central Laboratory located in Lusaka (Lusaka province) and five regional laboratories located in Livingstone (Southern province), Choma (Southern province), Kabwe (Central province), Ndola (Copperbelt province) and Kitwe (Copperbelt province). The selected laboratories were purposively and conveniently chosen due to their involvement with the TREATS infection cohort study in Zambia and are not representative of the total Zambian population. Usability of the prototype QIAreach QFT and training needs for the assay implementation were assessed across three domains: effectiveness, efficiency, and user satisfaction.

To achieve a valid preliminary data on usability, nine laboratory workers (two laboratory assistants, three laboratory scientists and four laboratory technicians) were purposively selected based on their job title and laboratory experience [17]. Operators were provided with the following: the QIAreach QFT eHub, a laptop computer with pre-installed QIAreach QFT software (optional; for connectivity with laboratory reporting systems only), QIAreach QFT test kits and diluent buffer, QIAreach QFT package insert, an adjustable standard laboratory pipette capable of dispensing 150 µl and disposable pipette tips, and TB2 tube with harvested plasma. During the usability testing, operators were asked to read the instructions outlined in the package insert, and complete four tasks using both the eHubs and software. The operators did not receive any initial aid from the observer. If participants struggled with a task, the observer provided hints to help users through the process.

For each task, metrics on success (pass, fail, pass with hints), total task time, and ease of use rating (five-point Likert scale) were collected. Total task time is an indicator of user efficiency. Shorter task times on subsequent identical tasks are indicative of learnability. Common errors were collected after assay completion and categorised into those issues that prevent the user from completing the assay and those that increase the risk of human error during the task.

Written consent was obtained from eligible participants, who agreed to take part in the TREATS infection cohort at enrolment and there was no additional consent obtained for this study.

Ethics approval for the infection cohort was obtained from the Biomedical Research Ethics Committees of the University of Zambia, Lusaka, Zambia and the London School of Hygiene and Tropical Medicine, London, UK.

Overall task completion rate was 89–100%. Table 1 provides a visual representation of the pass and fail rates of each task. One participant out of nine could not understand the software instructions in the QIAreach QFT package insert. However, the participant was able to complete the assay manually. Two participants had difficulty loading the sample on the QIAreach eStick. The average time from setup to results ranged from 22 to 40 min. Users with experience performing the QFT-Plus assay completed the test faster than users without experience, 26 min versus 35 min. Two participants were unable to adjust the pipette to the required volume of 150 µL. Two participants tried to mix the test sample up and down without the disposable tip on the pipette. One participant transferred the sample buffer twice and added insufficient plasma to the sample processing tube. Two participants added the test sample to the eStick sample port many times. One participant added wrong information in the software.

View this table:
  • View inline
  • View popup
TABLE 1

Summary of task success rate, time from setup to results and user satisfaction by participant

On average, participants had 7 years of laboratory experience. When asked about previous experience with IGRA technology, six operators reported experience using the QuantiFERON Gold-In-Tube/Plus.

The QIAreach QFT test provides a significant contribution to global TB infection diagnostics. The usability assessment of the prototype QIAreach QFT represents an important aspect that affects user acceptance and the introduction of a new test into the TB care cascade. In our study, we found that all participants obtained valid results and could use the platform without any problems or with little difficulties. Operators with prior experience with QFT-Plus completed the tasks faster than users without prior experience. Only one operator did not use the software due to his limited computer skills. The study also showed that seven operators out of nine correctly used a laboratory pipette without any difficulty. The key issue categorised as being at risk of human error when performing the assay was a lack of practice using the standard laboratory pipette. However, considering that the skills for using laboratory pipettes in low-resource settings are very limited, a disposable pipette and video training is recommended to reduce errors.

The primary driver of failed tasks was lack of expertise in using computers. High inconsistencies with the features of the device and those described in the instructions were found. Regardless of these challenges, an ease-of-use rating was assigned, with a majority of participants reporting ratings of 4 or 5 on a Likert scale for assay usability. When asked about satisfaction, the participants commented on the platform being user-friendly, the content being enough and the instructions being easy to understand and follow. The time taken for each user to perform the assay from the first to the last sample decreased as the user's experience and familiarity with the assay increased.

This study demonstrated that the prototype QIAreach QFT has a number of operational advantages compared with the more complex current IGRA assays. The prototype QIAreach QFT is an innovative digital lateral flow, battery operated system that replaces the laboratory-based ELISA workflow. The system also uses an optimised single tube workflow requiring 1 mL compared with the 4 mL needed for QFT-Plus and T-SPOT. The QIAreach QFT assay requires a time to results of 20 min compared with the 150 min needed for the ELISA-based detection assay. In addition, the QIAreach QFT allows eight samples to be run independently eliminating the need to batch samples and providing timely TB infection diagnosis.

The QIAreach QFT assay is suitable for implementation in remote areas, where limited infrastructure has hampered the accessibility of IGRA technologies to those in need. Further studies are needed to establish the assays performances as well as the feasibility of introducing this new assay at larger scale to improve TB control in regions with limited infrastructure.

Acknowledgement

Authors would like to express their sincere appreciation and gratitude to all members of the TREATS infection cohort study team in Zambia, and to the study participants and their communities, and to the Zambart and non-Zambart laboratory staff, for their contributions to the research. The content herein is solely the responsibility of the authors.

Footnotes

  • Provenance: Submitted article, peer reviewed.

  • Author contributions: M. Ruperez, N. Ndunda and H. Ayles conceived and designed the study. C. Kaaba made substantial contributions to the acquisition of the data. C. Kaaba, B. Kosloff and N. Ndunda helped with analysis and interpretation of data. K. Shanaube and C. Kaaba took the lead in writing the paper with input from all authors. K. Shanaube, H. Ayles and C. Kaaba revised the paper critically for intellectual content. All authors were involved in the final approval of the version to be submitted.

  • Conflict of interest: Some of the authors (C. Kaaba, M. Ruperez, B. Kosloff, K. Shanaube and H. Ayles) declare receiving a grant from EDCTP for TREATS and one author (N. Ndunda) is a former employee of QIAGEN. QIAGEN (Hilden, Germany) provided the QIAreachTM QuantiFERON-TB test kits free of charge.

  • Support statement: QIAGEN (Hilden, Germany) provided the QIAreachTM QuantiFERON-TB test kits free of charge. QIAGEN had no role in study design, collection, analysis or interpretation of data. This project is part of the EDCTP2 programme supported by the European Union (grant number RIA2016S-1632-TREATS). Funding information for this article has been deposited with the Crossref Funder Registry.

  • Received August 17, 2021.
  • Accepted October 27, 2021.
  • Copyright ©The authors 2021
http://creativecommons.org/licenses/by-nc/4.0/

This version is distributed under the terms of the Creative Commons Attribution Non-Commercial Licence 4.0. For commercial reproduction rights and permissions contact permissions{at}ersnet.org

References

  1. ↵
    1. TB Alliance
    . TB is a Pandemic. www.tballiance.org/why-new-tb-drugs/global-pandemic
  2. ↵
    1. World Health Organization
    . Global Tuberculosis Report 2020. Geneva, World Health Organization, 2020. www.who.int/publications/i/item/9789240013131
  3. ↵
    1. Harries A,
    2. Kumar A,
    3. Satyanarayana S, et al.
    Treatment for latent tuberculosis infection in low- and middle-income countries: progress and challenges with implementation and scale-up. Expert Rev Respir Med 2020; 14: 195–208. doi:10.1080/17476348.2020.1694907
    OpenUrl
  4. ↵
    1. Chakaya JM,
    2. Harries AD,
    3. Marks GB
    . Ending tuberculosis by 2030 – pipe dream or reality? Int J Infect Dis 2020; 92: S51–S54. doi:10.1016/j.ijid.2020.02.021
    OpenUrl
  5. ↵
    1. Matteelli A,
    2. Rendon A,
    3. Tiberi S, et al.
    Tuberculosis elimination: where are we now? Eur Respir Rev 2018; 27: 180035. doi:10.1183/16000617.0035-2018
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Zhou G,
    2. Luo Q,
    3. Luo S, et al.
    Interferon-γ release assays or tuberculin skin test for detection and management of latent tuberculosis infection: a systematic review and meta-analysis. Lancet Infect Dis 2020; 20: 1457–1469. doi:10.1016/S1473-3099(20)30276-0
    OpenUrl
  7. ↵
    1. Zellweger JP,
    2. Sotgiu G,
    3. Corradi M, et al.
    The diagnosis of latent tuberculosis infection (LTBI): currently available tests, future developments, and perspectives to eliminate tuberculosis (TB). Med Lav 2020; 111: 170–183. doi:10.23749/mdl.v111i3.9983
    OpenUrl
    1. Pai M,
    2. Denkinger C,
    3. Kik S, et al.
    Gamma interferon release assays for detection of Mycobacterium tuberculosis infection. Clin Microbiol Rev 2014; 27: 3–20. doi:10.1128/CMR.00034-13
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. Farhat M,
    2. Greenaway C,
    3. Pai M, et al.
    False-positive tuberculin skin tests: What is the absolute effect of BCG and non-tuberculous mycobacteria? Int J Tuberc Lung Dis 2006; 10: 1192–1204.
    OpenUrlPubMed
  9. ↵
    1. Lalvani A
    . Diagnosing tuberculosis infection in the 21st century: new tools to tackle an old enemy. Chest 2007; 131: 1898–1906. doi:10.1378/chest.06-2471
    OpenUrlCrossRefPubMed
  10. ↵
    1. World Health Organization
    . WHO guidelines on tuberculosis infection prevention and control, 2019 update. Geneva, World Health Organization, 2019. www.who.int/publications/i/item/9789241550512
  11. ↵
    1. Barcellini L,
    2. Borroni E,
    3. Brown J, et al.
    First evaluation of QuantiFERON-TB gold plus performance in contact screening. Eur Respir J 2016; 48: 1411–1419. doi:10.1183/13993003.00510-2016
    OpenUrlAbstract/FREE Full Text
  12. ↵
    1. Petruccioli E,
    2. Vanini V,
    3. Chiacchio T, et al.
    Analytical evaluation of QuantiFERON- Plus and QuantiFERON- Gold In-tube assays in subjects with or without tuberculosis. Tuberculosis (Edinb) 2017; 106: 38–43. doi:10.1016/j.tube.2017.06.002
    OpenUrl
  13. ↵
    1. Faust L,
    2. Ruhwald M,
    3. Schumacher S, et al.
    How are high burden countries implementing policies and tools for latent tuberculosis infection? A survey of current practices and barriers. Health Sci Rep 2020; 3: e158. doi:10.1002/hsr2.158
    OpenUrl
  14. ↵
    1. Fukushima K,
    2. Akagi K,
    3. Kondo A, et al.
    First clinical evaluation of the QIAreachTM QuantiFERON-TB for tuberculosis infection and active pulmonary disease. Pulmonology 2021; in press [https://doi.org/10.1016/j.pulmoe.2021.07.003].
  15. ↵
    1. Stieber F,
    2. Howard J,
    3. Manissero D, et al.
    Evaluation of a lateral flow nanoparticle fluorescence assay for TB infection diagnosis. Int J Tuberc Lung Dis 2021; 25: 917–922. doi:10.5588/ijtld.21.0391
    OpenUrl
  16. ↵
    1. Molich R
    . A critique of “How to specify the participant group size for usability studies: a practitioner's guide” by Macefield. J Usability Studies 2010; 5: 124–128.
    OpenUrl
PreviousNext
Back to top
Vol 7 Issue 4 Table of Contents
ERJ Open Research: 7 (4)
  • Table of Contents
  • Index by author
Email

Thank you for your interest in spreading the word on European Respiratory Society .

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Assessing usability of QIAreach QuantiFERON-TB platform in a high tuberculosis prevalence, low-resource setting
(Your Name) has sent you a message from European Respiratory Society
(Your Name) thought you would like to see the European Respiratory Society web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Print
Citation Tools
Assessing usability of QIAreach QuantiFERON-TB platform in a high tuberculosis prevalence, low-resource setting
Conceptor Kaaba, Maria Ruperez, Barry Kosloff, Nduku Ndunda, Kwame Shanaube, Helen Ayles
ERJ Open Research Oct 2021, 7 (4) 00511-2021; DOI: 10.1183/23120541.00511-2021

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Assessing usability of QIAreach QuantiFERON-TB platform in a high tuberculosis prevalence, low-resource setting
Conceptor Kaaba, Maria Ruperez, Barry Kosloff, Nduku Ndunda, Kwame Shanaube, Helen Ayles
ERJ Open Research Oct 2021, 7 (4) 00511-2021; DOI: 10.1183/23120541.00511-2021
del.icio.us logo Digg logo Reddit logo Technorati logo Twitter logo CiteULike logo Connotea logo Facebook logo Google logo Mendeley logo
Full Text (PDF)

Jump To

  • Article
    • Abstract
    • Acknowledgement
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • PDF

Subjects

  • Respiratory infections and tuberculosis
  • Tweet Widget
  • Facebook Like
  • Google Plus One

More in this TOC Section

  • Profiles of host responses in plasma and LRT during ARF
  • Expansion of ST2-expressing macrophages in BOS
  • S. pneumoniae re-emerges as a cause of CAP
Show more Research letters

Related Articles

Navigate

  • Home
  • Current issue
  • Archive

About ERJ Open Research

  • Editorial board
  • Journal information
  • Press
  • Permissions and reprints
  • Advertising

The European Respiratory Society

  • Society home
  • myERS
  • Privacy policy
  • Accessibility

ERS publications

  • European Respiratory Journal
  • ERJ Open Research
  • European Respiratory Review
  • Breathe
  • ERS books online
  • ERS Bookshop

Help

  • Feedback

For authors

  • Instructions for authors
  • Publication ethics and malpractice
  • Submit a manuscript

For readers

  • Alerts
  • Subjects
  • RSS

Subscriptions

  • Accessing the ERS publications

Contact us

European Respiratory Society
442 Glossop Road
Sheffield S10 2PX
United Kingdom
Tel: +44 114 2672860
Email: journals@ersnet.org

ISSN

Online ISSN: 2312-0541

Copyright © 2023 by the European Respiratory Society