The genus Flavivirus includes dengue virus (DENV), the most common human arbovirus worldwide, and yellow fever virus (YFV), which remains a significant public health threat despite the availability of an effective vaccine.1–4 Both pathogens present diagnostic challenges in regions of endemicity.3–6 Real-time reverse transcriptase PCR (rRT-PCR) is the most accurate method for DENV and YFV detection during acute infection, although viral RNA may only be detectable in serum or plasma for 5–7 days after symptom onset.4,6 In resource-limited settings, few laboratories have the capacity to perform high-complexity molecular testing, and results from national or regional reference laboratories are not available in a clinically relevant time frame. As a result, patients may receive a clinical diagnosis that is inaccurate for differentiating DENV or YFV from many other causes of acute febrile illness.2–4 Timely diagnosis and initiation of management for dengue improve clinical outcomes.2 Similar data are not available for yellow fever, where early detection may be particularly important, given the high case-fatality rate for severe cases.4 Rapid diagnostics are available for the detection of DENV nonstructural protein 1 (NS1) and anti-DENV IgM, but these are significantly less sensitive than rRT-PCR during acute infection.6,7 Testing for anti-YFV IgM is often limited to reference laboratories. For both DENV and YFV, IgM is not reliably detectable until 5 days after symptom onset, and significant cross-reactivity occurs between flaviviruses.3,4,6,8
Recently, a hydrolysis probe–based reverse transcription–insulated isothermal PCR has been developed for the detection of DENV in serum (POCKIT DENV Reagent Set, GeneReach Biotechnology, Taichung City, Taiwan).9–13 This assay can be performed on a handheld battery-powered instrument that is inexpensive relative to the costs of real-time PCR instruments. Although assay comparisons between the DENV reagent set and an FDA-cleared DENV rRT-PCR have been reported,9,10 independent evaluations of this assay have not been published. In addition, no data have been published regarding the performance of the POCKIT YFV Reagent Set. The objectives of the current study were to evaluate both reagent sets using a diverse set of clinical samples and/or reference viral strains from different regions of endemicity and to compare assay performance with sensitive laboratory-developed rRT-PCRs for each pathogen.14,15
Evaluation of the POCKIT DENV Reagent Set was performed using pre-collected clinical samples from sites in Guatemala (DENV-2 and -3), Paraguay (DENV-1 and -4), and Sri Lanka (DENV-2). Samples had been obtained from patients with a suspected arboviral illness within the first 7 days of symptom-onset as part of ongoing arboviral studies (Guatemala and Paraguay) or routine clinical care (Sri Lanka). Sera were collected in Paraguay and Sri Lanka, whereas plasma and whole blood samples were collected in Guatemala. This research protocol was reviewed and approved by the Emory University Institutional Review Board (Protocol 91162). All statistical analyses were performed using GraphPad software (v. 8.1.1, GraphPad, San Diego, CA).
Total nucleic acids were extracted on an eMAG instrument (bioMérieux, Marcy-l’Étoile, France) according to the manufacturer-recommended protocols. Samples were initially screened using an rRT-PCR for Zika virus, chikungunya virus, and DENV (the “ZCD assay”).16 Dengue virus–positive samples were then confirmed in a quantitative, serotype-specific DENV rRT-PCR.15 Nucleic acids were stored at −80°C until tested once with the POCKIT DENV Reagent Set on a Micro Plus Nucleic Acid Analyzer according to the manufacturer-supplied protocol.9 Samples with discordant rRT-PCR and POCKIT results were tested a second time with the serotype-specific DENV rRT-PCR for confirmation.
One hundred thirty-three samples were tested for DENV (serum/plasma, n = 118; whole blood, n = 15). Overall results are shown in Table 1. Four samples (3.0%) yielded “undetermined” results, which display as a “?” on the nucleic acid analyzer. Undetermined samples included 3 DENV-positive samples (DENV-1 and DENV-2, n = 2) and 1 DENV-negative sample. These were retested with the POCKIT assay: 3/4 yielded negative/undetermined results and one sample yielded one positive and one negative result. All undetermined samples were thus classified as negative for further calculations.
Comparison of the POCKIT DENV Reagent Set with a laboratory-developed rRT-PCR
DENV rRT-PCR | Viral load | Results, POCKIT DENV | ||
---|---|---|---|---|
Result | N | Median (range)* | Detected, n | Sensitivity (%) |
DENV positive | 78 | 5.2 (2.7–10.8) | 68 | 87.2 |
DENV-1 | 24 | 5.3 (2.7–9.3) | 20 | 83.3 |
DENV-2 | 33 | 4.4 (2.8–10.8) | 29 | 87.9 |
DENV-3 | 18 | 6.8 (4.2–9.5) | 16† | 88.9 |
DENV-4 | 3 | 4.8 (4.8–5.5) | 3 | 100 |
DENV negative | 55 | – | 1‡ | – |
DENV = dengue virus; rRT-PCR = real-time reverse transcriptase PCR.
Determined by rRT-PCR, expressed as log10 copies/mL of serum.
One eluate each from plasma and whole blood tested negative (viral loads 4.2 and 5.4 log10 copies/mL, respectively).
Specificity, 98.2%.
The POCKIT assay demonstrated a high level of agreement with reference rRT-PCR results (kappa statistic 0.83, 95% CI 0.74–0.93), and the sensitivity was 87.2% (68/78). Seven samples were negative in the POCKIT assay but positive by rRT-PCR. When combined with undetermined samples, 8/10 samples that tested positive by rRT-PCR but negative/undetermined in the POCKIT had viral loads less than 4.0 log10 copies/mL serum (DENV-1, n = 4; DENV-2, n = 4). Two DENV-3 samples gave false-negative results and included one plasma and one whole blood sample with viral loads of 4.2 and 5.4 log10 copies/mL, respectively. Therefore, the POCKIT assay detected 96.2% of samples with viral loads ≥ 4.0 log10 copies/mL (50/52). Specificity of the POCKIT assay was 98.2% (54/55), which resulted from one positive serum sample that was repeatedly negative in both the ZCD and DENV serotype-specific rRT-PCRs.
Evaluation of the POCKIT YFV Reagent Set was performed using dilutions of genomic RNA from six reference YFV strains representing five genotypes (Table 2). Dilutions were tested in duplicate across a range of concentrations extending from 1.0 to 9.3 log10 copies/mL of sample. Viral load was quantified in a laboratory-developed rRT-PCR.14 For dilutions with viral loads ≥ 2.5 log10 copies/mL (∼1 copy/µL of eluate), RNA detection in the POCKIT YFV Reagent Set (43/48, 89.6%) was similar to that in the laboratory-developed rRT-PCR (44/48, 91.7%). Of samples with viral loads below this level, 1/12 (8.3%) was detected in the POCKIT assay compared with 5/12 (41.7%) by rRT-PCR. To evaluate assay specificity, genomic RNA was tested from related flaviviruses (Table 2).14 In addition, 12 DENV-positive and 12 DENV-negative serum samples from Paraguay were tested. All samples in the specificity analysis tested negative except for one DENV-1 sample that yielded an indeterminate result. This sample tested negative for YFV by rRT-PCR and was negative in the POCKIT YFV Reagent Set on repeat testing.14
Evaluation of POCKIT YFV reagent set
YFV real-time reverse transcriptase PCR | POCKIT yellow fever | ||
---|---|---|---|
Sample | Viral load, range* | Detected, n/total (%) | Detected, n/total (%) |
Sensitivity evaluation | ≥ 5.5 | 22/22 (100) | 22/22 (100) |
3.25–5.49 | 14/14 (100) | 14/14 (100) | |
YFV strains† | 2.5–3.24 | 8/12 (66.7) | 7/12 (58.3) |
1.0–2.49 | 5/12 (41.7) | 1/12 (8.3) | |
Specificity evaluation | |||
Flaviviral strains‡ | 7.2–8.8 | 0/8 | 0/8 |
DENV-positive samples§ | 5.1–9.3 | 0/12 | 0/12 |
DENV-negative samples | – | 0/12 | 0/12 |
DENV = dengue virus; YFV = yellow fever virus.
Expressed as log10 copies/mL of sample, estimated for YFV strains and calculated for DENV serum samples.
Yellow fever virus strains: Asibi–Ghana, 1927 and Senegal ArD 149194, 1996 (West Africa II genotype); Couma–Ethiopia 1961 (East/Central Africa); Angola SH 281788, 2016 (Angola); INHRR 10a-10 – Venezuela 2010 (South America I); and FVB 0196 – Bolivia 2006 (South America II).
Genomic RNA from West Nile virus (two strains), tick-borne encephalitis virus, Japanese encephalitis virus, St. Louis encephalitis virus (two strains), Zika virus, and DENV-4.
DENV-1 (n = 11) and DENV-4 (n = 1); a single DENV-1 sample yielded an initial indeterminate POCKIT YFV result that was negative on repeat testing (DENV viral load, 8.1 log10 copies/mL of serum).
In this study, the POCKIT DENV and YFV reagent sets were compared with laboratory-developed rRT-PCRs that have proven to be more sensitive than common comparators for each pathogen.14,15,17 The POCKIT DENV assay demonstrated a sensitivity of 87.2% and detected 96.2% of DENV-positive samples with viral loads ≥ 4.0 log10 copies/mL. Viral loads in this range are common among patients who present within the first 5 days of symptom onset,7 such that assay use could be targeted to a high-yield population based on information that is readily available at presentation. Notably, sensitivity is higher than that of a rapid NS1 assay used to test patients in Paraguay (71.4%).7 Given the rapidity of assay performance (setup time, ∼5–10 minutes; run time, 45 minutes), this could provide a sensitive testing option for use near the point of patient care.
Assay performance of the YFV reagent set has not yet been published, but in this initial evaluation, the assay proved to be as sensitive as rRT-PCR down to viral loads of 2.5 log10 copies/mL using genomic RNA from six YFV strains (five genotypes). A single DENV-1 sample gave an indeterminate result in the YFV assay, although this was negative on repeat testing. Given the high significance of detecting even a single yellow fever case, which can trigger vaccination campaigns and the issuance of travel medicine advisories, reference YFV testing with rRT-PCR testing will need to be available to confirm results.3,4,8 However, this test may provide an option for sensitive molecular testing in remote and/or resource-limited regions disproportionately affected by YFV.3,4 As such, it warrants further evaluation with acute-phase clinical samples.4
Currently, the manufacturer only recommends the use of serum with these two reagent sets, although one previous publication also used plasma.9 It is unclear if this difference in the sample matrix affects performance, but notably, the DENV-3 samples that tested negative in the POCKIT assay were plasma and whole blood. The POCKIT assay still requires nucleic acid extraction, which in turn requires the availability of skilled personnel and relatively sophisticated laboratory facilities that can maintain molecular workflow. However, additional instruments are available for automated RNA extraction and sample-to-answer detection based on this technology.11,12 In conclusion, the POCKIT DENV and YFV reagent sets compared favorably with sensitive rRT-PCRs for each pathogen, and these may provide accurate and less-complex options for molecular testing in certain laboratory settings.
Acknowledgments:
We thank Yvalena de Guillén, Laura Mendoza, Cynthia Bernal, César Cantero, and all members of the study team based at the Instituto de Investigaciones en Ciencias de la Salud, Asunción, Paraguay. We also thank the study team at the Fundación para la Salud Integral de los Guatemaltecos, FUNSALUD, Quetzaltenango, Guatemala. We are grateful to all study participants and their families. Samples from Guatemala were used by permission of the National Institute of Allergy and Infectious Diseases (NIAID), National Institutes of Health (NIH). We thank Walla Dempsey and Kay Tomashek for their assistance in this process.
REFERENCES
- 1.↑
Kuno G, Chang GJ, Tsuchiya KR, Karabatsos N, Cropp CB, 1998. Phylogeny of the genus Flavivirus. J Virol 72: 73–83.
- 2.↑
World Health Organization, 2009. Dengue: Guidelines for Diagnosis, Treatment, Prevention and Control. Geneva, Switzerland: WHO Press.
- 4.↑
Waggoner JJ, Rojas A, Pinsky BA, 2018. Yellow fever virus: diagnostics for a persistent arboviral threat. J Clin Microbiol 56: e00827-18.
- 5.
Wang WK, Gubler DJ, 2018. Potential point-of-care testing for dengue virus in the field. J Clin Microbiol 56: e00203-18.
- 6.↑
Peeling RW et al. 2010. Evaluation of diagnostic tests: dengue. Nat Rev Microbiol 8 (12 Suppl): S30–S38.
- 7.↑
Rojas A et al. 2019. Characterization of dengue cases among patients with an acute illness, Central Department, Paraguay. PeerJ 7: e7852.
- 8.↑
Pan American Health Organization, 2018. Laboratory Diagnosis of Yellow Fever Virus Infection. Washington, D.C.
- 9.↑
Go YY et al. 2016. A pan-dengue virus reverse transcription-insulated isothermal PCR assay intended for point-of-need diagnosis of dengue virus infection by use of the POCKIT nucleic acid analyzer. J Clin Microbiol 54: 1528–1535.
- 10.↑
Tsai JJ, Liu LT, Lin PC, Tsai CY, Chou PH, Tsai YL, Chang HG, Lee PA, 2018. Validation of the pockit dengue virus reagent set for rapid detection of dengue virus in human serum on a field-deployable PCR system. J Clin Microbiol 56: e01865-17.
- 11.↑
Tsai JJ et al. 2019. An RT-PCR panel for rapid serotyping of dengue virus serotypes 1 to 4 in human serum and mosquito on a field-deployable PCR system. PLoS One 14: e0214328.
- 12.↑
Tsai JJ et al. 2019. A fully automated sample-to-answer PCR system for easy and sensitive detection of dengue virus in human serum and mosquitos. PLoS One 14: e0218139.
- 13.↑
Tsai YL, Wang HT, Chang HF, Tsai CF, Lin CK, Teng PH, Su C, Jeng CC, Lee PY, 2012. Development of TaqMan probe-based insulated isothermal PCR (iiPCR) for sensitive and specific on-site pathogen detection. PLoS One 7: e45278.
- 14.↑
Rojas A et al. 2018. Internally controlled, multiplex real-time reverse transcription PCR for dengue virus and yellow fever virus detection. Am J Trop Med Hyg 98: 1833–1836.
- 15.↑
Waggoner JJ et al. 2013. Single-reaction, multiplex, real-time rt-PCR for the detection, quantitation, and serotyping of dengue viruses. PLoS Negl Trop Dis 7: e2116.
- 16.↑
Waggoner JJ, Gresh L, Mohamed-Hadley A, Ballesteros G, Davila MJ, Tellez Y, Sahoo MK, Balmaseda A, Harris E, Pinsky BA, 2016. Single-reaction multiplex reverse transcription PCR for detection of Zika, chikungunya, and dengue viruses. Emerg Infect Dis 22: 1295–1297.
- 17.↑
Waggoner JJ et al. 2013. Comparison of the FDA-approved CDC DENV-1-4 real-time reverse transcription-PCR with a laboratory-developed assay for dengue virus detection and serotyping. J Clin Microbiol 51: 3418–3420.