|
|
||||||||
| ABSTRACT |
|
|
|---|
= 0.64), with a sensitivity (95% CI) of 76.1% (68.3–83.9%), comparable to RDT and microscopy, but a specificity of 89.6% (84.0–95.2%) compared with 100% for RDT and microscopy. DNA extraction by heat treatment deteriorated specificity to unacceptable levels. LAMP enables molecular diagnosis of falciparum malaria in settings with limited technical resources but will need further optimization. The results are in contrast with a higher accuracy reported in an earlier study comparing LAMP with a non-validated PCR method. | INTRODUCTION |
|
|
|---|
Recently a new, simple, and inexpensive molecular test to detect the highly conserved 18S ribosomal RNA gene of P. falciparum by use of a loop-mediated isothermal amplification PCR (LAMP) was described.12,13 This method has the potential to combine the high sensitivity of a molecular diagnostic test with the possibility of performing the test under field conditions with limited technical resources. The LAMP method uses a robust DNA polymerase with low sensitivity to inhibitors and a set of three primer pairs that produce a specific double hairpin DNA template, which is amplified and concatenated with very high efficiency, leading to DNA concentrations close to 1 µg/µL within 90 minutes. The technique has been applied successfully as a diagnostic tool for several viral diseases.14–17 In patients with dengue, for example, very low copy numbers can be detected, even outperforming the sensitivity of real-time PCR.17 We evaluated the accuracy of this method in falciparum malaria and compared it with microscopy and a PfHRP2-based RDT, using nested PCR as the gold standard.
| MATERIALS AND METHODS |
|
|
|---|
Consecutive admitted patients with a clinical suspicion of falciparum malaria were included in the study. Patients previously diagnosed with malaria and treated with antimalarials within the week before admission were excluded. The screening was done as part of a study on the role of levamisole as adjuvant therapy in falciparum malaria, the results of which will be published separately. All patients signed an informed consent before enrollment. Ethical approval for this study was obtained from the Bangladesh Medical Research Council and the Oxford Tropical Medicine Research Ethical Committee (OXTREC). CMCH is a tertiary referral center with a catchment population of ~15 million people. Malaria transmission is low in this area, with a seasonal peak from May until August during the rainy season.
Blood collection. A 1-mL EDTA anticoagulated blood sample (TekLab, Durham, UK) was taken from the antecubital vein on admission of the patient. Microscopy and RDT were performed on site, and the remainder of the blood sample was stored in liquid nitrogen until further processing. Nested PCR and LAMP were performed in the Faculty of Tropical Medicine, Mahidol University (Bangkok, Thailand).
Microscopy. Thick and thin blood films were stained according to the method described by Field.2 The slides were read by an experienced microscopist who was blinded for the results of the other diagnostic tests. Parasitemia was assessed either per 1,000 erythrocytes in the thin film or at low parasitemias per 200 white blood cells (WBC) in the thick film. In case of a putative negative film, 500 WBC were assessed to confirm the absence of parasites.
Rapid diagnostic test. The PfHRP2 antigen-based lateral flow test (Paracheck; Orchid Biosystems, Goa, India) was used according to the manufacturers instructions, using a drop of EDTA anticoagulated whole blood. Test results were read after 15 minutes.
Preparation of the DNA template. The template DNA used for nested PCR and LAMP (LAMP-DNA-extract) was prepared from 200 µL of frozen whole EDTA blood using the QIAamp DNA Mini Kit (Qiagen, Valencia, CA), providing elutes of 50 µL of template DNA. Two microliters was used per sample, corresponding to ~8 µL of the original blood sample. For the LAMP assay, a second simple and cheap method of DNA extraction13 was used by freezing 50 µL of blood (cell lysis), followed by heating for 3 minutes at 99°C and then centrifugation at 13,000 rpm for 3 minutes (LAMP-heat). In contrast to a previous report, we heated the specimens for 3 minutes instead of 10 minutes at 99°C. Two microliters of the resulting supernatant was used as template for the LAMP assay.
Nested PCR assay. This assay targets the Plasmodium small subunit ribosomal RNA (ssrRNA) gene, resulting in a first 620-bp and a secondary 240-bp amplicon. The oligonucleotide primers used for the nested PCR assay were identical to those previously published.10 The reaction mixture for the first PCR step consisted of 2 µL of DNA template, 250 nmol/L of each primer (rPLU 1 and rPLU 5), 4 mmol/L MgCl2 (Boehringer Mannheim, Indianapolis, IN), PCR buffer (50 mmol/L KCl, 10 mmol/L Tris-HCl), 200 µmol/L of each deoxynucleoside triphosphate, 1.25 units of Taq DNA polymerase (Boehringer Mannheim), and water to a final volume of 50 µL. Primary amplification conditions were 94°C for 4 minutes; 35 cycles at 94°C for 30 seconds, annealing at 55°C for 1 minute, extension at 72°C for 1 minutes; and final extension at 72°C for 4 minutes. Two microliters of the first amplification product was used as DNA template for each of the 20-µL secondary amplifications. The conditions and concentrations of the secondary amplification were identical to those of the primary, except for the annealing temperature of 58°C and the amount of Taq Polymerase being 0.5 units. The PCR products of the secondary amplification round were analyzed by gel electrophoresis and stained with ethidium bromide.
LAMP assay. All LAMP PCR reactions were performed with the Loopamp DNA Amplification Kit (Eiken Chemical Co., Tokyo, Japan); the primer set and methods used were previously described.13 The reaction consisted of 7 µL of primers (FIP and BIP 40 pmol, Loop-F and Loop-B 20 pmol, F3 and B3 5 pmol), 12.5 µL of reaction mixture (40 mmol/L Tris-HCl, 20 mmol/L KCl, 16 mmol/L MgSO4, 20 mmol/L NH4SO4, 0.2% Tween 20, 1.6 mol/L betaine, deoxynucleotide triphosphates 2.8 mmol/L each), 1 µL Bst DNA polymerase, 2µL template DNA, and distilled water to a total volume of 25 µL. The reaction mixture was incubated in a hot water bath at 65°C for 120 minutes.13
Endpoint assessment. Turbidity of the reaction mixture, which is based on the precipitation of magnesium pyrophosphate as a by-product of the reaction,18 was scored as a positive test. Four independent people, who were masked to all malaria diagnostic test results, assessed turbidity as turbid or not turbid. The tubes were spun down (10,000 rpm for 3 minutes) to produce a whitish pellet if precipitate was present. The same four interpreters performed a second round of endpoint assessment pellet or no pellet, again masked to previous results, and a fifth person collected the scores. A positive test result was defined as follows: each individual positive reading scored one point; thus, a maximum of four points for turbidity and four for pellet formation was possible. If a sample collected five points or more, the test was considered positive; in case the outcome was equivocal with a score of four points (N = 2), the pellet endpoint result was decisive because it was more discriminatory. Besides the assessment of turbidity by the naked eye, the tubes were also analyzed by gel electrophoresis to assess if the LAMP DNA product was present. All reactions were analyzed by 2.0% (wt/vol) agarose gel by electrophoresis in Tris-Acetate-EDTA (TAE) buffer stained with ethidium bromide (BioRad, San Diego, CA), and positive results were defined by the appearance of typical ladder-bands of various sizes.
UV fluorescence detection. During evaluation of endpoints in the pilot phase of this study, all reactions with heat-treated blood sample templates showed some level of positive fluorescence when using SYBR-green intercalating dye, including those clearly LAMP negative as shown by negative turbidity, pellet formation, and gel electrophoresis. Even blood samples from healthy controls showed some level of pre-LAMP fluorescence when using commercial DNA extraction methods, clearly showing that UV fluorescence detection would provide false-positive results. For this reason, the use of intercalating dyes to determine the assay endpoint was discontinued.
Statistical analysis.
All statistical analyses were performed using Stata SE Version 9 Software (2005). Specificity, sensitivity, and positive and negative predictive values of the different diagnostic tests were compared with nested PCR results as the gold standard. The interobserver variation in assessing turbidity "by eye" in the LAMP assay was expressed as a
-value. Comparison of specificity and sensitivity of the LAMP with microscopy was calculated by comparison of equivalence of proportions of the studied methods.
| RESULTS |
|
|
|---|
Nested PCR, which was used as the reference method, was positive for P. falciparum in 67 (58.3%) patients. Both microscopy and the PfHRP2-based RDT did not produce any false-positive results, translating into a specificity and positive predictive value of 100% (Table 1
). The sensitivity (95% CI) of the RDT was comparable with microscopy: 77.6% (70.0–85.2%) versus 73.1% (65.0–81.2%; P = 0.55; Table 2
). The negative predictive value (95% CI) of the RDT was 76.2% (68.4–84.0%).
|
|
The highest agreement with nested PCR (nPCR) was achieved with the LAMP-DNA-extract modality (81.7%,
= 0.64). Both assays using gel electrophoresis as the read-out method (LAMP-DNA-extract and LAMP heat-gel) showed a similar level of agreement with nPCR (Table 1
). The sensitivities of all three LAMP assays were comparable to the RDT. There was a trend that the sensitivity was better than microscopy (Table 2
), but this was not significant. Specificity of the LAMP-DNA-extract method was superior to the LAMP-heat-eye and LAMP-heat-gel methods (Table 1
) but remained inferior compared with RDT or microscopy (P = 0.02; Table 2
). However, the negative predictive value of the LAMP-DNA-extract was similar to microscopy (P = 0.99), whereas the positive predictive value for both assays was significantly higher for microscopy (P = 0.03; Table 2
).
The LAMP method most suitable for deployment in the field would use heat treatment to obtain template DNA and visual assessment of turbidity and pellet formation after centrifugation as endpoints (LAMP-heat-eye). Even though this method showed a sensitivity of 79.1%, its specificity was 58.3%. When, instead of a visual assessment of turbidity, the DNA product was analyzed by agarose gel electrophoresis, the specificity of the LAMP in heat-treated samples (LAMP-heat-gel) rose to 83.3%. The visual interpretation of turbidity in the test tube seemed to be slightly less prone to interobserver variability than pellet formation, with
values between the four observers of 0.88 and 0.82, respectively. The
statistic (range, 1 to –1) measures the observed percentage of agreement between tests against what might be expected by chance, ranging from < 0 =poor agreement to 1 =perfect agreement.19
| DISCUSSION |
|
|
|---|
Evaluation of new diagnostic tests in malaria has the advantage of the availability of a highly sensitive and specific gold standard, which is nested PCR.11 In this study, we compared three different LAMP modalities, a PfHRP2-based RDT, and microscopy to nested PCR as the reference method. Both microscopy and RDT showed specificity and positive predictive values of 100%. The combined results for the best LAMP modality, LAMP-DNA-extract, showed no significant difference in sensitivity, with a lower PPV than microscopy and RDT and reasonable specificity and NPV. The basic LAMP-heat-eye modality showed the highest incidence of false-positive results.
A previous study on this technique using the same primer sets as in this study reported a higher specificity and sensitivity than in our results.13 This can be explained in part by the use of a real-time turbidimeter. However, an important source of error in the previous study could have been the use of a not formally validated PCR method as the gold standard for comparison. Because this PCR was based on the same primer set as used in the LAMP test, this could have resulted in an overestimation of the quality of the LAMP assay.
The results of this study showed that the performance of the test in its current form needs further optimization; specificity and sensitivity need to be improved. Accuracy is currently insufficient to promote its use as a diagnostic or research tool because the test currently shows unacceptably high rates of both false positives and false negatives. A low rate of false-negative results is particularly important to clinicians using diagnostic tests, because failing to treat a true case of falciparum malaria may result in progression to severe disease and death.
Possibilities for improvement of the LAMP assay include the definition of an unequivocal post-PCR endpoint; the use of turbidity and pellet formation are subject to individual variation in interpretation. Turbidity is caused by the formation of magnesium-pyrophosphate as a side product of the amplification reaction.18 Modification of this end product through labeling or chemical conversion into a colored product could make interpretation of the test more reliable. Heat-treated samples may contain cellular debris or have a yellowish appearance if the sample is not centrifuged properly; this can mimic pellet formation or turbidity, although this can easily be distinguished with increased experience. The use of a real-time turbidimeter to detect the exponential increase of turbidity can effectively reduce misjudgment of positive endpoint turbidity by the naked eye and thus improves accuracy. Unfortunately, these devices are not currently commercially available.
Therefore, although the use of simple heat-treated samples as a source for DNA template, together with visual interpretation of turbidity for assessment of test positivity, has the advantage that it can be deployed in a resource limited setting, in its current form, it shows an unacceptably high rate of false-positive results. The amplification efficiency of the LAMP method is extremely high because all reactions are conducted at the same temperature optimal for the enzyme, with no time lost by thermal changes as in conventional PCR. The LAMP method is capable of synthesizing 20 µg of specific DNA for 25 µL of reaction mixture within 60 minutes.18 Even though this method is a closed single-tube assay, contamination of work areas can easily occur if a tube is opened post-PCR, because large amounts of DNA (close to 1 µg/µL) are present within the tube. Avoidance of contamination should have priority when conducting the assay, which can be obtained by changing gloves between every assay and strict spatial separation of reagents preparation and performance of the test.
In conclusion, LAMP is a promising new technique, which for the first time enables a molecular diagnosis of falciparum malaria in a setting with limited resources. However, in contrast to the findings in a more favorable earlier report, the LAMP assay currently lacks sufficient accuracy. Development of improved methods for visualization of the LAMP end product or a derived product (magnesium pyrophosphate) will be important.
Received April 2, 2007. Accepted for publication July 20, 2007.
Acknowledgments: DHP was supported by the Swiss National Science Foundation in 2005/06 (Grant PBZHB-106270) and now holds a Wellcome Trust Clinical Research Training Fellowship. This study was funded by the Wellcome Trust of Great Britain as part of the Wellcome Trust–Mahidol University–Oxford Tropical Medicine Research Programme.
Disclosure: The authors state that they have no conflict of interest.
* Address correspondence to Daniel H. Paris, Mahidol University, 420/6 Rajvithi Road, Bangkok 10500, Thailand. E-mail: parigi{at}tropmedres.ac ![]()
Authors addresses: All authors, Mahidol, Oxford Research Unit, Faculty of Tropical Medicine, Mahidol University, 420/6 Rajvithi Road, 10400 Bangkok, Thailand, Telephone: 66-2-3541395, Fax: 66-2-3549169, E-mails: parigi{at}tropmedres.ac, noi{at}tropmedres.ac, oye{at}tropmedres.ac, sue{at}tropmedres.ac, nickd{at}tropmedres.ac, arjen{at}tropmedres.ac, a.faiz{at}abnetbd.com, mahtab{at}abnetbd.com, emran{at}spnetctg.com.
Reprint requests: Daniel H. Paris, Faculty of Tropical Medicine, Mahidol University, 420/6 Rajvithi Rd., Bangkok 10400, Thailand, Telephone: 66-2-354-91-71, Fax: 66-2-354-91-69, E-mail: parigi{at}tropmedres.ac.
| REFERENCES |
|
|
|---|
This article has been cited by other articles:
![]() |
C. N. Peyrefitte, L. Boubis, D. Coudrier, M. Bouloy, M. Grandadam, H. J. Tolou, and S. Plumet Real-Time Reverse-Transcription Loop-Mediated Isothermal Amplification for Rapid Detection of Rift Valley Fever Virus J. Clin. Microbiol., November 1, 2008; 46(11): 3653 - 3659. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |