Skip to main content

Advertisement

A validation study of microscopy versus quantitative PCR for measuring Plasmodium falciparum parasitemia

Article metrics

Abstract

Microscopy and 18S qPCR are the most common and field-friendly methods for quantifying malaria parasite density, and it is important that these methods can be interpreted as giving equivalent results. We compared results of quantitative measurement of Plasmodium falciparum parasitemia by microscopy and by 18S qPCR in a phase 2a study. Microscopy positive samples (n = 355; median 810 parasites/μL [IQR 40–10,471]) showed close agreement with 18S qPCR in mean log10/mL transformed parasitemia values by paired t test (difference 0.04, 95%CI − 0.01–0.10, p = 0.088). Excellent intraclass correlation (0.97) and no evidence of systematic or proportional differences by Passing–Bablok regression were observed. 18S qPCR appears to give equivalent parasitemia values to microscopy, which indicates 18S qPCR is an appropriate alternative method to quantify parasitemia in clinical trials.

Background

Microscopy is the gold standard method for identifying and quantifying malaria parasites [1]. Microscopists calculate parasitemia (parasites/microliter (μL) of whole blood) as the parasites counted within a given number of microscope fields divided by the number of WBCs (thick film) or RBCs (thin film) in μL of whole blood multiplied by the total WBC (thick film) or RBC (thin film) counted within those fields [2]. The microscopy detection limit is generally 11–50 parasites/μL [3].

Nucleic acid amplification testing (NAAT) methods detect and quantify parasitemia with greater sensitivity and precision than microscopy, particularly for low levels of parasitemia [4]. Quantitative NAAT methods include quantitative PCR (qPCR) and quantitative reverse transcriptase PCR (qRT-PCR). NAAT methods for malaria target either specific DNA sequences of the parasite’s genome, such as the gene encoding the 18S ribosomal RNA gene (18S rDNA), or a constitutively transcribed RNA sequence such as 18S rRNA of asexual parasites [1].

The World Health Organization (WHO) has published standardised protocols for microscopy [5, 6]. However, no equivalent protocols exist for NAAT. The Minimum Information for Publication of Quantitative Real-Time PCR Experiments (MIQE) guidelines [7] have led towards a more standardised approach to malaria NAAT [8, 9]. Murphy et al. [4] established the first formal external quality assurance (EQA) program to promote the reliability and comparability of results for NAAT across centres undertaking volunteer infection studies (VIS). In 2018, WHO published an operational manual for an ongoing EQA program for malaria NAAT [10].

Our aim was to compare microscopy and qPCR parasitemia values to demonstrate that qPCR is a suitable alternative to microscopy for quantifying parasitemia in clinical trials.

Methods

Participants with uncomplicated Plasmodium falciparum malaria were treated with a single dose of cipargamin (KAE609) in an open-label phase 2a study in Vietnam, as described by Hien et al. [11]. Twenty-five adult males had 6 mL of blood taken 4–6 hourly until they had two consecutive negative blood films, and subsequently once daily until day 8.

Experienced microscopists followed standard procedures to count asexual parasites using both thick and thin blood films shortly after blood collection [6]. First, 200 WBCs were counted on thick films. If the parasite count was less than 10 after 200 WBCs, then up to 500 WBCs were counted. Thin films were used where the number of parasites exceeded 250 per 50 WBCs.

For the 18S qPCR, DNA was extracted from a 200-μL volume of packed RBCs using the QIAamp DNA blood mini kit (Qiagen). The Plasmodium-specific qPCR was performed on-site in real time using the protocol described by Imwong et al. [9] with primers and probes developed by Kamau et al. [12]. The method uses a hydrolysis probe real-time qPCR targeting the 18S rRNA gene with a detection limit of 22 parasites/mL (SD 5). Samples were run in triplicate. Each 18S qPCR run contained a positive and negative water control and internal phocine herpesvirus control. Cycle threshold values greater than 50 were considered non-detectable.

To account for possible confounding of results by circulating gametocytes, RNA was extracted from frozen packed RBCs using the QIAamp DNA blood mini kit (Qiagen) with DNase treatment and tested for the presence of the P. falciparum female gametocyte-specific mRNA pfs25, using the primers, probe, and protocol described by Pasay et al. [13]. The ratio of log10 gametocytes/mL (pfs25 qRT-PCR) to log10 parasites/mL (18S qPCR) was then calculated for the 20 samples with both gametocyte and asexual parasite counts.

Log10 parasitemia values using microscopy and 18S qPCR were summarised by mean, standard deviation, coefficient of variation, median, interquartile range, and range. We used paired t test, intraclass correlation coefficient (ICC), and Passing-Bablok regression to assess for agreement between log10 parasitemia values. ICC for consistency was calculated using a mixed effects model without interaction. The Passing-Bablok regression 95% confidence interval (CI) was calculated with the bootstrap (quantile) method. Regression and residual plots were examined. The reference method was microscopy. All analyses were conducted in R Studio (version 1.0.136, R version 3.2.5).

Results

Of the 740 blood samples collected, 268 microscopy results were reported as non-detectable, 92 samples were clotted and unsuitable for 18S qPCR, and 23 were missing values. Two 18S qPCR assay results failed quality control checks, resulting in 355 matched samples across 22 participants. Median parasitemia value by microscopy was 810 parasites/μL (IQR 40–10,471).

Log10 parasitemia values from microscopy were marginally lower (mean 5.81 log10 units/mL) than values from 18S qPCR (mean 5.86 log10 units/mL) (Table 1). Standard deviations and coefficients of variation were similar between methods. All samples with parasites detected by microscopy were also positive by 18S qPCR.

Table 1 Comparison of log10 parasitemia values/mL by microscopy and 18S qPCR

The high ICC value indicated excellent consistency between microscopy and 18S qPCR (Table 2). The paired t test indicated that log10 parasitemia values/mL were not significantly different between microscopy and 18S qPCR (mean difference 0.04 [95% CI − 0.01–0.10], p = 0.088). There was no evidence of a systematic or proportional bias by Passing–Bablok regression but a slight tendency towards non-linearity at lower levels of parasitemia (H statistic: 1.50; p < 0.05) (Fig. 1).

Table 2 Agreement statistics for log10 parasitemia/mL by microscopy and 18S qPCR
Fig. 1
figure1

Passing–Bablok regression fit comparing microscopy and 18S qPCR. The plot shows log10 parasitemia by microscopy and 18S qPCR. The solid black line represents the fitted Passing–Bablok regression line. The 95% confidence bounds, in grey, were calculated using the bootstrap quantile method

Our 18S qPCR assay was developed for clinical trials where the upper limit of quantification (ULoQ) is 250,000 parasites/mL [9]. Half of the samples tested had parasitemia values above this ULoQ. We conducted sensitivity analysis to examine whether extrapolation of 18S qPCR values above the ULoQ was reasonable (n = 155 ≤ 250,000 parasites/mL, mean difference 0.07 log10 units/mL [95% CI − 0.01–0.15, p = 0.10]), and found our conclusions unchanged, which indicates that extrapolation beyond the reference range was valid.

Across matched samples analysed by both18S qPCR and pfs25 qRT-PCR assay the ratio of gametocytes to total parasites averaged 0.006 (SD 0.010) and ranged between 0.000 and 0.050. Thus, our comparison of microscopy with 18S qPCR was not confounded by the presence of gametocytes.

Discussion

Our findings support the use of the 18S qPCR assay in clinical trials to quantify a wide range of parasitemia values, based on a strong agreement with microscopy. This has application to clinical trials in endemic settings (such as [11]) and to VIS in non-endemic settings.

Parasitemia values from microscopy and from 18S qPCR showed good agreement and no evidence of systematic or proportional bias by Passing–Bablok regression, a method commonly used in clinical laboratory settings [14]. Our findings of a mean difference of 0.04 log10 units/mL are supported by several smaller studies. Nwakanma et al. [15] calculated a mean difference of − 0.5 log10 units (95% CI − 1.4–0.4) for 81 thick films with values from an 18S rRNA gene-targeted qPCR. Kamau et al. [16] reported a much larger mean difference of − 0.87 log10 units for 60 samples, although they used averaged thick or thin film counts using a multiplex qPCR containing an 18S rRNA gene target.

Although microscopy is the gold standard for quantifying parasitemia, microscopy cannot quantify parasitemia at low levels and its accuracy is influenced by the film type (thick or thin), microscopist’s expertise, and WBC count (theoretical or actual) used [2]. Quantification of sexual lifecycle stages may not be included in microscopy counts, such as in this study. However, we did not find evidence of over-estimation by 18S qPCR due to low numbers of gametocytes in matched samples. If deconvolution of asexual parasitemia versus gametocytemia is required, then inclusion of qRT-PCR assays targeting specific life cycle stages is recommended [13].

18S qPCR assays cannot discern whether target DNA is within a viable or dead parasite, or elsewhere, such as cell-free DNA. Parasite counts from 18S qPCR assays could be influenced by cell-free Plasmodium DNA in the saliva, blood, or stool of malaria-infected humans [17]. This could lead to overestimation of intact and viable parasites if parasites from target DNA elsewhere are counted [18]. However, the agreement between the parasitemia values estimated by microscopy and 18S qPCR in our study (patients treated with cipargamin) suggests confounding due to cell-free DNA is unlikely.

Conclusions

In this study, we compared the most common and field-friendly methods for parasite quantification. Although other methods, including flow cytometry [19] and droplet digital PCR [20], can quantify parasitemia without a standard curve, they have high operational costs and are unlikely to be realistic options for many laboratories. In conclusion, our results support the use of 18S qPCR to give equivalent estimates to those from microscopy for P. falciparum parasitemia in clinical trials, particularly drug studies where accurate quantification is required across a wide range of parasitemia.

Availability of data and materials

The datasets analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CI:

Confidence interval

EQA:

External quality assurance

ICC:

Intraclass correlation coefficient

IQR:

Interquartile range

MIQE:

Minimum Information for Publication of Quantitative Real-Time PCR Experiments

NAAT:

Nucleic acid amplification testing

qPCR:

Quantitative polymerase chain reaction

qRT-PCR:

Quantitative reverse transcriptase polymerase chain reaction

RBC:

Red blood cell

SD:

Standard deviation

ULoQ:

Upper limit of quantification

VIS:

Volunteer infection study

WBC:

White blood cell

WHO:

World Health Organization

References

  1. 1.

    Murphy SC, Shott JP, Parikh S, Etter P, Prescott WR, Stewart VA. Malaria diagnostics in clinical trials. Am J Trop Med Hyg. 2013;89(5):824–39.

  2. 2.

    O'Meara W, McKenzie F, Magill A, Forney J, Permpanich B, Lucas C, et al. Sources of variability in determining malaria parasite density by microscopy. Am J Trop Med Hyg. 2005;73(3):593–8.

  3. 3.

    Kobayashi T, Gamboa D, Ndiaye D, Cui L, Sutton PL, Vinetz JM. Malaria diagnosis across the international centers of excellence for malaria research: platforms, performance, and standardization. Am J Trop Med Hyg. 2015;93(3 Suppl):99–109.

  4. 4.

    Murphy SC, Hermsen CC, Douglas AD, Edwards NJ, Petersen I, Fahle GA, et al. External quality assurance of malaria nucleic acid testing for clinical trials and eradication surveillance. PLoS One. 2014;9(5):e97398.

  5. 5.

    World Health Organization. Malaria microscopy quality assurance manual (version 2); 2016. https://www.who.int/malaria/publications/atoz/9789241549394/en/.

  6. 6.

    World Health Organization & UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases. Microscopy for the detection, identification and quantification of malaria parasites on stained thick and thin blood films in research settings: procedure: methods manual (version 1.0); 2015. https://apps.who.int/iris/handle/10665/163782.

  7. 7.

    Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, Kubista M, et al. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009;55(4):611–22.

  8. 8.

    Alemayehu S, Feghali KC, Cowden J, Komisar J, Ockenhouse CF, Kamau E. Comparative evaluation of published real-time PCR assays for the detection of malaria following MIQE guidelines. Malar J. 2013;12(1):277.

  9. 9.

    Imwong M, Hanchana S, Malleret B, Renia L, Day N, Dondorp A, et al. High-throughput ultrasensitive molecular techniques for quantifying low-density malaria parasitemias. J Clin Microbiol. 2014;52(9):3303.

  10. 10.

    World Health Organization. WHO external quality assurance scheme for malaria nucleic acid amplification testing: operation manual (version 1.0); 2018. Licence: CC BY-NC-SA 3.0 IGO. https://apps.who.int/iris/handle/10665/259950.

  11. 11.

    Hien TT, White NJ, Thuy-Nhien NT, Hoa NT, Thuan PD, Tarning J, et al. Estimation of the in vivo MIC of cipargamin in uncomplicated Plasmodium falciparum malaria. Antimicrob Agents Chemother. 2017;61:2.

  12. 12.

    Kamau E, Tolbert LS, Kortepeter L, Pratt M, Nyakoe N, Muringo L, et al. Development of a highly sensitive genus-specific quantitative reverse transcriptase real-time PCR assay for detection and quantitation of plasmodium by amplifying RNA and DNA of the 18S rRNA genes. J Clin Microbiol. 2011;49(8):2946–53.

  13. 13.

    Pasay CJ, Rockett R, Sekuloski S, Griffin P, Marquart L, Peatey C, et al. Piperaquine monotherapy of drug-susceptible Plasmodium falciparum infection results in rapid clearance of parasitemia but is followed by the appearance of gametocytemia. J Infect Dis. 2016;214(1):105–13.

  14. 14.

    Pant V, Tumbapo A, Karki B. Inter-instrumental comparison for the measurement of electrolytes in patients admitted to the intensive care unit. Int J Gen Med. 2017;10:145–9.

  15. 15.

    Nwakanma DC, Gomez-Escobar N, Walther M, Crozier S, Dubovsky F, Malkin E, et al. Quantitative detection of Plasmodium falciparum DNA in saliva, blood, and urine. J Infect Dis. 2009;199(11):1567–74.

  16. 16.

    Kamau E, Alemayehu S, Feghali KC, Saunders D, Ockenhouse CF. Multiplex qPCR for detection and absolute quantification of malaria. PLoS One. 2013;8(8):e71539.

  17. 17.

    Weerakoon KG, McManus DP. Cell-free DNA as a diagnostic tool for human parasitic infections. Trends Parasitol. 2016;32(5):378–91.

  18. 18.

    Vafa Homann M, Emami SN, Yman V, Stenstrom C, Sonden K, Ramstrom H, et al. Detection of malaria parasites after treatment in travelers: a 12-months longitudinal study and statistical modelling analysis. EBioMedicine. 2017;25:66–72.

  19. 19.

    Campo JJ, Aponte JJ, Nhabomba AJ, Sacarlal J, Angulo-Barturen I, Jimenez-Diaz MB, et al. Feasibility of flow cytometry for measurements of Plasmodium falciparum parasite burden in studies in areas of malaria endemicity by use of bidimensional assessment of YOYO-1 and autofluorescence. J Clin Microbiol. 2011;49(3):968–74.

  20. 20.

    Koepfli C, Nguitragool W, Hofmann NE, Robinson LJ, Ome-Kaius M, Sattabongkot J, et al. Sensitive and accurate quantification of human malaria parasites using droplet digital PCR (ddPCR). Sci Rep. 2016;6:39183.

Download references

Acknowledgements

We thank the participants of the original published study. We acknowledge Jacinda Wilson for assistance with manuscript submission.

Funding

The 18S and pfs25 assays were funded by Novartis Pharma AG. The original published study was part of the Wellcome Trust Tropical Medicine Research Programmes in Vietnam and Thailand and was supported by Novartis Pharma AG.

Author information

TTH, NTT, and JT conducted the original study and supplied the data. JSM, PO, EB, and LM conceptualised and generated the idea for the study. EB conducted overall data analysis. EB, CW, ZP, PO, and JSM drafted the manuscript. All authors read and approved the final manuscript.

Correspondence to James S. McCarthy.

Ethics declarations

Ethics approval and consent to participate

Ethical approval and consent to participate is documented in the publication of the original study. The original published study was registered in the ClinicalTrials.gov database under identifier NCT01836458.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Microscopy
  • qPCR
  • Plasmodium falciparum
  • Validation