Here, we present a protocol for the development and validation of a quantitative PCR method used for the detection and quantification of EHV-2 DNA in equine respiratory fluids. The EHV-2 qRT-PCR validation protocol involves a three-part procedure: development, characterization of qRT-PCR assay alone, and characterization of the whole analytical method.
The protocol describes a quantitative RT-PCR method for the detection and quantification of EHV-2 in equine respiratory fluids according to the NF U47-600 norm. After the development and first validation step, two distinct characterization steps were performed according to the AFNOR norm: (a) characterization of the qRT-PCR assay alone and (b) characterization of the whole analytical method. The validation of the whole analytical method included the portrayal of all steps between the extraction of nucleic acids and the final PCR analysis.
Validation of the whole method is very important for virus detection by qRT-PCR in order to get an accurate determination of the viral genome load. Since the extraction step is the primary source of loss of biological material, it may be considered the main source of error of quantification between one protocol and another. For this reason, the AFNOR norm NF-U-47-600 recommends including the range of plasmid dilution before the extraction step. In addition, the limits of quantification depend on the source from which the virus is extracted. Viral genome load results, which are expressed in international units (IU), are easier to use in order to compare results between different laboratories.
This new method of characterization of qRT-PCR should facilitate the harmonization of data presentation and interpretation between laboratories.
Equid herpesvirus-2 (EHV-2) is involved in a respiratory syndrome, with potential clinical manifestations such as nasal discharge, pharyngitis and swollen lymph nodes1-3. This virus is also suspected to be associated with the poor-performance of horses, which may result in a significant and negative economic impact for the horse industry2.
Until now, the gold standard for gamma-EHV (γ-EHV) detection was the cell culture method. The first inconvenience of this procedure was the absence of discrimination between EHV-2 and other γ-EHV's (e.g., EHV-5). The second inconvenience was the slow development of the cytopathic process, which takes from 12 to 28 days to manifest4,5.
Development of a validated and normalized quantitative real-time polymerase chain reaction (qRT-PCR) method will help to rapidly detect the virus, to discriminate between EHV-2 and EHV-5 and to study the relationship between the viral genome load and the disease thanks to the quantification aspect.
Polymerase chain reaction (PCR) was described for the first time in 1986 by Mullis6 and is about to become the new gold standard in most of the fields of biological diagnosis (human, environment and veterinary). This method, which is based on the amplification of a part of the genome of pathogens, presents many advantages: specificity, sensitivity and rapidity. Moreover, the risk of amplicon contamination receded since the advent of qRT-PCR and quality assurance7. Nevertheless, the recognition of PCR as a new gold standard method necessitated more than just improved performance data but also the demonstration of the control of development and validation steps of the whole method without degradation of the performance over time.
The first molecular tools used for the detection of EHV-2 were time consuming and involved non-specific amplification with nested PCR followed by sequencing8. The targeted genes for herpes viruses were deoxyribonucleic acid (DNA) polymerase and DNA packaging9. However, nested PCR presents a high risk of contamination by amplicons. Since then, conventional PCR tests have been designed to amplify the interleukin 10-like gene or glycoprotein B gene, reviewed in 20092. More recently, real-time PCR characteristics were described for the quantification of EHV-210 but no data were available concerning validation of the whole method including the extraction process.
In this protocol, development and validation procedures are described for a quantitative PCR method for the detection and quantification of EHV-2 DNA in equine respiratory fluids according to the Association française de normalisation (AFNOR) norm NF U47-6003,11,12, which is the French representative in the international normalization committee. This norm details the "Requirements and recommendations for the implementation, development and validation of veterinary PCR in animal health analysis method"11,12, according to the NF EN ISO/CEI 17025, 200513 and to OIE (World Organization for Animal Health) recommendations, 201014. The EHV-2 qRT-PCR validation protocol involves a three-part procedure: (a) development of the qRT-PCR assay, (b) characterization of qRT-PCR assay alone and (c) characterization of the whole analytical method (from extraction of nucleic acids from the biological sample to PCR analysis).
The characterization of the qRT-PCR assay and of the whole analytical method include the definition of two limits: the limit of detection (LOD) and the limit of quantification (LOQ). The LOD95% PCR represents the lowest number of nucleic acid copies per unit volume that can be detected in 95% of all cases. The LOQ95% PCR represents the lowest quantity of nucleic acid copies that can be determined taking into account the uncertainties.
This qRT-PCR method allows the precise detection and rapid quantification of EHV-2 in respiratory fluids. Furthermore, the method could be applied in other laboratories to ensure a standardized procedure and as general template for the development of other new qRT-PCR assays.
Note: Refer to all the different steps that are illustrated in Figure 1.
1. Extraction of Nucleic Acids
Note: Perform extraction under a fume hood to limit airway contamination with nucleic acids. Include an extraction negative control with DEPC-treated water to ensure that none of the reagents are contaminated with unwanted DNA.
2. Amplification Procedure
3. Development of Quantitative RT-PCR
Note: The development of a qRT-PCR test requires reference strains, a specific titrated plasmid, and different controls and entails the titration of the primers and probe.
4. Characterization of Quantitative Real-time PCR (qRT-PCR)
Note: After the development step and determination of the best conditions to use, the characterization step of the PCR includes the specificity, the limit of detection, the linearity range and the limit of quantification of qRT-PCR.
5. Characterization of the Whole Analytical Method (from DNA Extraction to the qRT-PCR Result)
Note: The characterization of the whole method is the validation of all steps necessary to obtain qRT-PCR data (i.e., from the extraction of DNA from the respiratory sample (see section 1) to the amplification and quantification of the target (see section 2)).
The quantitative RT-PCR method, as described above, was implemented to detect and quantify equid herpesvirus-2 in respiratory fluids. Figure 1 illustrates a schematic workflow chart for the development and validation of a quantitative RT-PCR method according to the AFNOR norm NF U47-600. Specificity of the primers and probes were validated during the step-by-step development of the PCR. Only EHV-2 strains were amplified in this system. Subsequently, the performance of the qRT-PCR had to be characterized.
Firstly, to estimate the LODPCR, a 6 ten-fold serial dilution was performed to establish the abatement zone (Figure 2). In this example, 6 ten-fold serial dilutions were made between 10-5 and 10-10 (between 26,000 and 0.26 copies/2.5 µl sample) to estimate the LODPCR. The abatement zone lies between dilutions of 10-9 and 10-10 (between 2.6 and 0.26 copies/2.5 µl sample). To determine the LODPCR value in this case, 6 two-fold serial dilutions of the plasmid were made in this abatement zone between 5.2 and 0.16 copies/2.5 µl sample. The LODPCR value was 2.6 copies/2.5 µl sample.
To determine the linearity range and LOQPCR, the LODPCR value was used to start the range of 6 ten-fold serial dilutions, between 2.6 (LODPCR) and 260,000 copies/2.5 µl sample. Figure 3 illustrates a linear regression for the EHV2 qRT-PCR from one trial. The performances of linear regression (Figure 4) are validated in quadruplicate using the calculations described in Table 3. The calculations are performed to define the linearity range according to the criteria absolute Biasi value ≤0.25 log10, whatever the level i of plasmid load. In this case, the linearity range lay between 2.6 and 260,000 copies/2.5 µl sample. The LOQPCR is the lowest concentration in the linearity range (i.e., 2.6 copies/2.5 µl sample in this case). ULIN was determined to be 0.12 log10 in the range 2.6-260,000 copies/2.5 µl of DNA.
After development (Figure 1, blue) and characterization of the qRT-PCR (Figure 1, yellow), the AFNOR NF U47-600 norm recommends characterization of the whole analytical method from DNA extraction to qRT-PCR (Figure 1, orange). The diagnostic sensitivity and specificity were calculated as described in Table 4. The quantitative performances of the qRT-PCR whole analytical method was evaluated and validated with an accuracy profile (Figure 5).
This protocol, which uses state-of-the-art molecular technology, allowed us to detect and quantify the EHV-2 viral genome load in 172 nasal swab samples obtained from horses with respiratory disorders and/or clinical suspicion of infection. The incidence of EHV-2 from field (biological) samples was 50% (86/172) in this population. The quantitative analyses showed that viral genome loads of EHV-2 were significantly higher in young horses and the repartition of viral genome loads decreased with age (Figure 6). In the present study, the highest EHV-2 viral genome load (1.9 x 1011 copies/ml) was detected in foals (Figure 6).
Figure 1: Workflow chart for the development (blue), the characterization of the quantitative RT-PCR (yellow) and the characterization of the whole analytical method from DNA extraction to qRT-PCR (orange) according to the AFNOR norm NF U47-600-2. The workflow chart resumes the different steps for the development, the characterization of the quantitative RT-PCR and the characterization of the whole analytical method from DNA extraction to qRT-PCR. For each step, the workflow chart indicates the number of required runs, dilutions to be perform and the number of required analysts. Please click here to view a larger version of this figure.
Figure 2: Determination of the abatement zone with representative results from real-time PCR curves obtained with 6 ten-fold serial dilutions of plasmid. To estimate the abatement zone, 6 ten-fold serial dilutions are made between 10-5 (26,000 copies/2.5 µl sample) and 10-10 (0.26 copies/2.5 µl sample). The abatement zone lies between dilutions of 10-9 (2.6 copies/2.5 µl sample) and 10-10 (0.26 copies/2.5 µl sample). In this case, 6 two-fold serial dilutions of plasmid were made in this abatement zone to determine the LOD 95% PCR, between 5.2 and 0.16 copies/2.5 µl sample. Please click here to view a larger version of this figure.
Figure 3: Linear regression for EHV2 qRT-PCR. The linearity of quantitative testing is the ability to generate results which are proportional to the concentration of the target present in a specific range. This can be modeled by linear regression (y = ax + b) between the instrumental response (Cycle threshold or Ct) and the logarithm of the quantity of the target (number of target copies/2.5 µl sample). Please click here to view a larger version of this figure.
Figure 4: Performance of linear regression of EHV-2 qPCR. Mean bias represent the mean difference between the measured plasmid quantity () and the theoretical plasmid quantity (x'i) for each plasmid level. Vertical bars represent the linearity uncertainty (ULINi) given by the formula
where SD'i is the standard deviation of measured plasmid quantity. Please click here to view a larger version of this figure.
Figure 5: Accuracy profiles based on the validation results of the EHV-2 qRT-PCR method. The green line (circles) represents the trueness of the data (systematic error, or bias). The acceptability limits are defined at ± 0.75 Log10 by the laboratory (dashed lines). The lower and the upper accuracy limits were determined for each plasmid load level from the mean bias ± twice the standard deviation of the reliability data (red lines). Please click here to view a larger version of this figure.
Figure 6: Quantification of viral genome loads of EHV-2 according to age. The viral genome load distribution of EHV-2 detected in nasal swab samples is represented for the different age groups. The horizontal lines represent the median values within the standard deviation (m = months). * Significantly different by ANOVA with Newman-Keuls post-hoc test (p <0.05). Please click here to view a larger version of this figure.
Target gene | Primers, probe and plasmide sequences (5'-3') | Nucleotide position | Product size (nucleotides) | Thermal cycling conditions | 参考文献 | |||
EHV2 gB (HQ247755.1) |
Forward: GTGGCCAGCGGGGTGTTC | 2113-2130 | 78 | 95 °C 5 min | 11 | |||
Reverse: CCCCCAAAGGGATTYTTGAA | 2189-2170 | 95 °C 15 sec | 45 cycles | |||||
Probe: FAM-CCCTCTTTGGGAGCATAGTCTCGGGG-MGB | 2132-2157 | 60 °C 1 min | ||||||
Plasmid: ACCTGGGCACCATAGGCAAGGTGGTGGTCA ATGTGGCCAGCGGGGTGTTCTCCCTCTTTG GGAGCATAGTCTCGGGGGTGATAAGCTTTTT CAAAAATCCCTTTGGGGGCATGCTGCTCATA GTCCTCATCATAGCCGGGGTAGTGGTGGTG TACCTGTTTATGACCAGGTCCAGGAGCATAT ACTCTGCCCCCATTAGAATGCTCTACCCCGG GGTGGAGAGGGCGGCCCAGGAGCCGGGCG CGCACCCGGTGTCAGAAGACCAAATCAGGA ACATCCTGATGGGAATGCACCAATTTCAG |
2081-2381 |
Table 1: Sequences of primers, probes and positive synthetic DNA controls used in this protocol. The sequence of plasmid (positive synthetic DNA) corresponds to nucleotide positions 2081-2381 of EHV2gB sequence (HQ247755.1). The design of primers and probes used in this protocol was obtained by using specific software.
PATHOGENS | Reference (origin) | Number of strains | RESULTS |
EHV-2 | |||
EHV-2 | VR701 (ATCC) | 20 | Positive |
20 samples (FDL collection) | |||
EHV-5 | KD05 (GERC) | 20 | Negative |
20 samples (FDL collection) | |||
EHV-3 | VR352 (ATCC) | 2 | Negative |
T934 WSV (GERC) | |||
EHV-1 | Kentucky strain Ky A (ATCC) | 3 | Negative |
2 samples (FDL collection) | |||
EHV-4 | VR2230 (ATCC) | 1 | Negative |
Asinine herpesvirus AHV5 | FDL Collection | 1 | Negative |
Equine Influenza Virus | A/equine/Jouars/4/2006 (H3N8) | 1 | Negative |
(Accession Number JX091752) | |||
Equine Arteritis Virus | VR796 (ATCC) | 2 | Negative |
Rhodococcus equi | FDL Collection | 1 | Negative |
Streptococcus equi subsp. Zooepidemicus | FDL Collection | 1 | Negative |
Streptococcus equi subsp. equi | FDL Collection | 1 | Negative |
Coxiella burnetii | ADI-142-100 (Adiagene) | 1 | Negative |
Chlamydophila abortus | ADI-211-50 (Adiagene) | 1 | Negative |
Klebsiella pneumoniae | FDL Collection | 1 | Negative |
Table 2: Analytical specificity of qRT-PCR for EHV-2.
Table 3: Calculation of the bias and linearity uncertainty (adapted from NF U47-600-212). For each trial, the performances of linear regression (y = ax+b) are validated using the table where y is the cycle threshold obtained; a is the slope obtained; x is the plasmid level and b is the intercept. i is the plasmid level (i varies from 1 to k levels); k is the number of plasmid levels used (e.g, k = 6 in this table); j is the trial (j varies from 1 to I trials); I is the number of trials, comprised between 3 and 6 trials (e.g. I = 4 in this table). xi is the estimated plasmid quantity for each i plasmid level. x'i is the theoretical plasmid quantity obtained with equation x'i = log10(xi) for each i plasmid level. During each j trial, the cycle threshold obtained for each i plasmid level is calculated with the linear regression yi,j = ajxi,j + bj. is the measured plasmid quantity during the trial j. Biasi is the difference observed between the measured plasmid quantity and the theoretical plasmid quantity for each trial and each plasmid level. is the mean value of by each i plasmid level; SD'i is the standard deviation of measured quantity for each i plasmid level; Mean bias is the mean of Biasi; ULINi is the linearity uncertainty determined for each i plasmid level calculated from SD'i and mean bias. Please click here to view a larger version of this figure.
Real status of sample | |||
Positive | Negative | ||
Results obtained with whole method | Positive | RP (real positive) | FP (false positive) |
Negative | FN (false negative) | RN (real negative) | |
Total | RP+FN | FP+RN | |
Se = RP/(RP+FN) | Sp = RN/(RN+FP) |
Table 4: Calculation of diagnostic sensitivity (Se) and specificity (Sp) of the whole method. A Schwartz table was used to calculate the confidence interval at 95% of sensitivity and specificity of the whole method as described in NF U47-600-2.
Since the 2000s, real-time PCR has been replacing gold standard techniques (cell culture and bacteria culture methods) in an increasing number of laboratories. Implementation of the technique is relatively easy. However validation of laboratory methods is essential for molecular detection and quantification of pathogens to ensure accurate, repeatable and reliable data.
Since the extraction step is the primary source of loss of biological material, it may be considered the main source of error of quantification between one protocol and another. As such, the creation of a standard curve of DNA plasmid during qRT-PCR, mainly reported in the literature, indicates the viral genome load but does not take into account the extraction step.
Description of a de novo strategy for a whole method validation process in the AFNOR norm NF U47-600-2 represents a significant progress in this area. As illustrated in this paper for EHV-2 in horses, or by others in bees21, this necessitates clear differentiation between the development step and the validation step with characterization of the PCR and characterization of the whole method. One limitation in this interesting approach is that any change in the protocol will result in the obligation to revalidate the complete process which could be very costly. This limitation was also highlighted by the fact that the confines of quantification depend on the source from which the virus is extracted (e.g., respiratory fluids, organs, blood or urine). In fact, each matrix presents different specificities in their physico-chemistry characteristics and it is important to define independently each different matrix used for viral detection and quantification by qRT-PCR. Thus, the viral genome load of each biological sample can be quantified more precisely from the extraction. The characterization also takes into account the thermocycler model and when the use of a previously well-characterized method (e.g., the EHV-2 qPCR method described in this paper) necessitates a new type of machine in the parent laboratory or another laboratory, one must confirm the performance of that instrument. The confirmation of the performance of a qPCR assay is a prerequisite for all tests bring into a laboratory. This is normally achieved by analyzing a reference sample with known properties. Such a check is a prerequisite and considered mandatory as requested by the NF 47-600-1 AFNOR norm in order to validate the performance of the qPCR (LOD, LOQ efficiency) and the robustness of the whole method (LOD, LOQ). Not only during the development and characterization steps but also when used in research or for diagnostic purposes, the risk factors can be identified and well controlled to ensure standardization of the protocol. Of particular concern is adequate staff training, highly qualified personnel, quality control of the consumables used and their storage, control of the immediate environmental conditions and awareness of metrological conditions that may affect the performance of the scientific instruments involved in the assay. Use of reference samples for inter-laboratory comparisons could also help control the uncertainties. In this manner, comparison of data between laboratories may be facilitated. Indeed, inter-laboratory proficiency tests are essential to evaluate and confirm the reproducibility of the method.
Viral genome load results which are expressed in international units (IU) of the analyzed biological matrix (IU: copies/ml for fluids or copies/g for tissues) are easier to use in order to compare results between different laboratories. All the results above the LOQ are expressed as copies/ml and a result between the LOD and LOQ is taken as a non-quantifiable positive result. Presenting quantificational data of the genome in this manner conforms more precisely to the process of analyses (amplification of the genome). In fact, in cell culture experiments, expression of the viral load by TCID50 (median tissue culture infective dose) is dependent on the nature of the cells and virus strains. Each strain line possesses its unique infection kinetics and some viruses like EHV-2 can take several days before the first cytopathogenic effect is apparent.
In conclusion, this new method of characterization of qRT-PCR should facilitate the harmonization of data presentation and interpretation between laboratories. This will be very useful for potential new applications of qRT-PCR in the future like the establishment of a cut-off value for declaration of the disease status instead of merely the presence or absence of the pathogen.
The authors have nothing to disclose.
The authors would like to thank Sophie Castagnet and Nadia Doubli-Bounoua for their technical support. This work received financial support from the General Council of Calvados and the agreement of Region Basse-Normandie and French Government (CPER 2007-2013; project R25 p3). The authors would like to thank the experts of the AFNOR group and particularly Jean-Philippe Buffereau and Eric Dubois.
AB-1900 natural color ABgene 96 well plate | Dutsher | 16924 | |
Adhesive film QPCR Absolute | Dutsher | 16629 | Adhesive film used for sealing the plate prior to the qRT-PCR run |
0.5 mL microtubes, skirted, caps | Dutsher | 039258 | |
Ethanol 98% | Sodipro | SAF322941000 | |
Primers | Eurofins | Custom order | |
Probe | Life Technologies | Custom order | |
Plasmid | Eurofins | Custom order | |
QIAamp RNA viral Mini Kit (containing: QIAamp Mini column, AVL buffer, AW1 buffer, AW2 buffer, AVE buffer, collection tubes) |
Qiagen | 52906 | AVL buffer: pre-warm 5 min at 72°C |
Sequencing by Sanger method | Eurofins | Custom order | |
Taqman Universal PCR Master Mix | Life Technologies | 4364340 | |
Tris-EDTA buffer solution | Santa Cruz | sc-296653A | |
NanoDrop 2000c Spectrophotometer | Thermoscientific | ND-2000C | |
StepOnePlus Real-Time PCR systems | Life Technologies | 4376600 | pre-warm 15 min |