Comparison of Three BRAF Mutation Tests in Formalin-Fixed Paraffin Embedded Clinical Samples
Article information
Abstract
Background
Recently, BRAF inhibitors showed dramatic treatment outcomes in BRAF V600 mutant melanoma. Therefore, the accuracy of BRAF mutation test is critical.
Methods
BRAF mutations were tested by dual-priming oligonucleotide-polymerase chain reaction (DPO-PCR), direct sequencing and subsequently retested with a real-time PCR assay, cobas 4800 V600 mutation test. In total, 64 tumors including 34 malignant melanomas and 16 papillary thyroid carcinomas were analyzed. DNA was extracted from formalin-fixed paraffin embedded tissue samples and the results of cobas test were directly compared with those of DPO-PCR and direct sequencing.
Results
BRAF mutations were found in 23 of 64 (35.9%) tumors. There was 9.4% discordance among 3 methods. Out of 6 discordant cases, 4 cases were melanomas; 3 cases were BRAF V600E detected only by cobas test, but were not detected by DPO-PCR and direct sequencing. One melanoma patient with BRAF mutation detected only by cobas test has been on vemurafenib treatment for 6 months and showed a dramatic response to vemurafenib. DPO-PCR failed to detect V600K mutation in one case identified by both direct sequencing and cobas test.
Conclusions
In direct comparison of the currently available DPO-PCR, direct sequencing and real-time cobas test for BRAF mutation, real-time PCR assay is the most sensitive method.
Melanoma is the most aggressive skin cancer and the number of cases worldwide has doubled in the past 20 years.1 In particular, metastatic malignant melanoma is largely refractory to existing therapies and has a poor prognosis with a median survival rate of 6 months and a 5-year survival rate of less than 5%.2
The management of melanoma is rapidly evolving due to an improved understanding of its molecular biology and the development of effective, personalized, and targeted therapy strategies. Of particular importance in melanoma is the mitogen-activated protein kinase (MAPK) pathway, which normally regulates cell growth, proliferation, and differentiation.3 Aberrant activation of the MAPK pathway is present in over 80% of primary melanomas,4 and mutations in proteins along the RAS-RAF-MEK-ERK pathway are thought to be mutually exclusive. Among them, the most commonly mutated component of this pathway is BRAF.1 Constitutively activating mutations in the BRAF oncogene have been reported in 33% to 47% of primary melanomas and 41% to 55% of metastatic melanomas.5 Since its discovery in 2002, the BRAF V600E mutant kinase has been considered a promising therapeutic target for malignant melanoma. Recently, metastatic melanoma patients with the BRAF V600E mutation in a phase 3 randomized clinical trial on BRAF inhibitor (vemurafenib) showed significantly prolonged survival with a 63% relative reduction in the risk of death and a 74% relative reduction in the risk of tumor progression.6,7 Therefore, it is of great importance to accurately select patients with BRAF mutations who are candidates for BRAF inhibitors. Furthermore, in preclinical studies with mutant-selective BRAF inhibitors, melanoma patients with wild-type BRAF showed no response and paradoxically increased tumor growth.8-10 These findings once again highlighted the importance of accurate BRAF detection in the management of malignant melanoma.
Given the importance of BRAF mutation detection in this highly aggressive tumor, companion diagnostic testing using the cobas 4800 BRAF V600 mutation test, a real-time polymerase chain reaction (PCR) test, was approved by the Food and Drug Administration (FDA) in 2011. There is limited data on the direct comparison of BRAF detection approaches such as PCR-based methods and sequencing methods.11-13 A more recently developed method, cobas, was reported to have a lower failure rate and more sensitivity for detecting V600E mutations than Sanger direct sequencing.12,13 However, all previous studies have only compared the analytic performance of the cobas test to Sanger sequencing. We performed direct comparison of the cobas BRAF V600 mutation test with dual-priming oligonucleotide-polymearse chain reaction (DPO-PCR) and direct sequencing in Korea, where the incidences of mucosal and acral melanomas are higher compared to melanomas that develop on sun-exposed skin for the first time.
MATERIALS AND METHODS
Patients and tumors
A total of 73 tumors were analyzed for the BRAF mutation. Tests were performed on formalin-fixed, paraffin-embedded (FFPE) tissue blocks diagnosed between 2011 and 2012. Of the 73 cases, 64 cases were sufficient for DNA isolation and analysis of the BRAF mutation by DPO-PCR, direct sequencing, and the cobas BRAF V600 mutation test, and were selected for this study. Tumor specimens consisted of 34 malignant melanomas (53.1%), 16 papillary thyroid carcinomas (25.0%), 11 adenocarcinomas from the colon (17.2%), 1 clear cell carcinoma from the skin (1.6%), 1 mucinous adenocarcinoma from the bladder (1.6%), and 1 epithelioid sarcoma (1.6%) from the soft tissue.
Of the 34 malignant melanoma patients, 1 patient (2.9%) was stage II, 5 patients (14.3%) were stage III, 26 patients (76.5%) were stage IV, and 2 patients (5.9%) were of unknown stage. In terms of primary sites, 12 (35.3%) were cutaneous, 8 (23.5%) were mucosal, 12 (35.3%) were acral, and 2 (5.9%) were of unknown primary site. Of the 34 melanomas, 13 (38.2%) specimens were obtained from primary tumor sites and 21 (61.8%) were obtained from metastatic tumors. For the rest of the tumors, the tumor samples for BRAF detection were obtained either from primary or from metastatic tumors.
DNA extraction
An appropriate paraffin block containing tumor tissue was selected for analysis after reviewing the hematoxylin and eosin-stained slides. Tumor volume was evaluated for each case and the amounts of melanin pigments, necrosis, and inflammatory cells admixed with tumor were also evaluated for melanoma cases. If possible, tumor-rich areas (>80%) were extracted from FFPE tumor samples using manual microdissection under microscopy, as previously described.14 Five sections of 4 µm thickness containing a representative portion of each tumor were subjected to DNA isolation by QIAamp DNA FFPE tissue kit (Qiagen, Hilden, Germany) according to the manufacturer's protocol after deparaffinization with xylene. The same DNA was used for all of the analyses.
Mutation analyses
BRAF mutations were detected utilizing both DPO-PCR and direct sequencing. Afterwards, all of the DNA was subsequently retested with a real-time PCR assay (cobas 4800 V600 mutation test, Roche Molecular Systems, Mannheim, Germany). An agreement analysis among DPO-PCR, direct sequencing, and cobas was made.
Dual-priming oligonucleotide-PCR
DPO-PCR analysis was performed using the Seeplex BRAF ACE detection system (Seegene, Seoul, Korea) designed to detect the V600E variant according to the manufacturer's instructions. Each PCR reaction mixture contained 4 µL of 5× BRAF primer, 3 µL of extracted DNA (10 ng/µL), 3 µL of 8-methoxypsoralen solution (0.01%) , and 10 µL of 2× multiplex master mix (Seegene), with a total volume of 20 µL. After 15 minutes of incubation at 94℃, amplification was performed in a Thermal Cycler (Applied Biosystems, Foster City, CA, USA) with 35 cycles of denaturation at 94℃ for 30 seconds, annealing at 62℃ for 30 seconds, extension at 72℃ for 60 seconds, and a final extension at 72℃ for 10 minutes. The amplified PCR products were visualized and analyzed on the screenTape system (Lab901 Ltd., Edinburgh, UK) with Seegene viewer software. The level of internal control/V600E amplicon band intensity was recorded by a mutation ratio >10%. In our analyses using serially diluted DNAs from the BRAF mutant cell line SNU-790, the analytical limit of detection was less than 5%.
Direct sequencing of the BRAF gene
One hundred nanograms of DNA was amplified in a 20 µL reaction volume containing 2 µL of 10× buffer (Roche), 1.7-2.5 µM of MgCl2, 0.3 µM of each primer pair, 250 µM of dNTPs, and 2.5 unit of DNA polymerase (Roche). The PCR primers were 5'-TGCTTGCTCTGATAGGAAAATG-3' (forward) and 5'-AGCATCTCAGGGCCAAA AAT-3' (reverse). The PCR cycling conditions were as follows: an initial denaturation at 95℃ for 30 seconds, an annealing at 61℃ for 90 seconds decreasing by 0.5℃ every cycle until it reached 57℃, and an elongation step at 72℃ for 90 seconds. This procedure was followed by an additional 30 cycles with an annealing temperature at 57℃, and a final elongation step at 72℃ for 10 minutes. The PCR products were processed for the DNA sequencing reaction using the ABI-PRISM BigDye Terminator version 3.1 (Applied Biosystems) with both forward and reverse sequence-specific primers. Sequence data were generated using the ABI-PRISM 3100 DNA Analyzer (Applied Biosystems). In our analyses on the serially diluted DNA from the BRAF mutant cell line SNU-790, the analytical limit of detection was 12.5%.
Cobas 4800 BRAF V600 mutation test
The same DNA used for DPO-PCR and direct sequencing was diluted to 5 ng/µL. A working master mix was prepared for use and 25 µL of it was added to each reaction well on the 96-well amplification-detection plates. Reaction controls and diluted specimens were then added to the respective reaction wells at 25 µL/well and mixed. The cobas 4800 BRAF V600 mutation test utilizes real-time PCR technology and uses primers that define a 116-base pair sequence of the human genomic region containing the BRAF V600E site in exon 15. BRAF wild-type and V600E target-specific fluorescent dye-labeled TaqMan probes bind to the wild-type and V600E sequences, respectively. The results were automatically generated by the cobas BRAF analysis software package (Roche Molecular Systems Inc., Branchburg, NJ, USA). In our analyses using serially diluted DNA from the BRAF mutant cell line SNU-790, the analytical limit of detection was less than 5%.
RESULTS
BRAF mutation results by cobas
A total of 64 cases were finally included in this study. The summary of the test results based on the cobas test are shown in Table 1. BRAF mutations were found in tumors of 23 of the 64 patients (35.9%). In the 34 melanomas, BRAF mutations were detected in 10 cases (29.4%). Nine patients had V600E mutations and one patient harbored a V600K mutation. The frequency of BRAF mutations in malignant melanoma varied according to the primary site: 50.0% in cutaneous melanoma, 12.5% in mucosal melanoma, and 16.7% in acral melanomas. In papillary thyroid carcinomas, BRAF mutations were detected in 13 out of 16 cases (81.3%). No BRAF mutation was identified in the rest of the tumors.
BRAF mutation concordance among dual-priming oligonucleotide-PCR, direct sequencing, and cobas
There was 90.6% concordance (58 of 64 tested samples) and 9.4% discordance among the 3 methods. Out of the 6 discordant cases, 4 cases were melanomas and 2 cases were papillary thyroid carcinomas. The clinicopathologic characteristics of the discordant cases are provided in Table 2. Notably, 3 cases (cases nos. 27, 42, and 44) were V600E-positive only by the cobas test, and negative by DPO-PCR and direct sequencing (Fig. 1A). Among these 3 discordant cases, 1 patient (case no. 27) with a V600E-mutated metastatic melanoma which was detected only by the cobas test had been treated with vemurafenib and showed a dramatic therapeutic response. In 2 discordant cases which were confirmed to be V600E-positive in both direct sequencing and the cobas test, DPO-PCR showed invalid results with no internal control bands in repeated experiments (cases nos. 6 and 7) (Fig. 1B). In case no. 29, DPO-PCR failed to detect the V600K mutation which was identified in both direct sequencing and the cobas test (Fig. 1C). Direct sequencing revealed the V600K mutation with a substitution of 2 nucleotides (c.1798_1799 GT>AA) (Appendix 1).
DISCUSSION
As the clinical efficacy of BRAF inhibitors has now been documented in BRAF V600 melanoma, the sensitivity and specificity of BRAF mutation tests to select candidate patients should be important as well. In 2011, the FDA approved vemurafenib for the treatment of metastatic melanoma patients with a BRAF V600 mutation, along with the cobas 4800 companion diagnostic test. However, how the FDA approval of the cobas 4800 diagnostic test will influence the use of the current portfolio of validated BRAF tests performed in Clinical Laboratory Improvement Amendments-certified laboratories around the country remains uncertain.15 Traditional bidirectional Sanger sequencing has been widely used for mutation testing in most clinical laboratories, but it suffers from a limited sensitivity for low-level mutant alleles and a relatively slow turn-around time.12,16
There are scarce reports of studies which have directly compared currently available BRAF mutation tests used in the clinic.11-13,17 All previous studies have compared the analytic performance of the cobas test to Sanger sequencing and have suggested that the cobas test is superior to direct sequencing in terms of diagnostic accuracy and sensitivity. The cobas test showed a very high sensitivity (>99%) and specificity (88%) for the detection of the BRAF V600E mutation.15 In this study, BRAF mutations were tested by DPO-PCR, direct sequencing, and the cobas 4800 V600 mutation test. DPO-PCR is still performed in many laboratories in Korea because of its easy accessibility and low costs. However, the sensitivity and specificity of DPO-PCR is still controversial; The DPO system has shown results comparable to those of direct sequencing and pyrosequencing in terms of its sensitivity and specificity for detecting BRAF mutations.18 However, some have reported lower sensitivity compared to direct sequencing.19 Therefore, comparing the cobas test with DPO-PCR and direct sequencing is also important.
An agreement analysis showed that there was discordance in 9.4% of the cases among the 3 methods. An important problem is that 4 melanomas were included in these discordant cases. According to a previous study by Halait et al.,12 the positive percent agreement between the cobas test and Sanger sequencing was 96%, and the negative percent agreement was 82%. Our study revealed 86.7% (20/23) agreement for BRAF mutation-positive cases and 100% (41/41) agreement in BRAF mutation-negative cases between the cobas test and Sanger sequencing.
It is noteworthy that 3 cases were determined to be V600E-positive only by the cobas test and negative by DPO-PCR and direct sequencing. These three specimens contained large amounts of tumor volume and minimal known interference factors such as melanin pigments or inflammatory cells were identified. Therefore, the reason for the negative results by DPO-PCR and direct sequencing could be due to the heterogeneity of BRAF mutations existing in melanomas20,21 or the higher sensitivity of the cobas test as compared to sequencing, as was observed in previous studies.11,12 In repeated experiments, we failed to find internal positive bands in the DPO-PCR analysis. In these cases, DNA extraction was repeated several times. Although the precise cause has not been described in the literature, poor-quality DNA caused by delayed fixation or melanin pigments within tumors may have inhibited the PCR reaction.
It is well known that Sanger sequencing is not as sensitive as mutant-specific and real-time PCR technologies. The sensitivity of direct sequencing and DPO-PCR is limited in that they are only able to detect the mutation if the tumor cells constitute more than 5% of the specimen submitted for genetic analysis.21 One concern regarding the utilization of mutation detection techniques with enhanced sensitivity is that a positive test might actually reflect the detection of a small subset of mutant cells. Some have argued that there is no clinical relevance of a tumor containing a small amount of mutant BRAF cells, as these patients would not be expected to benefit from BRAF inhibitors.21 In this study, we observed that 1 melanoma patient (case no. 27) with BRAF mutation detected only by the cobas test, but was wild-type in both DPO-PCR and direct sequencing, had been on vemurafenib treatment for 6 months and had showed a dramatic response. Further studies are therefore warranted to determine the clinical application of vemurafenib on patients with tumors containing a small amount of mutant BRAF cells or tumors with heterogeneity.
In terms of non-V600E mutations, 1 V600K mutation was included in our study. The Catalog of Somatic Mutations in Cancer (COSMIC) database indicates that approximately 90% of BRAF codon 600 mutations in melanoma are V600E. Data are currently very limited on the clinical importance of non-V600E mutations. In the phase III trial of vemurafenib, 10 patients with V600K mutations were included and 4 of them showed partial responses, 3 had stable disease, 2 had progressive disease, and 1 had data that could not be assessed.7 These results suggest that vemurafenib may benefit patients with V600K mutations and that BRAF detection methods should be able to detect non-V600E mutation in clinical settings. Although the cobas test was designed to detect the V600E mutation, it has also showed cross-reactivity with V600K, as previously described.12
The present study has several limitations. The sample size was small. We found only 1 V600K mutation, for which the cobas test is known to have limited detection, and the results were not confirmed by massive parallel sequencing with next-generation sequencing platforms. Given that many large cohorts report around 6-30% of melanoma tumors having V600K,22 more V600K cases are needed to better compare the methodologies.
In conclusion, we directly compared direct sequencing with the currently available cobas test and DPO-PCR for BRAF mutations and found that the cobas test is a more sensitive method applicable for the small quantities of DNA extracted from FFPE clinical samples.
Notes
No potential conflict of interest relevant to this article was reported.