The diagnostic value of pleural fluid homocysteine in malignant pleural effusion

Summary

Background

Pleural fluid homocysteine (HCY) can be useful for diagnosis of malignant pleural effusion (MPE). There are no published studies comparing the diagnostic accuracy of HCY with other tumour markers in pleural fluid for diagnosis of MPE. The aim was to compare the accuracy of HCY with that of carcinoembryonic antigen (CEA), cancer antigen (CA) 15.3, CA19.9 and CA125 in pleural fluid and to develop a probabilistic model using these biomarkers to differentiate benign (BPE) from MPE.

Methods

Patients with pleural effusion were randomly included. HCY, CEA, CA15.3, CEA19.9 and CA125 were quantified in pleural fluid. Patients were classified into two groups: MPE or BPE. By applying logistic regression analysis, a multivariate probabilistic model was developed using pleural fluid biomarkers. The diagnostic accuracy was determined by receiver operating characteristic (ROC) curves and calculating the area under the curve (AUC).

Results

Population of study comprised 133 patients (72 males and 61 females) aged between 1 and 96 years (median = 70 years), 81 BPE and 52 MPE. The logistic regression analysis included HCY (p<0.0001) and CEA (p = 0.0022) in the probabilistic model and excluded the other tumour markers. The probabilistic model was: HCY+CEA = Probability(%) = 100×(1+e^-z)^-1, where Z = 0.5471×[HCY]+0.3846×[CEA]–8.2671. The AUCs were 0.606, 0.703, 0.778, 0.800, 0.846 and 0.948 for CA125, CA19.9, CEA, CA15.3, HCY and HCY+CEA, respectively.

Conclusions

Pleural fluid HCY has higher accuracy for diagnosis of MPE than CEA, CA15.3, CA19.9 and CA125. The combination of HCY and CEA concentrations in pleural fluid significantly improves the diagnostic accuracy of the test.

Keywords:

Diagnostic medicine – Cancer detection and diagnosis – Normal distribution – biomarkers – Regression analysis – Pleural effusion – Metastatic tumors

Introduction

Malignant pleural effusion (MPE) involves the accumulation of exudate in the pleural space due to its invasion by primary tumour cells (mesothelioma) or metastatic tumour cells originating from other tissues. Studies have shown that 42–77% of exudative effusions are secondary to malignancy [1]. The cancers causing MPE, in order of frequency, are lung cancer, breast cancer, lymphoma, unknown primary, genitourinary cancer and gastrointestinal cancer [2]. MPE is found in an estimated 50% of patients with malignant metastatic tumours, either at the time of diagnosis or during the course of their disease [3]. Clinically, the prognosis of MPE is poor, with a median survival of 3 to 12 months, depending on the histological type of the tumour [4,5]. Differentiation between MPE and benign pleural effusion (BPE) is crucial for the treatment and prognosis of these patients. The gold standards for the diagnosis of DPM are pleural fluid cytology and pleura biopsy. The identification of malignant cells in pleural fluid (cytology) is laborious and subjective and shows highly variable sensitivity (from 11% to 78%) [6–8]. Pleural biopsy can achieve high sensitivity, but the procedure is invasive, requires extensive experience, is technically difficult and may not be appropriate in critically ill patients [9]. In contrast, tumour markers (TMs) in pleural fluid may be measured easily and quickly in automated analyzers, being a minimally invasive technique with high accuracy for the diagnosis of DPM.

TMs are molecules produced by normal cells in response to cancer or secreted by the tumour cells themselves that are released into the blood and pleural fluid; their concentrations can be much higher in pleural fluid than in serum [6,10]. Although patients with benign effusions usually have TMs levels in pleural fluid lower than the upper reference limit for serum, parapneumonic and tuberculous pleural exudates can reach serum concentrations up to 14 times the upper reference limit. Moreover, some benign systemic diseases such as renal failure and liver disease can elevate serum TM levels and thereby indirectly elevate TMs concentrations in the pleural fluid as transudative pleural effusions. In addition, some TMs such as cancer antigen (CA) 125 are secreted by normal mesothelial cells and show elevated concentrations in patients with BPE [11]. Thus, the optimal cutoff value of a TM for MPE diagnosis must have sufficiently high specificity to ensure that the marker levels in BPE do not exceed the cutoff point. This high specificity lowers the sensitivity of the TMs. For this reason, some authors recommend the combination of two or more TMs to increase sensitivity without compromising specificity [12,13]. The most frequently used and widely studied pleural fluid TMs are carcinoembryonic antigen (CEA), CA15.3, CA19.9 and CA125. In addition, recent work identified homocysteine (HCY), a sulphur-containing amino acid derived from the metabolism of methionine, as a new TM in pleural fluid, with pleural fluid HCY showing high diagnostic accuracy to distinguish BPE and MPE [14]. However, there are no published studies comparing the diagnostic accuracy of HCY with other TMs in pleural fluid. The aim of this study was to compare the accuracy of HCY with that of CEA, CA15.3, CA19.9 and CA125 in pleural fluid and to develop a probabilistic model using these biomarkers to differentiate MPE from BPE.

Materials and methods

Study design and patients

This is a descriptive cross-sectional diagnostic study carried out at Puerto Real University Hospital (Cádiz, Spain) and adhered to the ethical recommendations of the Declaration of Helsinki [15]. The study was approved by the Research Ethics Committee of Cadiz and all participants signed an informed consent form. In cases of patients under the age of 18 years, informed consent form was obtained from the minor’s parents or guardians.

White patients treated from January 2014 to January 2017 at Puerto Real University Hospital were studied. This population includes some members of the population assessed in our previous study [14]. The following inclusion criteria were used: patients of any age and sex with pleural effusion and an indication for diagnostic thoracentesis. Exclusion criteria were: patients with previous pleural effusion, pleural fluid extracted from a second or successive thoracocentesis, and purulent pleural fluid.

Included patients were classified into two groups according to the aetiological diagnosis of the pleural effusion: MPE or BPE. The diagnosis of MPE required anatomopathological confirmation by pleural fluid cytology or pleural tissue biopsy.

The objective was to predict a dichotomous qualitative variable (MPE / BPE) using the values of the independent quantitative variables (pleural fluid biomarkers). This objective can be achieved by the multiple logistic regression study. The logistic regression develops a probabilistic model to predict a dichotomous variable using the combination of independent variables [16]. The sample size for the multiple logistic regression study was estimated using the following formula: n = 10k/p, where ‘k’ is the number of independent variables and ‘p’ is the proportion of patients with MPE [17]. Five pleural fluid biomarkers were included in this study (HCY, CEA, CA15.3, CEA19.9 and CA125). With an expected proportion of patients with MPE of 40%, the estimated sample size was n = 10 × 5 / 0.4 = 125 patients, with a minimum of 75 patients with BPE and 50 patients with MPE. The sampling method was incidental until the estimated sample size was completed.

Sample analysis

The pleural fluid of each patient extracted by thoracocentesis was analyzed. Biomarkers were quantified in pleural fluid supernatant. To obtain the supernatant, pleural fluid was centrifuged at 4000 revolutions per minute for 5 minutes. HCY was determined by nephelometry in a BNII autoanalyser (Siemens Healthcare Diagnostics, Marburg, Germany), with serum reference values between 4.9 and 15.0 μmol/L. TMs (CEA, CA15.3, CA19.9 and CA125) were quantified by electrochemiluminescence immunoassay in a Hitachi Modular E170 autoanalyser (Roche Diagnostics, Bassel, Switzerland). The serum reference values of TMs are < 5.0 ng/mL for CEA, < 35 U/mL for CA15.3 and CA125, and < 37 U/mL for CA19.9. Although the methods used are not validated for this type of sample, there are many papers using these immunoassays for the determination of TMs in pleural fluid, so these methods are widely accepted. In order to validate the method used for the determination of HCY in pleural fluid, a precision study was performed: repeatability (21 consecutive determinations in the same sample) and reproducibility (one determination per day for 21 days in an aliquot of the same sample conserved at -80°C).

Statistical analysis

Data were processed using MedCalc 13.0 (MedCalc Software, Ostend, Belgium), with significance set at p<0.05. The precision study was performed by calculating the coefficient of variation (CV(%) = 100 x standard deviation / arithmetic mean). Quantitative variables were analysed with the D'Agostino-Pearson test to determine whether they followed a normal (Gaussian) distribution or not. For the descriptive analysis, the frequencies of qualitative variables were used, as well as range and arithmetic mean for normally distributed quantitative variables and range and median for non-Gaussian quantitative variables. Correlations between normally distributed quantitative variables and between non-Gaussian variables were determined using the Pearson correlation coefficient and the Spearman rho correlation coefficient, respectively. Groups were compared using the Student t test for normally distributed variables and using the non-parametric Mann-Whitney U test for non-Gaussian variables. The influence of each independent variable that is, of each of the biomarkers measured in pleural fluid, on the dependent variable (MPE) was evaluated using odds ratios. By applying logistic regression analysis, a multivariate probabilistic model was developed using the independent variables of this study [Probability (%) = 100 × (1 + e^-z)^-1, where Z is the constant determined from the pleural fluid biomarkers]. We calculated the diagnostic accuracy of each of the independent variables and of the resulting probabilistic model by analysing receiver operating characteristic (ROC) curves and calculating the area under the curve (AUC), as well as their optimal cutoff value and the corresponding sensitivity and specificity. In order to reduce the number of false positives, the optimal cutoff value was considered to be the one with the highest sensitivity and a specificity > 90%.

Results

Population of study comprised 133 patients (72 males and 61 females) aged between 1 and 96 years (median = 70 years). In total, 81 patients had BPE and 52 had MPE. All quantitative variables followed a non-gaussian distribution (S1 Table). There were no statistically significant differences between the sexes in terms of the variables studied or any correlation with age (p>0.05). In the precision study, the repeatability and reproducibility CVs were 2.54% and 2.98%, respectively.

Table 1 shows the distribution of patients according to the aetiological diagnosis of the pleural effusion and demographic data; Table 2 shows the descriptive statistics of the biomarkers studied in pleural fluid and the statistical differences between the two patient groups (MPE and BPE); and Table 3 shows the results of the correlation study between the biomarkers quantified in pleural fluid.

The multivariate logistic regression analysis included the pleural fluid concentrations of HCY (p<0.0001) and CEA (p = 0.0022) in the probabilistic model and excluded the other biomarkers. The odds ratios were 1.72 [95% confidence interval (CI) = 1.36–2.18] and 1.46 (95% CI = 1.14–1.87) for HCY and CEA, respectively. The probabilistic model was as follows: Probability (%) = 100 × (1 + e^-z)^-1, where Z = 0.5471 × [HCY] + 0.3846 × [CEA]– 8.2671.

The ROC curves of each biomarker and of probabilistic model to differentiate MPE from BPE can be compared in Fig 1. The AUCs and the optimal cutoff values with their corresponding sensitivities and specificities are shown in Table 4. Significant differences were found between the AUC of the probabilistic model and all of the other AUCs of the pleural fluid biomarkers analysed (S2 Table).

Discussion

The pleural fluid concentrations of HCY, CEA, CA15.3, CA19.9 and CA125 were significantly higher in MPE patients than in BPE patients (Table 2). All pleural fluid biomarkers analysed were directly and proportionally intercorrelated, with the exception of CA125 with CEA and CA19.9. The strongest correlations were found for HCY and CEA with CA15.3 (Table 3).

In relation to the precision study of the method used for the determination of HCY in pleural fluid, the repeatability and reproducibility CVs were low (<3%), so this method has a very high precision.

The pleural fluid concentration of HCY was the most accurate biomarker for differentiating MPE and BPE (AUC = 0.846), followed by CA15.3 (AUC = 0.800) and CEA (0.778) (Table 4). In the recent study evaluating the pleural fluid concentration of HCY as a TM, which included 89 patients, the AUC obtained was 0.833 [14], which is similar than that obtained in this study. CEA sensitivity was 51.9%, which was somewhat lower than that published in the meta-analysis by Shi et al, which analysed 45 studies and obtained a sensitivity of 54% and specificity of 94% [18]. With CA15.3, a sensitivity of 53.8% was obtained, also slightly lower than that obtained in the meta-analysis by Wu et al [19], which analysed 21 studies and obtained a sensitivity of 58% and specificity of 91%. The optimal cutoff value of the pleural fluid concentration of CEA to differentiate MPE from BPE was similar to the upper reference limit for serum, whereas the cutoff values of HCY, CA15.3 and CA19.9 were lower than their upper reference limits for serum. Pleural fluid CA125 showed a very high optimal cutoff value (1433 U/mL) to differentiate MPE from BPE because of its high concentration in BPE patients, a result of its secretion by normal mesothelial cells [11].

Because the multivariate analysis with five biomarkers only included the pleural fluid concentrations of HCY and CEA in the probabilistic model, these two biomarkers are sufficient to obtain the maximum diagnostic accuracy for MPE. The odds ratio of HCY was higher than that of CEA. Although CA15.3 had a high diagnostic accuracy (AUC = 0.800), its exclusion from the probabilistic model may be due to its strong correlation with HCY and CEA (Table 3). The diagnostic accuracy obtained with the probabilistic model (AUC = 0.948) was significantly higher than that obtained with each individual biomarker (S2 Table). The combination of HCY and CEA in pleural fluid improved the diagnostic accuracy of the test. The probabilistic model (HCY+CEA) achieved high sensitivity (86.5%) and specificity (97.5%) for differentiating MPE and BPE (Table 4). The study by Porcel et al, which analysed 416 patients with pleural effusion, obtained a sensitivity of 54% through the combination of four TMs (CA15.3, CA19.9, CA125 and CYFRA 21–1) [20]; the work by Gaspar et al, which included 155 patients, achieved a sensitivity of 75% through the combination of three TMs (CEA, CA15.3 and TAG-72) [21]; and the meta-analysis by Yang et al, which analysed combinations of pleural fluid TMs for the diagnosis of MPE in 20 studies, obtained a sensitivity of 64% through the combination of CEA+CA15.3 and of 58% with CEA+CA19.9 [22]. All of these studies achieved a lower sensitivity than we obtained here using the combination of HCY+CEA.

These results show an increase of pleural fluid HCY concentration in patients with MPE. The metabolism of HCY occurs via two pathways, via remethylation to methionine using 5-methyltetrahydrofolate (vitamin B9 or folate) as methyl group donor and cobalamin (vitamin B12) as cofactor or via transsulphuration using pyridoxine (vitamin B6) as cofactor, which leads to the degradation of HCY to cysteine [23]. The deficiency of these vitamins B in serum is associated with hyperhomocysteinemia [24]. The increased of pleural fluid HCY concentration in patients with MPE may be due to elevated cellular consumption of vitamins B6, B9 and B12 caused by the intense metabolism of the tumour cells present in the pleural space. The lack of vitamins B can block the two metabolic pathways of HCY and cause its accumulation in the pleural fluid. Moreover, in some studies, serums TMs were superior to pleural fluid TMs for diagnosis of MPE [25]. Further studies are needed to research the association between vitamins B and HCY in pleural fluid, and to assess the diagnostic value of serum HCY and its pleural fluid/serum ratio in patients with MPE.

Conclusions

Pleural fluid HCY can be considered a TM with high power to differentiate MPE from BPE. Pleural fluid HCY concentration may be measured easily and quickly in automated analyzers and could be a biomarker commonly used for diagnosis of MPE. Pleural fluid HCY has higher accuracy than CEA, CA15.3, CA19.9 and CA125 for diagnosis of MPE. The combination of HCY and CEA in pleural fluid significantly improves the diagnostic accuracy of the test. New studies are needed to confirm these conclusions.

Supporting information

S1 Table [doc]
Descriptive statistics of independent variables (n = 133).

S2 Table [doc]
Comparison of ROC curves.