Research Articles

Download PDF (635.43 KB)

TOMOGRAPHY, December 2016, Volume 2, Issue 4: 374-377
DOI: 10.18383/j.tom.2016.00244

An Approach Toward Automatic Classification of Tumor Histopathology of Non–Small Cell Lung Cancer Based on Radiomic Features

Ravindra Patil1, Geetha Mahadevaiah1, Andre Dekker2

1Philips Research India, Bangalore, India and2Department of Radiation Oncology (MAASTRO), GROW-School for Oncology and Developmental Biology, Maastricht University Medical Centre (MUMC), Maastricht University, Maastricht, The Netherlands


Non–small cell lung cancer contributes toward 85% of all lung cancer burden. Tumor histology (squamous cell carcinoma, large cell carcinoma, and adenocarcinoma and "not otherwise specified") has prognostic significance, and it is therefore imperative to identify tumor histology for personalized medicine; however, biopsies are not always possible and carry significant risk of complications. Here, we have used Radiomics, which provides an exhaustive number of informative features, to aid in diagnosis and therapeutic outcome of tumor characteristics in a noninvasive manner. This study evaluated radiomic features of non–small cell lung cancer to identify tumor histopathology. We included 317 subjects and classified the underlying tumor histopathology into its 4 main subtypes. The performance of the current approach was determined to be 20% more accurate than that of an approach considering only the volumetric- and shape-based features.


Non–small cell lung cancer (NSCLC) accounts for 85% of all the lung cancers, and it is second most common cause of cancer in both men and women. According to the American Cancer Society, estimates for 2016 include an incidence of 224,390 new lung cancer cases in the USA (men, 117 920; women, 106 470) and 158,080 deaths due to lung cancer (men, 85 920; women, 72 160). Every year, more people die because of lung cancer than because of colon, breast, and prostate cancer combined. Further, 2 of 3 people diagnosed with lung cancer are aged ≥65 years, whereas <2% are aged <45 years (1). The different factors that can affect survival include genetic factors, clinical factors such as age and overall health, the size and grade of the tumor, and the histological subtype of NSCLC. With regard to the subtype, many studies have identified a link between the subtype and survival. For example, Ma et al. (2) recently showed that patients with adenocarcinoma have worse prognosis compared with those with nonadenocarcinoma subtypes. Similarly, Yano et al. (3) recently showed that squamous cell carcinoma has worse outcomes compared with other NSCLC subtypes, and concluded that surgical management should be different for different subtypes. Given this knowledge, it is imperative to classify NSCLS based on histology. Currently, biopsy is performed to identify the subtype, involving an invasive procedure and requiring multiple biopsies from the site of interest. Hence, it is painful, costly, and not without risk (4).

In recent years, noninvasive diagnosis and screening of lung cancer have been emphasized upon (5, 6). An advanced technique named “Radiomics” that involves the extraction of large quantitative features, resulting in conversion of images into higher-dimensional mineable data, can be used for building decision support systems. This is in contrast to the traditional practice of treating medical images as pictures used solely for visual interpretation. The output from a Radiomics analysis contains first-, second-, and higher-order statistical data derived from the entire image or a particular region of interest. It can be performed with tomographic images from computed tomography (CT), magnetic resonance imaging, and positron emission tomography studies. Aerts et al.'s seminal work (7) showed that radiomic features have prognostic power when used for patients with lung and head and neck cancer. In addition, several studies on NSCLC exist, for example, Al-Kadi et al., Cook et al., and Ganeshan et al. (810), in which texture analysis is applied to predict lung cancer outcomes on the basis of factors associated with tumor texture. In this study, we have hypothesized that radiomic texture features can noninvasively classify the different NSCLC subtypes.

The aim of this study is to perform a radiomic analysis to identify tumor histopathology in NSCLC and classify into squamous cell carcinoma, adenocarcinoma, large cell carcinoma, and not-otherwise-specified NSCLC. We extracted radiomic features and evaluated their ability to classify tumor histopathology and assessed how these features compare with nonradiomic “normal” features (eg, volume or diameter).


The applied methodology involves image acquisition, segmentation, feature extraction, and model validation to identify the histology of an underlying tumor. Figure 1 summarizes the aforementioned approach. The approach involved characterizing the tumor region by extracting radiomic features, which were earlier considered to be either redundant or inapplicable for clinical outcome. The obtained CT image is segmented to define the tumor region, and in this study, gross tumor volume is used. The segmented region is used to extract features based on tumor intensity, shape, and texture. The extracted features are analyzed to build a decision support system to identify tumor histopathology.

Figure 1.

The Radiomics workflow. Images are taken partly from Aerts HJ et al. (7) with permission.



The data used in this study were obtained from The Cancer Imaging Archive ( from the collection of NSCLC-Radiomics. In all, 317 patients diagnosed with NSCLC were considered, of which, 40 patients were diagnosed with adenocarcinoma, 108 with large cell carcinoma, 110 with squamous cell carcinoma, and 59 with not otherwise specified. The demographic distribution is mentioned in Table 1. The ground truth of the tumor region was provided by a radiation oncologist in the DICOM-RTSTRUCT file; hence, no explicit segmentation algorithm was used for the tumor regions' identification. The data were neither preprocessed nor normalized so as not to devalue any clinical information present in the images.

Table 1.

Distribution of Subject Characteristics

Subject Characteristics Adenocarcinoma Large Cell Carcinoma Squamous Cell Carcinoma Not Otherwise Specified
Number of Subjects 40 108 110 59
Male 20 65 70 41
Female 20 43 40 18
Mean Age (years) 67.2 66.9 70.2 65.6

Feature Extraction

An important sub-step of Radiomics is the high throughput extraction of quantitative image features. In total, 431 imaging features were extracted from the tumor site identified by the manual delineation performed by the radiation oncologist. The feature-extraction algorithm was custom-implemented in Matlab (The MathWorks, Inc., Natick, Massachusetts). The quantitative imaging features were divided into 4 subgroups, namely, (1) first-order statistical features (2) shape- and size-based features, (3) textural features, and (4) multiscale wavelet, which describe tumor phenotypes. The first-order statistical features provide distribution of voxel intensities within the CT image via commonly used and basic metrics (eg, energy, entropy, and kurtosis). The shape- and size-based features provide tumor compactness, volume, and area metrics along with how spherical, rounded, or elongated the tumor is. The first-order statistical features represent only the information related to gray-level distribution and do not provide pertinent information regarding the relative position of various gray-level across images. Then, we computed textural features using gray-level co-occurrence and gray-level run-length texture matrices. All voxel intensities were resampled into equally spaced bins that were 25 Hounsfield units wide. The former step reduces image noise and normalizes the intensities, allowing direct comparison of all calculated textural features between patients. The matrices were determined considering 26 connected voxels in all 13 directions in 3 dimensions. The wavelets feature helps decouple original images into high and low frequencies. In this analysis, we applied one level undecimated 3-dimensional wavelet transform on the gross tumor volume. The original image is decomposed into 8 levels of wavelet decomposition (XLLL, XLLH, XLHL, XLHH, XHLL, XHLH, XHHL, and XHHH), where L and H denote low pass and high pass, respectively. For example, XHLH is interpreted as a high-pass sub-band resulting from directional filtering in x with high pass, along y with low pass, and along z in high pass.


Where NH is the length of filter H and NL is the length of filter L.

For each decomposition obtained above, we computed first-order statistical and textural features as mentioned earlier. The feature vector length for each subject was 431.

The first-order statistical, shape- and size-based, textural features, and wavelet decomposition features account for 14, 8, 33, and 376 features, respectively.


Because data classes were skewed and to eliminate bias in learning due to unequal samples in each class, the SMOTE (Synthetic Minority Over-sampling Technique) algorithm (11) was applied on the data set. Two data models were built in this experiment, the first was the radiomic model that contained all the radiomic features extracted in the above step and the second was the normal model consisting of typical normal features, which were a subset of radiomic features consisting Energy, Entropy, Kurtosis, Maximum, Mean, Mean Absolute Deviation, Median, Minimum, Range, RMS Value, Skewness, Standard Deviation, Uniformity, Variance, Compactness, Maximum 3D diameter, Spherical Disproportion, Sphericity, Surface Area, Surface-to-Volume Ratio, and Volume). Following which, a multicategory support vector machine using R with package (e1071) was used for classifying the data into predefined classes. The results obtained were based on 10-fold cross validation on the data set. The experimental parameters set for the support vector machine were as follows: kernel type, rbf; gamma, 1.0; C, 0.1; epsilon: 10(−4). The aforementioned hyper parameters were selected on the basis of a grid search to yield the best accuracy value. Further, features were ranked on the basis of the built model to identify the most important predictive features that aided in the classification using the caret package in R.


The demographic of the data set included both male (60%) and female (40%) subjects, with their average age being 68 years. The metrics of histological classification obtained by considering radiomic features and those of normal features are shown in the Figure 2. It can be observed from Figure 2 that sensitivity in determining the histology using radiomic features is 87% and that using normal features is 70%. In addition, the specificity and accuracy considering radiomic features are 89% and 88%, respectively; however, those considering normal features are 65% and 67%, respectively. Further, the accuracy in identifying tumor histopathology using radiomic features showed 20% improvement (P < .0001) compared with that using normal features.

Figure 2.

Classification metrics using radiomic and normal features.


In addition, to rank the features based on importance value, feature ranking was used on the radiomic model. The top 40 radiomic features that aid in classification of tumor histopathology are shown in Figure 3. The top features contributing toward histological classification using radiomic features include HLH_Median, HHH_Median, HHL_Information_Measure_of_Correlation, HLL_Skewness, Autocorrelation, Compactness, LHL_Entropy, and LLL_Energy. It is interesting to note that volume as an independent feature does not rank as the top contributor for the classification and was ranked 53rd in the hierarchy. In addition, wavelet-based features dominate as top contributing features for the classification, strengthening the claim that additional features aid in better information extraction. Thus, in the classification of tumor histopathology, Radiomics can quantify phenotypical differences from medical images by using a large set of imaging features and provide more hidden information compared with normal features.

Figure 3.

Radiomic features' ranking based on importance.



In this study, we adapted Radiomics to classify NSCLC, namely, adenocarcinoma, squamous cell carcinoma, large cell carcinoma, and not otherwise specified, by extracting imaging features from annotated tumor region. Limitations of this study include lack of validation of the external data set and the lack of noninvasive liquid biopsies (12), which could, in principle, provide a method to determine histological subtypes. The results of the study show that radiomic features have greater potential than normal features for classifying tumor histopathology. Our approach provides a noninvasive, fast, low-cost and repeatable method of investigating tumor histology, thus accelerating the development of personalized medicine. However, our method directly considered the tumor regions segmented by a radiologist; thus, future efforts should focus on integrating an automated segmentation algorithm in the workflow.


[1] Abbreviations:


Non–small cell lung cancer


computed tomography


    American Cancer Society. Lung Cancer (Non-Small Cell). American Cancer Society Website. 2016.
    Ma LH, Li G, Zhang HW, Wang ZY, Dang J, Zhang S, Yao L. The effect of non-small cell lung cancer histology on survival as measured by the graded prognostic assessment in patients with brain metastases treated by hypofractionated stereotactic radiotherapy. Radiat Oncol. 2016;11:92.
    Yano M, Yoshida J, Koike T, Kameyama K, Shimamoto A, Nishio W, Yoshimoto K, Utsumi T, Shiina T, Watanabe A, Yamato Y, Watanabe T, Takahashi Y, Sonobe M, Kuroda H, Oda M, Inoue M, Tanahashi M, Adachi H, Saito M, Hayashi M, Otsuka H, Mizobuchi T, Moriya Y, Takahashi M, Nishikawa S, Matsumura Y, Moriyama S, Fujii Y. The outcomes of a limited resection for non-small cell lung cancer based on differences in pathology. World J Surg. 2016. [Epub ahead of print]. doi: 10.1007/s00268-016-3596-9.
    Wu CC, Maher MM, Shepard JA. Complications of CT-guided percutaneous needle biopsy of the chest: prevention and management. AJR Am J Roentgenol. 2011;196(6):W678–W682.
    Bajtarevic A, Ager C, Pienz M, Klieber M, Schwarz K, Ligor M, Ligor T, Filipiak W, Denz H, Fiegl M, Hilbe W, Weiss W, Lukas P, Jamnig H, Hackl M, Haidenberger A, Buszewski B, Miekisch W, Schubert J, Amann A. Noninvasive detection of lung cancer by analysis of exhaled breath. BMC Cancer. 2009;9:348.
    D'Urso V, Doneddu V, Marchesi I, Collodoro A, Pirina P, Giordano A, Bagella L. Sputum analysis: non-invasive early lung cancer detection. J Cell Physiol. 2013;228(5):945–951.
    Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F, Rietbergen MM, Leemans CR, Dekker A, Quackenbush J, Gillies RJ, Lambin P. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006.
    Al-Kadi OS, Watson D. Texture analysis of aggressive and nonaggressive lung tumor CE CT images. IEEE Trans Biomed Eng. 2008;55(7):1822–1830.
    Cook GJ, Yip C, Siddique M, Goh V, Chicklore S, Roy A, Marsden P, Ahmad S, Landau D. Are pretreatment 18F-FDG PET tumor textural features in non-small cell lung cancer associated with response and survival after chemoradiotherapy? J Nucl Med. 2013;54(1):19–26.
    Ganeshan B, Goh V, Mandeville HC, Ng QS, Hoskin PJ, Miles KA. Non-small cell lung cancer: histopathologic correlates for texture parameters at CT. Radiology. 2013;266(1):326–336.
    Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: Synthetic Minority Over-sampling Technique. J Artif Intell Res. 2002;16:321–357.
    Brock G, Castellanos-Rizaldos E, Hu L, Coticchia C, Skog J. Liquid biopsy for cancer screening, patient stratification and monitoring. Transl Cancer Res. 2015;4(3):280–290.


Download the article PDF (635.43 KB)

Download the full issue PDF (200.5 MB)

Mobile-ready Flipbook

View the full issue as a flipbook (Desktop and Mobile-ready)