+ Site Statistics
+ Search Articles
+ PDF Full Text Service
How our service works
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ Translate
+ Recently Requested

Nasopharyngeal carcinoma segmentation based on enhanced convolutional neural networks using multi-modal metric learning



Nasopharyngeal carcinoma segmentation based on enhanced convolutional neural networks using multi-modal metric learning



Physics in Medicine and Biology 64(2): 025005



Multi-modality examinations have been extensively applied in current clinical cancer management. Leveraging multi-modality medical images can be highly beneficial for automated tumor segmentation as they provide complementary information that could make the segmentation of tumors more accurate. This paper investigates CNN-based methods for automated nasopharyngeal carcinoma (NPC) segmentation using computed tomography (CT) and magnetic resonance (MR) images. Specially, a multi-modality convolutional neural network (M-CNN) is designed to jointly learn a multi-modal similarity metric and segmentation of paired CT-MR images. By jointly optimizing the similarity learning error and the segmentation error, the feature learning processes of both modalities are mutually guided. In doing so, the segmentation sub-networks are able to take advantage of the other modality's information. Considering that each modality possesses certain distinctive characteristics, we combine the higher-layer features extracted by a single-modality CNN (S-CNN) and M-CNN to form a combined CNN (C-CNN) for each modality, which is able to further utilize the complementary information of different modalities and improve the segmentation performance. The proposed M-CNN and C-CNN were evaluated on 90 CT-MR images of NPC patients. Experimental results demonstrate that our methods achieve improved segmentation performance compared to their counterparts without multi-modal information fusion and the existing CNN-based multi-modality segmentation methods.

Please choose payment method:






(PDF emailed within 0-6 h: $19.90)

Accession: 065984148

Download citation: RISBibTeXText

PMID: 30524024

DOI: 10.1088/1361-6560/aaf5da


Related references

Tumor Segmentation in Contrast-Enhanced Magnetic Resonance Imaging for Nasopharyngeal Carcinoma: Deep Learning with Convolutional Neural Network. Biomed Research International 2018: 9128527, 2018

Automated nasopharyngeal carcinoma segmentation in magnetic resonance images by combination of convolutional neural networks and graph cut. Experimental and Therapeutic Medicine 16(3): 2511-2521, 2018

Splenomegaly Segmentation on Multi-Modal MRI Using Deep Convolutional Networks. IEEE Transactions on Medical Imaging 38(5): 1185-1196, 2019

Semi-Supervised Learning for Pelvic Mr Image Segmentation Based on Multi-Task Residual Fully Convolutional Networks. Proceedings. IEEE International Symposium on Biomedical Imaging 2018: 885-888, 2018

Eye Tracking for Deep Learning Segmentation Using Convolutional Neural Networks. Journal of Digital Imaging 32(4): 597-604, 2019

Brain tumor segmentation in multi-spectral MRI using convolutional neural networks (CNN). Microscopy Research and Technique 81(4): 419-427, 2018

A multi-view deep convolutional neural networks for lung nodule segmentation. Conference Proceedings 2017: 1752-1755, 2017

Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning. Smart and Sustainable Manufacturing Systems 2:, 2018

Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images. Journal of Digital Imaging 32(3): 462-470, 2019

Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage 108: 214-224, 2015

Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation. Visual Computer 33(6-8): 1061-1071, 2017

A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks. International Journal of Remote Sensing 37(7): 1671-1691, 2016

Pancreas Segmentation in MRI using Graph-Based Decision Fusion on Convolutional Neural Networks. Medical Image Computing and Computer-Assisted Intervention 9901: 442-450, 2016

Aircraft Type Recognition Based on Segmentation With Deep Convolutional Neural Networks. IEEE Geoscience and Remote Sensing Letters 15(2): 282-286, 2018

Joint Reconstruction and Segmentation of 7T-like MR Images from 3T MRI Based on Cascaded Convolutional Neural Networks. Medical Image Computing and Computer-Assisted Intervention 10433: 764-772, 2017