DeepMTS: Deep Multi-Task Survival model for joint survival prediction and tumor segmentation

In this study, we propose a 3D end-to-end Deep Multi-Task Survival model (DeepMTS) for joint survival prediction and tumor segmentation. Our novelty is the introduction of a hard-sharing segmentation backbone to guide the extraction of local features related to the primary tumors, which reduces the interference from non-relevant background information. In addition, we also introduce a cascaded survival network to capture the prognostic information existing out of primary tumors and further leverage the global tumor information (e.g., tumor size, shape, and locations) derived from the segmentation backbone. Our experiments demonstrate that our DeepMTS can consistently outperform traditional radiomics-based survival models and existing deep survival models.
For more details, please refer to our paper. [IEEE] [arXiv]

Overview

Publication

If this repository helps your work, please kindly cite our papers:

• Mingyuan Meng, Bingxin Gu, Lei Bi, Shaoli Song, David Dagan Feng, Jinman Kim, "DeepMTS: Deep Multi-task Learning for Survival Prediction in Patients with Advanced Nasopharyngeal Carcinoma using Pretreatment PET/CT," IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 9, pp. 4497-4507, 2022, doi: 10.1109/JBHI.2022.3181791. [IEEE] [arXiv]
• Mingyuan Meng, Lei Bi, Dagan Feng, Jinman Kim, "Radiomics-enhanced Deep Multi-task Learning for Outcome Prediction in Head and Neck Cancer," Head and Neck Tumor Segmentation and Outcome Prediction (HECKTOR 2022), pp. 135-143, 2022, doi: 10.1007/978-3-031-27420-6_14. [Springer] [arXiv]
  (Ranked 2nd in HECKTOR2022 challenge, with only 0.00068 lower in C-index)