Elsevier

Medical Image Analysis

Volume 15, Issue 2, April 2011, Pages 214-225
Medical Image Analysis

A magnetic resonance spectroscopy driven initialization scheme for active shape model based prostate segmentation

https://doi.org/10.1016/j.media.2010.09.002Get rights and content

Abstract

Segmentation of the prostate boundary on clinical images is useful in a large number of applications including calculation of prostate volume pre- and post-treatment, to detect extra-capsular spread, and for creating patient-specific anatomical models. Manual segmentation of the prostate boundary is, however, time consuming and subject to inter- and intra-reader variability. T2-weighted (T2-w) magnetic resonance (MR) structural imaging (MRI) and MR spectroscopy (MRS) have recently emerged as promising modalities for detection of prostate cancer in vivo. MRS data consists of spectral signals measuring relative metabolic concentrations, and the metavoxels near the prostate have distinct spectral signals from metavoxels outside the prostate. Active Shape Models (ASM’s) have become very popular segmentation methods for biomedical imagery. However, ASMs require careful initialization and are extremely sensitive to model initialization. The primary contribution of this paper is a scheme to automatically initialize an ASM for prostate segmentation on endorectal in vivo multi-protocol MRI via automated identification of MR spectra that lie within the prostate. A replicated clustering scheme is employed to distinguish prostatic from extra-prostatic MR spectra in the midgland. The spatial locations of the prostate spectra so identified are used as the initial ROI for a 2D ASM. The midgland initializations are used to define a ROI that is then scaled in 3D to cover the base and apex of the prostate. A multi-feature ASM employing statistical texture features is then used to drive the edge detection instead of just image intensity information alone. Quantitative comparison with another recent ASM initialization method by Cosio showed that our scheme resulted in a superior average segmentation performance on a total of 388 2D MRI sections obtained from 32 3D endorectal in vivo patient studies. Initialization of a 2D ASM via our MRS-based clustering scheme resulted in an average overlap accuracy (true positive ratio) of 0.60, while the scheme of Cosio yielded a corresponding average accuracy of 0.56 over 388 2D MR image sections. During an ASM segmentation, using no initialization resulted in an overlap of 0.53, using the Cosio based methodology resulted in an overlap of 0.60, and using the MRS-based methodology resulted in an overlap of 0.67, with a paired Student’s t-test indicating statistical significance to a high degree for all results. We also show that the final ASM segmentation result is highly correlated (as high as0.90) to the initialization scheme.

Graphical abstract

The metavoxels acquired in the magnetic resonance spectroscopy (MRS) of prostate imagery are intelligently clustered (red green and blue on the left). These clusters are pruned (red on the right) and used as an initialization for an Active Shape Model (green on the right).

  1. Download : Download high-res image (113KB)
  2. Download : Download full-size image

Research highlights

► Magnetic resonance spectroscopy (MRS) MR prostate imagery clustered. ► MRS clusters initialize an active shape model (ASM) prostate segmentation scheme. ► MRS yields more accurate initialization than state of the art initialization methods.

Introduction

Prostatic adenocarcinoma (CaP) is the second leading cause of cancer related deaths among men in the United States, with an estimated 186,000 new cases in 2008 (Source: American Cancer Society). The current standard for detection of CaP is transrectal ultrasound (TRUS) guided symmetrical needle biopsy, which has a high false negative rate associated with it (Catalona, 1991). Recently, multi-modal Magnetic Resonance (MR) Imaging (MRI) comprising both structural T2-weighted (T2-w) MRI (Madabhushi et al., 2005, Zhu et al., 2003) and MR Spectroscopy (MRS) (Kurhanewicz et al., 1996, Kurhanewicz et al., 2002, Kumar et al., 2008, Vilanova and Barcelo, 2007, Hom et al., 2006, Tiwari et al., 2009, Zaider et al., 2000, Kim et al., 2003, Coakley et al., 2003) have emerged as promising modalities for early detection of CaP (Kumar et al., 2008, Vilanova and Barcelo, 2007). MRS measures the relative concentrations of different biochemicals and metabolites in the prostate, and changes in relative concentrations of choline, creatine, and citrate are highly indicative of the presence of CaP. It is important to note that MRS acquisition has a lower resolution than MRI acquisition, and thus each MRS metavoxel (containing a spectral signal) is approximately 13 times the size of an MRI voxel (containing a single intensity value).

An example of a MR spectra signature associated with a T2-w MRI image is show in Fig. 1. The spectra corresponding to three metavoxels within the prostate are shown in red, and three spectra corresponding to metavoxels outside the prostate are shown in cyan. The average spectra of the extra-prostatic metavoxels is shown in Fig. 1h as a blue line, and the average spectra of the prostatic metavoxels is shown as a red line. It can be seen that the prostatic MRS spectra are greatly different from the extra-prostatic MRS spectra. Finally, in Fig. 1i a scatter plot of the MRS spectra for a given slice is shown, in which the prostatic spectra are indicated by red dots and the extra-prostatic spectra are indicated by blue dots. To visualize the 256-dimensional spectra in three dimensions, principal component analysis was used. This scatter plot shows an example of how the prostatic and extra-prostatic spectra are distinct.

As of 2009, there are approximately 16 ongoing clinical trials in the US aiming to demonstrate the role of MR in a diagnostic, clinical setting.1 Recent literature suggests that the integration of MRI and MRS could potentially improve sensitivity and specificity for CaP detection (Hom et al., 2006). In fact, when combined with MRI, using MRS data could yield prostate cancer detection specificity and sensitivity values as high as 90% and 88% respectively (Testa et al., 2007). Recently, computer-aided diagnosis (CAD) schemes have emerged for automated CaP detection from prostate T2-w MRI (Madabhushi et al., 2005, Chan et al., 2003) and MRS (Tiwari et al., 2007, Tiwari et al., 2008, Tiwari et al., 2009). In Tiwari et al. (2009), we showed that spectral clustering of the MRS data could be used to distinguish between prostatic and extra-prostatic voxels with accuracies as high as 98%. This paper improves upon the methodology presented in Tiwari et al. (2009) to drive a segmentation scheme for the prostate capsule on T2-w MRI.

With the recent advancements of prostate MR imaging, several prostate segmentation schemes have been developed (Zhu et al., 2003, Chiu et al., 2004, Costa et al., 2007, Ladak et al., 2000, Hu et al., 2003, Pathak et al., 2000, Gong et al., 2004, Cosio, 2008, Gao et al., 2010). Segmentation of the prostate is useful for a number of tasks, including calculating the prostate volume pre- and post-treatment (Hoffelt et al., 2003, Kaminski et al., 2002), for creating patient specific anatomical models (Nathan et al., 1996), and for planning surgeries by helping to determine just how far outside the capsule they might need to go in order to capture any possible extra-capsular spread of the tumor. Additionally, identifying the prostate capsule is clinically significant for determining whether extra-capsular spread of CaP has occurred. Manual segmentation of the prostate, however, is not only laborious, but is also subject to a high degree of inter-, and intra-observer variability (Warfield et al., 2002, Warfield et al., 2004). The aim of this work is to automatically identify the spectra within the prostate in order to initialize a multi-feature active shape model (ASM) for precise segmentation of the prostate capsule.

Section snippets

Previous work and motivation

Previous work on automatic or semi-automatic prostate segmentation has been primarily for transrectal ultrasound (TRUS) images (Chiu et al., 2004, Ladak et al., 2000, Hu et al., 2003, Pathak et al., 2000, Gong et al., 2004, Cosio, 2008). Ladak et al., 2000, Hu et al., 2003 presented semi-automated schemes in which several points on the prostate contour are manually selected to initialize a deformable model for prostate segmentation. Manual intervention is then used to guide the segmentation.

Notation

We define a spectral scene C^=(C^,F^) where C^ is a 2D grid of metavoxels. Note that a metavoxel is a voxel at the lower spectral resolution. For each spatial location cˆC^, there is an associated 256-dimensional valued spectral vector F^(cˆ)=fˆj(cˆ)|j{1,,256}, where fˆj(cˆ) represents the concentration of different biochemicals (such as creatine, citrate, and choline). We define the associated T2-w MR intensity image scene C=(C,f), where C represents a set of spatial locations (voxels), f(c

Clustering of spectra (calculation of SMRS)

The crux of the methodology is to determine a set of prostate voxels (SMRS) based on a clustering of the spectroscopic data. This algorithm is described in the form of a sequence of steps below.

  • 1.

    For a given 2D MRS slice C^=(C^,F^), we first obtain the MR spectraF^(cˆ)=fˆ(cˆ)|j{1,,256}.

  • 2.

    The metavoxels cˆC^, are aggregated into k clusters VaC^,a{1,,k}, by applying k-means clustering to all F^(cˆ),cˆC^. k-means clustering aims to minimize the sum of distances to the clusters’ centroids, for

Basic shape model

Following model initialization XΔ0, an ASM search (Cootes et al., 1995) is performed to segment the prostate from a new image. An ASM is defined by the equationX=X¯+P·b,where X¯ represents the mean shape, P is a matrix of the first few principal components (Eigenvectors) of the shape, created using Principal Component Analysis (PCA), and b is a vector defining the shape, which can range from between −3 and +3 standard deviations from the mean shape. Therefore, X is defined by the variable b.

Performance measures

For each image, a single expert radiologist segmented the prostate region, yielding ground truth landmarks XE. For a given shape X, the set of pixels contained within the shape is denoted as SX. We employ the performance measures shown in Table 2.

Performance measures 1–4 are area based performance measures, in which a higher value indicates a more accurate segmentation, while performance measures 5 and 6 are edge based performance measures which evaluate proximity of the ASM extracted boundary

Comparison of clustering algorithms (E1-E3)

Fig. 5 shows some qualitative results from E1-E3 for a midgland slice, which was used to calculate SMRS. In all the images, the red cluster indicates the largest cluster which is removed, so that S^MRS corresponds to all metavoxels that are not red. While all the clustering methodologies found a set of metavoxels within the prostate, it is obvious that only the replicated k-means clustering algorithm was able to properly identify most of the prostate metavoxels. The superior performance of

Concluding remarks

In this paper, we have presented a fully automated and accurate ASM initialization scheme for prostate segmentation from multi-protocol in vivo MRI/MRS data. With the increasing use of MR imaging of the prostate, several institutions are beginning to acquire multi-modal MR prostate data, including MR spectroscopy (Kurhanewicz et al., 1996, Kumar et al., 2008, Vilanova and Barcelo, 2007, Hom et al., 2006, Tiwari et al., 2009). The primary novel contribution of our work is in leveraging

Acknowledgments

This work was made possible via grants from the Wallace H. Coulter Foundation, New Jersey Commission on Cancer Research, National Cancer Institute (Grant Nos. R01CA136535-01, ARRA-NCl-3 R21CA127186, R21CA127186, R03CA128081-01, R01CA140772-01A1, and R03CA143991-01), the Cancer Institute of New Jersey, and the Life Science Commercialization Award from Rutgers University. The authors would like to thank Fernando Cosio in his assistance implementing his initialization methodology. Finally, the

References (63)

  • Barqawi, A.B., Lu, L., Crawford, E.D., Fenster, A., Werahera, P.N., Kumar, D., Miller, S., Suri, J.S., 2007. Three...
  • M. Brejl et al.

    Object localization and border detection criteria design in edge-based image segmentation: automated learning from examples

    IEE Transactions on Medical Imaging

    (2000)
  • W. Catalona

    Measurement of prostate-specific antigen in serum as a screening test for prostate cancer

    New England Journal of Medicine

    (1991)
  • I. Chan et al.

    Detection of prostate cancer by integration of line-scan diffusion, T2-mapping and T2-weighted magnetic resonance imaging; a multichannel statistical classifier

    Medical Physics

    (2003)
  • T. Chen et al.

    Object-constrained meshless deformable algorithm for high speed 3d nonrigid registration between CT and CBCT

    Medical Physics

    (2010)
  • B. Chiu et al.

    Prostate segmentation algorithm using dyadic wavelet transform and discrete dynamic contour

    Physics of Medical Biology

    (2004)
  • D. Comaniciu et al.

    Mean shift: A robust approach toward feature space analysis

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (2002)
  • Cootes, T.F., Taylor, C.J., 1994. Using grey-level models to improve active shape model search. 1994. In: Conference A:...
  • Cootes, T.F., Taylor, C.J., 2004. Statistical models of appearance for computer...
  • Cootes, T.F., Hill, A., Taylor, C.J., Haslam, J.. 1993. The use of active shape models for locating structures in...
  • T.F. Cootes et al.

    Multi-resolution search with active shape models

    Computer Vision and Image Processing

    (1994)
  • Costa, J., Delingette, H., Novellas, S., Ayache, N., 2007. Automatic segmentation of bladder and prostate using coupled...
  • M. de Bruijne et al.
    (2003)
  • Duda, R.O., Hart, P.E., Stork, D.G., 2001. Pattern Classification, second ed....
  • Flores-Tapia, D., Thomas, G., Venugopal, N., McCurdy, B., Pistorius, S., 2008. Semi automatic MRI prostate segmentation...
  • Y. Gao et al.

    A coupled global registration and segmentation framework with application to magnetic resonance prostate imagery

    IEEE Transactions on Medical Imaging

    (2010)
  • L. Gong et al.

    Parametric shape modeling using deformable superellipses for prostate segmentation

    IEE Transactions on Medical Imaging

    (2004)
  • T. Hastie et al.

    The Elements of Statistical Learning

    (2009)
  • J.J. Hom et al.

    High-grade prostatic intraepithelial neoplasia in patients with prostate cancer: MR and MR spectroscopic imaging features – initial experience

    Radiology

    (2006)
  • Ning Hu et al.

    Prostate boundary segmentation from 3D ultrasound images

    Medical Physics

    (2003)
  • H. Kim et al.

    In vivo prostate magnetic resonance imaging and magnetic resonance spectroscopy at 3 Tesla using a transceive pelvic phased array coil: preliminary results

    Investigative Radiology

    (2003)
  • Cited by (42)

    • Hierarchical prostate MRI segmentation via level set clustering with shape prior

      2017, Neurocomputing
      Citation Excerpt :

      In [39], Stefan et al. formulated an automatic prostate segmentation method in 3D MR images via atlas matching with localized mutual information. A magnetic resonance spectroscopy driven initialization scheme was exhibited by Robert et al. for active shape model based prostate segmentation [40]. Also, a multi-feature landmark-free active appearance model was proposed by Robert [41].

    • A review of segmentation and deformable registration methods applied to adaptive cervical cancer radiation therapy treatment planning

      2015, Artificial Intelligence in Medicine
      Citation Excerpt :

      In recent years hybrid methods that combine registration based methods with prior shape information of the CTV, bladder and rectum have been adopted for cervix segmentation [25,26]. Prior shape information obtained from segmented organs are often used to build a shape model for medical image segmentation and analysis for a wide variety of structures [14,32–36]. An extensive review of shape models applied to medical image segmentation and registration may be found in this article [37].

    • Group sparse reconstruction for image segmentation

      2014, Neurocomputing
      Citation Excerpt :

      For all the 52 images, prostate is manually outlined by the clinical expert as the ground truth. The average surface distance (ASD) [31] and the dice similarity coefficient (DSC) are used as the quantitative measures. The two measures define the distance and the similarity between the automatic segmentation and the ground truth, respectively.

    • Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge

      2014, Medical Image Analysis
      Citation Excerpt :

      The average metric scores for the second observer are presented in Tables 6 and 7. Comparing these metric scores to scores reported in literature for inter-observer variability we can see that they are at approximately at the same level (Pasquier et al., 2007; Costa et al., 2007; Klein et al., 2008; Makni et al., 2009; Toth et al., 2011b; Chandra et al., 2012; Gao et al., 2012b). The main reason to use this approach is that it allows us to incorporate completely different, but equally important metrics like average boundary distance and the Dice coefficient.

    View all citing articles on Scopus
    View full text