SiSSR: Simultaneous subdivision surface registration for the quantification of cardiac function from computed tomography in canines
Graphical abstract
Introduction
Regional cardiac dysfunction commonly precedes changes in global metrics such as ejection fraction (EF), and is useful in the characterization of subtle impairment and monitoring of treatment response (Tee et al., 2013). Techniques developed for cardiac magnetic resonance imaging (CMR), including harmonic phase (HARP) imaging (Osman et al., 1999), strain encoded (SENC) imaging (Osman et al., 2001), and displacement encoding with stimulated echos (DENSE) imaging (Aletras et al., 1999), have enabled the measurement of biomarkers for regional cardiac function, including strain, strain rate, and torsion. However, due to their complex and time-consuming acquisition and analysis, further complicated by contraindication of CMR in patients with pacemakers, these techniques have been confined to research studies in academic centers.
Echocardiographic techniques for measuring function are widely deployed in the clinic due to low cost and real-time, bedside acquisitions. However, in terms of cardiac function, echocardiography is subject to certain limitations. Tissue Doppler echocardiography (TDI) is used to measure cardiac motion, but is highly angle-dependent. Speckle-tracking, which has been developed both for 2-D and 3-D sequences, currently provides measurements which are less sensitive to probe angle than Doppler techniques (Tee et al., 2013). Transthoracic echocardiography (TTE) is non-invasive, but unfortunately is limited by the available acoustic window. Transesophageal echocardiography (TEE) avoids these issues, but is an uncomfortable, semi-invasive procedure. All echocardiographic techniques are limited by operator dependence, and 2-D techniques are additionally subject to through-plane motion errors.
Historically, cardiac computed tomography (CCT) has been clinically infeasible for functional studies due to high radiation dose and low temporal resolution (Suinesiaputra et al., 2016). However, recent advances in CCT have dramatically reduced the necessary radiation dose (<2 mSv) and increased the temporal resolution (<50 ms) for whole-heart functional studies (Tee et al., 2015), spurring interest in the use of CCT in assessing cardiac function. Moreover, CCT is an attractive modality for functional studies given its high spatial resolution (on the order of 0.25 mm), inherently volumetric data, fast scan times (single heart beat), ubiquity in clinic, and increasing inclusion in cardiac imaging protocols due to the depiction of coronary anatomy (Tee et al., 2013). Therefore, fast, automated, and robust algorithms for extracting regional functional information from CCT are of immediate interest.
Initial efforts to recover strain from CCT have largely focused on application of tools originally developed for 2-D ultrasound (Ogawa et al., 2006) to resliced CCT sequences (Helle-Valle, Yu, Fernandes, Rosen, Lima, 2010, Tee, Noble, Bluemke, 2013). This approach is limited, as it relies on myocardial features which are largely absent from CCT and discards useful volumetric information. An alternative metric and approach has been proposed by Pourmorteza et al. (2012), who employed the coherent point drift (CPD) method (Myronenko, Song, Carreira-Perpinan, 2007, Myronenko, Song, 2010) to register a template mesh representing the left ventricular (LV) endocardium at end diastole to each subsequent frame. In CPD, the “moving” point set is represented as a Gaussian Mixture Model (GMM). Using Expectation Maximization (EM), the GMM is deformed so as to maximize the probability of the “fixed” point set having been sampled from it. “Coherent” motion is enforced by constraining the motion of the GMM centroids relative to one another. CPD can be used for non-rigid registration, and does not prescribe any specific transformation model. Having performed the registration, Pourmorteza et al. (2012) calculated for each face the square root of the ratio between the face’s area and the area of the corresponding face at end diastole. This metric, which they termed Stretch QUantifier for Endocardial Engraved Zones (SQUEEZ), may be interpreted as a surrogate for cardiac contraction (<1) or expansion ( > 1) in the circumferential-longitudinal plane. SQUEEZ is well suited to volumetric CCT data, and was subsequently shown to correlate with strain obtained by tagged CMR (Pourmorteza et al., 2015); to have clinical utility in the planning of cardiac resynchronization therapy (Behar et al., 2017); and to be robust to noise in low-dose CCT (Pourmorteza et al., 2018). After detailing the technical contributions of our proposed method, we calculate SQUEEZ and compare our results to those obtained from the CPD method.
The objective of our method is conceptually similar to Pourmorteza et al. (2012) in that we derive SQUEEZ from a series of registered meshes. However, rather than registering meshes using CPD, we adapt and extend a method which has been successfully used for cardiac modeling and segmentation in the context of 3-D echocardiography (Stebbing, 2014, Stebbing, Namburete, Upton, Leeson, Noble, 2015). In Stebbing (2014), a subdivision surface is registered to an arbitrary point set obtained using an off-the-shelf edge detector. A notable advantage of this method is that the subdivision surfaces are registered across all frames simultaneously, contrasting with the conceptually simpler “frame-to-frame” and “reference-frame” formulations. In the frame-to-frame formulation, consecutive pairs of frames are registered, leading to propagation of error throughout the cardiac cycle. In the reference-frame formulation, each frame is registered to the end diastolic frame, resulting in independent motion estimates. While this may be desirable in some scenarios, it may also lead to discontinuities in the displacements measured between successive frames (as the transformation estimated by a registration algorithm is not in general a smooth function of its inputs). By formulating the problem as a single, global optimization, the method constructed by Stebbing (2014) avoids both drawbacks.
In this paper, we present the Simultaneous Subdivision Surface Registration (SiSSR) method, which extends the state-of-the-art method for Loop subdivision surface registration developed by Stebbing (2014) in order to register an anatomical reference mesh representing the endocardium of the LV to a 3-D+time cardiac image sequence (Fig. 1). The most notable differences between SiSSR and its predecessor are:
- •
An anatomical reference mesh is constructed directly from the (segmented) image data, obviating the need for a bespoke template mesh representing the structure of interest, and accounting for the wide anatomical variability between canines.
- •
Two notable changes are made to the cost function. First, the velocity, rather than acceleration, of the (coarse) mesh vertices are regularized, more plausibly modeling real cardiac motion. Second, (coarse) mesh faces with high aspect ratios are penalized, thereby explicitly discouraging solutions with low mesh quality.
- •
Subdivision surfaces naturally lend themselves to a multiscale approach, which may decrease computation time while directing the optimization away from local minima. Therefore, we perform an initial registration, explicitly subdivide the result, and use the subdivided result to initialize a second pass.
- •
Stebbing (2014) evaluates the method primarily as a segmentation algorithm, and stops short of calculating functional parameters. We calculate SQUEEZ, and compare our results with the CPD approach.
- •
The subdivision method was originally developed in the context of 3-D echocardiography. Here, we instead investigate 3-D+time CCT, which has received relatively less attention and which we feel will become increasingly common clinically in the near future.
The structure of this paper is as follows. In Section 2 we present our methodology in detail, specifically highlighting points of difference between our and prior methods. In Section 3, we provide technical details pertaining to the implementation. In Section 4, we describe the canine infarct model, imaging parameters, and validation against the CPD method. In Section 5, we present qualitative and quantitative results. In Section 6 we offer a discussion of our findings, its limitations, and future directions. In Section 7, we provide a summary of the paper.
Unless otherwise noted or obvious from context, images and meshes are denoted by uppercase script letters (e.g., ); matrices by uppercase, boldface letters (e.g., X); tuples and vectors by lowercase boldface letters (e.g., t); real and integer scalars by lowercase, unweighted letters (e.g., r); and constants by uppercase, unweighted letters (e.g., F).
Section snippets
Methods
SiSSR takes as its input a sequence of contrast-enhanced CCT volumes, and produces as its output a sequence of registered mesh models, from which functional parameters may be calculated. Broadly, the pipeline involves selecting boundary candidates, corresponding to the endocardium of the LV (Section 2.1), generating a single anatomical reference mesh, from the boundary candidate data at end diastole (Section 2.2), registering to the boundary candidates across all frames
Implementation details
Evaluation of Loop subdivision surfaces at arbitrary parameter values was implemented according to Stam (1998) in the C++ programming language. The core classes have been packaged as an external module for the Insight Toolkit (ITK) library (Johnson et al., 2016). Visualization and user interaction was implemented using the Visualization Toolkit (VTK) library (Schroeder et al., 2006). Levenberg–Marquardt least squares optimization was performed using the Ceres Solver (Agarwal and Mierle, 2010),
Experiments
We applied our algorithm to CCT images obtained from a canine infarct model, and compared our results to those obtained for the CPD algorithm. The details of the animal model, imaging parameters, and validation are as follows.
Parameter selection
In order to determine optimal hyperparameters, the weight αcf associated with the primary cost function Ecf was initialized to unity, and a sequential parameter sweep was performed for the remaining residuals across three orders of magnitude (0.01, 0.1, 1.0, and 10.0). For each run, segmentation accuracy and mesh quality were assessed for all frames and canines (Fig. 6). Jaccard Index (the ratio between the intersection and union of the ground truth and predicted segmentations, where 0.0
Discussion
In this article, we have described an end-to-end pipeline for quantifying cardiac function from a 3-D+time CCT image sequence. Our method, which we term Simultaneous Subdivision Surface Registration (SiSSR), inherits a number of desirable features from the prior state-of-the-art method (Stebbing, 2014) that we have adapted and extended. Loop subdivision surfaces are useful structures for modeling cardiac anatomy. First, they allow smooth, detailed structures to be represented implicitly with a
Summary
In this study, we have presented the Simultaneous Subdivision Surface Registration (SiSSR) algorithm, a pipeline for the quantification of SQUEEZ (a regional metric of cardiac function) from 3-D+time contrast-enhanced cardiac computed tomography sequences. The primary technical contributions of our technique are in the extension and adaptation of a prior technique developed in the context of 3-D echocardiography to cardiac computed tomography. An anatomical reference mesh (stored as a Loop
Acknowledgments
This work was funded by the National Institutes of Health Intramural Research Program and the NIH-Oxford Scholars Program. The first author would additionally like to thank Richard Stebbing, DPhil, Christopher Bridge, DPhil, and Ana Namburete, DPhil for their invaluable input and encouragement throughout this work.
References (33)
- et al.
What shape are dolphins? building 3D morphable models from 2D images
IEEE Trans. Pattern Anal. Mach. Intell.
(2013) - et al.
Point set registration: coherent point drift
IEEE Trans. Pattern Anal. Mach. Intell.
(2010) - et al.
Imaging longitudinal cardiac strain on short-Axis images using strain-Encoded MRI
Magn. Reson. Med.
(2001) - et al.
Regional infarction identification from cardiac CT images: a computer-aided biomechanical approach
Int. J. Comput. Assist. Radiol. Surg.
(2016) - et al.
Multiatlas whole heart segmentation of CT data using conditional entropy for atlas ranking and selection
Med. Phys.
(2015) - Agarwal, S., Mierle, K., 2010....
- et al.
DENSE: Displacement encoding with stimulated echoes in cardiac functional MRI
J. Magn. Reson.
(1999) - et al.
Comprehensive use of cardiac computed tomography to guide left ventricular lead placement in cardiac resynchronization therapy
Heart Rhythm
(2017) - et al.
Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: A Statement for healthcare professionals from the cardiac imaging committee of the council on clinical cardiology of the american heart association
Circulation
(2002) - et al.
Automatic model-based segmentation of the heart in CT images
IEEE Trans. Med. Imag.
(2008)
Surface simplification using quadric error metrics
SIGGRAPH
Usefulness of radial strain mapping by multidetector computer tomography to quantify regional myocardial function in patients with healed myocardial infarction.
Am. J. Cardiol.
The ITK Software Guide: Book 1
Surface shape and curvature scales
Image Vis. Comput.
Marching cubes: a high resolution 3D surface construction algorithm
ACM SIGGRAPH Comput. Graph.
An algorithm for least-Squares estimation of nonlinear parameters
J. Soc. Ind. Appl. Math.
Cited by (6)
Estimation of coronary artery movement using a non-rigid registration with global-local structure preservation
2022, Computers in Biology and MedicineCitation Excerpt :In this way, the local myocardial function was evaluated according to the motion of these vertices. Davis et al. [22] proposed a simultaneous subdivision surface registration (SSSR) algorithm to estimate the function of the left ventricle. In Ref. [23], the multilabel SSSR method was introduced to calculate the deformation of the left heart.
Automatic estimation of aortic and mitral valve displacements in dynamic CTA with 4D graph-cuts
2020, Medical Image AnalysisCitation Excerpt :Moreover, high sensitivity to initialization and subjective landmarks annotations in training may reduce the performance of automatic methods (Ecabert et al., 2008; Peters et al., 2010; Zheng et al., 2008). More recently, a semiautomated method based on the registration of a template mesh has been proposed for canine studies (Vigneault et al., 2018). Because of the arduous task of manual segmentation of cardiac valves, especially when complex models are involved, several works have been proposed to achieve this goal automatically despite its inherent difficulty.
Review of Subdivision Schemes and their Applications
2022, Recent Patents on EngineeringM-SiSSR: Regional Endocardial Function Using Multilabel Simultaneous Subdivision Surface Registration
2021, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)An improved algorithm based on √3 subdivision for micro surface modeling
2019, International Journal of Advanced Manufacturing Technology