Medical Image Analysis
Volume 15, Issue 4 , Pages 622-639 , August 2011

DRAMMS: Deformable registration via attribute matching and mutual-saliency weighting

  • Yangming Ou

      Affiliations

    • Section of Biomedical Image Analysis (SBIA), University of Pennsylvania, 3600 Market St., Ste 380, Philadelphia, PA 19104, USA
    • Corresponding Author InformationCorresponding author. Tel.: +1 215 662 7358; fax: +1 215 614 0266.
    • ,
  • Aristeidis Sotiras

      Affiliations

    • MAS Laboratory, Ecole Centrale de Paris, Grande Voie des Vignes, 92 295 Chatenay-Malabry, France
    • Equipe GALEN, INRIA Saclay – Ile-de-France, Orsay 91893, France
    • ,
  • Nikos Paragios

      Affiliations

    • MAS Laboratory, Ecole Centrale de Paris, Grande Voie des Vignes, 92 295 Chatenay-Malabry, France
    • Equipe GALEN, INRIA Saclay – Ile-de-France, Orsay 91893, France
    • ,
  • Christos Davatzikos

      Affiliations

    • Section of Biomedical Image Analysis (SBIA), University of Pennsylvania, 3600 Market St., Ste 380, Philadelphia, PA 19104, USA

References 

  1. Anandan P. A computational framework and an algorithm for the measurement of visual motion. International Journal of Computer Vision. 1989;2:283–310
  2. Ashburner J. A fast diffeomorphic image registration algorithm. NeuroImage. 2007;38(1):95–113
  3. Bai W, Brady M. Regularized b-spline deformable registration for respiratory motion correction in PET images. Physics in Medicine and Biology. 2009;54(9):2719–2736
  4. Bond S, Brady J. Non-rigid registration for colorectal cancer MR images. Computer Vision for Biomedical Image Applications (CVBIA). 2005;399–408
  5. Bookstein FL. Principal warps: thin-plate splines and the decomposition of deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1989;11(6):567–585
  6. Chen, X., Brady, M., Lo, J.L.-C., Moore, N., 2005. Simultaneous segmentation and registration of contrast-enhanced breast mri. In: Information Processing in Medical Imaging (IPMI), pp. 126–137.
  7. Choi Y, Lee Y. Injectivity conditions of 2d and 3d uniform cubic b-spline functions. Graphical Models. 2000;62(6):411–427
  8. Christensen GE, Rabbitt RD, Miller MI. 3D brain mapping using a deformable neuroanatomy. Physics in Medicine and Biology. 1994;39(3):609–618
  9. Chui H, Rangarajan A. A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding. 2003;89:114–141
  10. Collins DL, Neelin P, Peters TM, Evans AC. Automatic 3d intersubject registration of MR volumetric data in standardized talairach space. Journal of Computer Assisted Tomography. 1994;18(2):192–205
  11. Crum WR, Hartkens T, Hill DL. Non-rigid image registration: theory and practice. The British Journal of Radiology. 2004;77(2):140–153
  12. Csapo I, Holland C, Guttmann C. Image registration framework for large-scale longitudinal MRI data sets: strategy and validation. Magnetic Resonance Imaging. 2007;25(6):889–893
  13. D’Agostino E, Maes F, Vandermeulen D, Suetens P. A viscous fluid model for multimodal non-rigid image registration using mutual information. Medical Image Analysis. 2003;7(4):565–575
  14. Dauguet J, Delzescaux T, Conde F, Mangin J, Ayache N, Hantraye P, et al. Three-dimensional reconstruction of stained histological slices and 3d non-linear registration with in-vivo mri for whole baboon brain. Journal of Neuroscience Methods. 2007;164:191–204
  15. Davatzikos C, Prince J, Bryan R. Image registration based on boundary mapping. IEEE Transactions on Medical Imaging. 1996;15(1):112–115
  16. Duncan, J., Owen, R., Staib, L., Anandan, P., 1991. Measurement of non-rigid motion using contour shape descriptors. In: Computer Vision and Pattern Recognition (CVPR), pp. 318–324.
  17. Elbakary M, Sundareshan M. Accurate representation of local frequency using a computationally efficient gabor filter fusion approach with application to image registration. Pattern Recognition Letters. 2005;26(14):2164–2173
  18. Ellingsen L, Prince J. Mjolnir: extending HAMMER using a diffusion transformation model and histogramequalization for deformable image registration. International Journal of Biomedical Imaging. 2009;2009:(Article ID 281615, 18 pp.)
  19. Fan Y, Shen D, Gur RC, Gur RE, Davatzikos C. COMPARE: lassification of morphological patterns using adaptive regional elements. IEEE Transactions on Medical Imaging. 2007;26(1):93–105
  20. Foroughi, P., Abolmaesumi, P., 2005. Elastic registration of 3d ultrasound images. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 83–90.
  21. Friston KJ, Ashburner J, Frith CD, Poline J-B, Heather JD, Frackowiak RSJ. Spatial registration and normalization of images. Human Brain Mapping. 1995;3(3):165–189
  22. Gee JC, Reivich M, Bajcsy R. Elastically deforming 3d atlas to match anatomical brain images. Journal of Computer Assisted Tomography. 1993;17(2):225–236
  23. Gee, J., Barillot, C., Le Briquer, L., Haynor, D., Bajcsy, R., 1994. Matching structural images of the human brain using statistical and geometrical image features. In: Proceedings of SPIE, Visualization in Biomedical Computing, pp. 191–204.
  24. Geng X, Christensen GE, Gu H, Ross TJ, Yang Y. Implicit reference-based group-wise image registration and its application to structural and functional mri. NeuroImage. 2009;47(4):1341–1351
  25. Gering DT, Nabavi A, Kikinis R, Hata N, O’Donnell LJ, Grimson WE, et al. An integrated visualization system for surgical planning and guidance using image fusion and an open mr. Journal of Magnetic Resonance Imaging. 2001;13(6):967–975
  26. Glocker B, Komodakis N, Tziritas G, Navab N, Paragios N. Dense image registration through MRFs and efficient linear programming. Medical Image Analysis. 2008;12(6):731–741
  27. Good C, Johnsrude I, Ashburner J, Henson R, Friston K, Frackowiak R. A voxel-based morphometric study of ageing in 465 normal adult human brains. NeuroImage. 2004;14(1):21–36
  28. Guyon I, Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research. 2003;3:1157–1182
  29. Haralick RM. Statistical and structural approaches to texture. Proceedings of the IEEE. 1979;67(5):786–804
  30. Hata, N., Dohi, T., Warfield, S., Wells, W., Kikinis, R., Jolesz, F., 1998. Multimodality deformable registration of pre- and intraoperative images for MRI-guided brain surgery. In: International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), pp. 1067–1074.
  31. Hill DL, Batchelor PG, Holden M, Hawkes DJ. Medical image registration. Physics in Medicine and Biology. 2001;46(3):1–45
  32. Holden M. A review of geometric transformations for nonrigid body registration. IEEE Transactions on Medical Imaging. 2008;27(1):111–128
  33. Huang, X., Sun, Y., Metaxas, D., Sauer, F., Xu, C., 2004. Hybrid image registration based on configural matching of scale-invariant salient region features. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’04), vol. 1.
  34. Jain AK, Farrokhnia F. Unsupervised texture segmentation using gabor filters. Pattern Recognition. 1991;24(12):1167–1186
  35. Jian, B., Vemuri, B., Marroquin, J., 2005. Robust nonrigid multimodal image registration using local frequency maps. In: Information Processing in Medical Imaging (IPMI), pp. 504–515.
  36. Joshi SC, Miller MI. Landmark matching via large deformation diffeomorphisms. IEEE Transactions on Image Processing. 2000;9(8):1357–1370
  37. Joshi S, Davis B, Jomier M, Gerig G. Unbiased diffeomorphic atlas construction for computational anatomy. NeuroImage. 2004;23(1):151–160
  38. Kadir T, Brady M. Saliency, scale and image description. International Journal of Computer Vision. 2001;V45(2):83–105
  39. Kamarainen, J., 2003. Feature extraction using gabor filters. Ph.D. thesis, Lappeenranta University of Technology, Finland.
  40. Komodakis N, Tziritas G, Paragios N. Performance vs computational efficiency for optimizing single and dynamic mrfs: setting the state of the art with primal-dual strategies. Computer Vision and Image Understanding. 2008;112(1):14–29
  41. Kybic J, Unser M. Fast parametric elastic image registration. IEEE Transactions on Image Processing. 2003;12(11):1427–1442
  42. Lawes I, Barrick T, Murugam V, Spierings N, Evans D, Song M, et al. Atlas-based segmentation of white matter tracts of the human brain using diffusion tensor tractography and comparison with classical dissection. NeuroImage. 2008;39(1):62–79
  43. Lazebnik S, Schmid C, Ponce J. A sparse texture representation using local affine regions. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005;27(8):1265–1278
  44. Leow A, Yanovsky I, Chiang M, Lee A, Klunder A, Lu A, et al. Statistical properties of jacobian maps and the realization of unbiased large-deformation nonlinear image registration. IEEE Transactions on Medical Imaging. 2007;26(6):822–832
  45. Lester H, Arridge S. A survey of hierarchical non-linear medical image registration. Pattern Recognition. 1999;32(1):129–149
  46. Liao, S., Chung, A., 2009. Non-rigid image registration with uniform spherical structure patterns. In: Information Processing in Medical Imaging (IPMI), pp. 163–175.
  47. Li G, Guo L, Liu T. Deformation invariant attribute vector for deformable registration of longitudinal brain MR images. Computerized Medical Imaging and Graphics. 2009;33(5):273–297
  48. Ling, H., Jacobs, D., 2005. Deformation invariant image matching. In: The Tenth International Conference in Computer Vision (ICCV), Beijing, China.
  49. Liu J, Vemuri BC, Marroquin JL. Local frequency representations for robust multimodal image registration. IEEE Transactions on Medical Imaging. 2002;21(5):462–469
  50. Liu T, Shen D, Davatzikos C. Deformable registration of cortical structures via hybrid volumetric and surface warping. NeuroImage. 2004;22(4):1790–1801
  51. Lopes R, Betrouni N. Fractal and multifractal analysis: a review. Medical Image Analysis. 2009;13(4):634–649
  52. Luan H, Qi F, Xue Z, Chen L, Shen D. Multimodality image registration by maximization of quantitativecqualitative measure of mutual information. Pattern Recognition. 2008;41(1):285–298
  53. Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P. Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging. 1997;16(2):187–198
  54. Mahapatra, D., Sun, Y., 2008. Registration of dynamic renal MR images using neurobiological model of saliency. In: IEEE International Symposium on Biomedical Imaging (ISBI), pp. 1119–1122.
  55. Maintz JBA, Viergever MA. A survey of medical image registration. Medical Image Analysis. 1998;2(1):1–36
  56. Manjunath BS, Ma W. Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1996;18(8):837–842
  57. McAuliffe, M., Lalonde, F., McGarry, D., Gandler, W., Csaky, K., Trus, B., 2001. Medical image processing, analysis and visualization in clinical research. In: Proceedings of the 14th IEEE Computer-Based Medical Systems, pp. 381–386.
  58. McEachen J, Duncan JS. Shape-based tracking of left ventricular wall motion. IEEE Transactions on Medical Imaging. 1997;16(3):270–283
  59. Meyer C, Boes J, Kim B, Bland P, Zasadny K, Kison P, et al. Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations. Medical Image Analysis. 1997;1(3):195–206
  60. Meyer C, Moffat B, Kuszpit K, Bland P, Mckeever P, Johnson T, et al. A methodology for registration of a histological slide and in vivo MRI volume based on optimizing mutual information. Molecular Imaging. 2006;5(1):16–23
  61. Munoz-Moreno E, Cardenes-Almeida R, Martin-Fernandez M. Review of techniques for registration of diffusion tensor imaging. Tensors in Image Processing and Computer Vision. 2009;273–297
  62. Muratore D, Russ J, Dawant B, Galloway RJ. Three-dimensional image registration of phantom vertebrae for image-guided surgery: a preliminary study. Comuter Aided Surgey. 2003;7(6):342–352
  63. Ou Y, Davatzikos C. DRAMMS: deformable registration via attribute matching and mutual-saliency weighting. 2009;50–62
  64. Ou Y, Shen D, Feldman M, Tomaszewski J, Davatzikos C. Non-rigid registration between histological and MR images of the prostate: a joint segmentation and registration framework. 2009;125–132
  65. Ou Y, Shen D, Zeng J, Sun L, Moul J, Davatzikos C. Sampling the spatial patterns of cancer: optimized biopsy procedures for estimating prostate cancer volume and gleason score. Medical Image Analysis. 2009;13(4):609–620
  66. Periaswamy S, Farid H. Medical image registration with partial data. Medical Image Analysis. 2006;10(3):452–464
  67. Pitiot A, Bardinet E, Thompson P, Malandain G. Piecewise affine registration of biological images for volume reconstruction. Medical Image Analysis. 2006;10(3):465–483
  68. Pluim JPW, Maintz JBA, Viergever MA. Mutual-information-based registration of medical images: a survey. IEEE Transactions on Medical Imaging. 2003;22(8):986–1004
  69. Pohl KM, Fisher J, Grimson E, Kininis R, Wells WM. A bayesian model for joint segmentation and registration. NeuroImage. 2006;31:228–239
  70. Prastawa M, Gilmore JH, Lin W, Gerig G. Automatic segmentation of MR images of the developing newborn brain. Medical Image Analysis. 2005;9(5):457–466
  71. Rohr K, Stiehl HS, Sprengel R, Buzug TM, Weese J, Kuhn MH. Landmark-based elastic registration using approximating thin-plate splines. IEEE Transactions on Medical Imaging. 2001;20(6):526–534
  72. Rueckert D, Sonoda LI, Hayes C, Hill DL, Leach MO, Hawkes DJ. Nonrigid registration using free-form deformations: application to breast MR images. IEEE Transactions on Medical Imaging. 1999;18(8):712–721
  73. Rueckert, D., Aljabar, P., Heckemann, R.A., Hajnal, J.V., Hammers, A., 2006. Diffeomorphic registration using b-splines. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 702–709.
  74. Shen D. Image registration by local histogram matching. Pattern Recognition. 2007;40(4):1161–1172
  75. Shen D, Davatzikos C. HAMMER: hierarchical attribute matching mechanism for elastic registration. IEEE Transactions on Medical Imaging. 2003;21(11):1421–1439
  76. Shen D, Davatzikos C. Measuring temporal morphological changes robustly in brain mr images via 4-dimensional template warping. NeuroImage. 2004;21(4):1508–1517
  77. Shen D, Herskovits E, Davatzikos C. An adaptive-focus statistical shape model for segmentation and shape modeling of 3-d brain structures. IEEE Transactions on Medical Imaging. 2001;20(4):257–270
  78. Shi P, Sinusas AJ, Constable RT, Ritman E, Duncan JS. Point-tracked quantitative analysis of left ventricular surface motion from 3-d image sequences. IEEE Transactions on Medical Imaging. 2000;19(1):36–50
  79. Sotiras, A., Komodakis, N., Glocker, B., Paragios, N., 2009. Graphical models and deformable diffeomorphic population registration using global and local metrics. In: International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI).
  80. Sundar H, Litt H, Shen D. Estimating myocardial motion by 4d image warping. Pattern Recognition. 2009;42(11):2514–2526
  81. Thirion J-P. Image matching as a diffusion process: an analogy with maxwell’s demons. Medical Image Analysis. 1998;2(3):243–260
  82. Thompson PM, Apostolova LG. Computational anatomical methods as applied to ageing and dementia. The British Journal of Radiology. 2007;80:78–91
  83. Thompson P, Toga AW. A surface-based technique for warping three-dimensional images of the brain. IEEE Transactions on Medical Imaging. 1996;15(4):402–417
  84. Vercauteren, T., Pennec, X., Perchant, A., Ayache, N., 2007. Non-parametric diffeomorphic image registration with the demons algorithm. In: International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), vol. 4792, pp. 319–326.
  85. Vercauteren T, Pennec X, Perchant A, Ayache N. Diffeomorphic demons: efficient non-parametric image registration. NeuroImage. 2009;45(1):S61–S72
  86. Verma, R., Davatzikos, C., 2004. Matching of diffusion tensor images using gabor features. In: IEEE International Symposium on Biomedical Imaging (ISBI), pp. 396–399.
  87. Verma R, Zacharaki E, Ou Y, Cai H, Chawla S, Lee S, et al. Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of mr images. Acadmic Radiology. 2008;15(8):966–977
  88. Wang F, Vemuri BC, Eisenschenk SJ. Joint registration and segmentation from brain mri. Academic Radiology. 2006;13(9):1101–1111
  89. Wells W, Viola P, Atsumi H, Nakajima S, Kikinis R. Multi-modal volume registration by maximization of mutual information. Medical Image Analysis. 1996;1(1):35–51
  90. Wu G, Qi F, Shen D. Learning-based deformable registration of MR brain images. IEEE Transactions on Medical Imaging. 2006;25(9):1145–1157
  91. Wu, G., Qi, F., Shen, D., 2007. Learning best features and deformation statistics for hierarchical registration of MR brain images. In: Information Processing in Medical Imaging (IPMI), pp. 160–171.
  92. Wyatt P, Nobel J. Map mrf joint segmentation and registration of medical images. Medical Image Analysis. 2003;7:539–552
  93. Xing, Y., Xue, Z., Englander, S., Schnall, M., Shen, D., 2008. Improving parenchyma segmentation by simultaneous estimation of tissue property t1 map and group-wise registration of inversion recovery mr breast images. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 342–350.
  94. Xue Z, Shen D, Davatzikos C. Determining correspondence in 3-d MR brain images using attribute vectors as morphological signatures of voxels. IEEE Transactions on Medical Imaging. 2004;23(10):1276–1291
  95. Xue Z, Shen D, Davatzikos C. CLASSIC: consistent longitudinal alignment and segmentation for serial image computing. NeuroImage. 2006;30(2):388–399
  96. Xue, Z., Wong, K., S., W., 2008. Joint registration and segmentation of serial lung ct images in microendoscopy molecular image- guided therapy. In: Medical Imaging and Augmented Reality, pp. 12–20.
  97. Xue, Z., Long, L., Antani, S., Jeronimo, J., Thoma, G., 2009. Segmentation of mosaicism in cervicographic images using support vector machines. In: Proceedings of the SPIE Medical Imaging.
  98. Yang, J., Blum, R.S., Williams, J., Sun, Y., Xu, C., 2006. Non-rigid image registration using geometric features and local salient region features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 825–832.
  99. Yang, J., Shen, D., Davatzikos, C., 2008. Diffusion tensor image registration using tensor geometry and orientation features. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 905–913.
  100. Yap P, Wu G, Zhu H, Lin W, Shen D. TIMER: tensor image morphing for elastic registration. NeuroImage. 2009;47:549–563
  101. Yezzi, A., Zollei, L., Kapur, T., 2001. A variational framework for joint segmentation and registration. In: Mathematical Methods in Biomedical Image Analysis (MMBIA).
  102. Zacharaki E, Shen D, Lee S, Davatzikos C. Orbit: a multiresolution framework for deformable registration of brain tumor images. IEEE Transactions on Medical Imaging. 2008;27(8):1003–1017
  103. Zhan Y, Shen D. Deformable segmentation of 3d ultrasound prostate images using statistical texture matching method. IEEE Transactions on Medical Imaging. 2006;25:256–272
  104. Zhan Y, Ou Y, Feldman M, Tomaszeweski J, Davatzikos C. Registering histologic and MR images of prostate for image-based cancer detection. Academic Radiology. 2007;14(11):1367–1381
  105. Zhang, J., Liu, Y., 2004. Cervical cancer detection using SVM based feature screening. In: Medical Image Computing and Computer Assisted Intervention (MICCAI), pp. 873–880.
  106. Zitova B, Flusser J. Image registration methods: a survey. Image and Vision Computing. 2003;21(11):977–1000
  107. Zollei, L., Learned-Miller, E., Grimson, E., Wells, W.I., 2005. Efficient population registration of 3d data. In: ICCV Workshop: Computer Vision for Biomedical Image Applications (CVBIA), pp. 291–301.
  108. Zuo C, Jiang A, Buff B, Mahon T, Wong T. Automatic motion correction for breast MR imaging. Radiology. 1996;198:903–906

PII: S1361-8415(10)00094-0

doi: 10.1016/j.media.2010.07.002

Medical Image Analysis
Volume 15, Issue 4 , Pages 622-639 , August 2011

Article Tools

* Image Usage & Resolution