Medical Image Analysis
Volume 15, Issue 4 , Pages 650-668 , August 2011

Coupled minimum-cost flow cell tracking for high-throughput quantitative analysis

  • Dirk Padfield

      Affiliations

    • GE Global Research, One Research Circle, Niskayuna, NY 12309, United States
    • Rensselaer Polytechnic Institute, 110 8th St., Troy, NY 12180, United States
    • Corresponding Author InformationCorresponding author at: GE Global Research, One Research Circle, Niskayuna, NY 12309, United States. Tel.: +1 518 387 4149; fax: +1 518 387 6981.
    • ,
  • Jens Rittscher

      Affiliations

    • GE Global Research, One Research Circle, Niskayuna, NY 12309, United States
    • ,
  • Badrinath Roysam

      Affiliations

    • Rensselaer Polytechnic Institute, 110 8th St., Troy, NY 12180, United States

References 

  1. Adiga PSU, Chaudhuri BB. An efficient method based on watershed and rule-based merging for segmentation of 3-D histo-pathological images. Pattern Recognition. 2001;34(7):1449–1458
  2. Al-Kofahi O, Radke RJ, Goderie SK, Shen Q, Temple S, Roysam B. Automated cell lineage construction: a rapid method to analyze clonal development established with murine neural progenitor cells. Cell Cycle. 2006;5(3):327–335
  3. Al-Kofahi O, Radke R, Roysam B, Banker G. Automated semantic analysis of changes in image sequences of neurons in culture. IEEE Transactions on Biomedical Engineering. 2006;53(6):1109–1123
  4. Ancin H, Dufresne TE, Ridder GM, Turner JN, Roysam B. An improved watershed algorithm for counting objects in noisy, anisotropic 3-D biological images. In: Proceedings of International Conference on Image Processing. vol. 3:IEE Computer Society; 1995;p. 3172
  5. Arulampalam S, Maskel S, Gordon L, Clapp T. A tutorial on particle filters for on-line non-linear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing. 2002;50(2):174–188
  6. Bar-Shalom Y, Fortmann TE. Tracking and Data Association. Academic Press; 1988;
  7. Blake A, Isard M. Condensation – conditional density propagation for visual tracking. International Journal of Computer Vision. 1998;28(1):5–28
  8. Bonneau S, Dahan M, Cohen LD. Single quantum dot tracking based on perceptual grouping using minimal paths in a spatiotemporal volume. IEEE Transactions on Image Processing. 2005;14(9):1384–1395
  9. Bunyak, F., Palaniappan, K., Nath, S., Baskin, T., Dong, G., 2006. Quantitative cell motility for in vitro wound healing using level set-based active contour tracking. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 1040–1043.
  10. Chan T, Vese L. Active contours without edges. IEEE Transactions on Image Processing. 2001;10(2):266–277
  11. Chen, X., Wong, S., 2005. Automated dynamic cellular analysis in high throughput drug screens. In: IEEE International Symposium on Circuits and Systems, vol. 5, pp. 4229–4232.
  12. Chen X, Zhou X, Wong ST. Automated segmentation, classification, and tracking of cancer cell nuclei in time-lapse microscopy. IEEE Transactions on Biomedical Engineering. 2006;53(4):762–766
  13. Chen Y, Ladi E, Herzmark P, Robey E, Roysam B. Automated 5-D analysis of cell migration and interaction in the thymic cortex from time-lapse sequences of 3-D multi-channel multi-photon images. Journal of Immunological Methods. 2009;340(1):65–80
  14. Comaniciu D, Ramesh V, Meer P. Real-time tracking of non-rigid objects using mean shift. In: Proceedings of IEEE Computer Vision and Pattern Recognition. vol. 2:South Carolina: Hilton Head Island; 2000;p. 142–149
  15. Cormen TH, Leiserson CE, Rivest RL, Stein C. Introduction to Algorithms. second ed.. The MIT Press; 2001;
  16. Debeir O, Van Ham P, Kiss R, Decaestecker C. Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes. IEEE Transactions on Medical Imaging. 2005;24(6):697–711
  17. De Hauwer C, Darro F, Camby I, Kiss R, Van Ham P, Decaesteker C. In vitro motility evaluation of aggregated cancer cells by means of automatic image processing. Cytometry. 1999;36(1):1–10
  18. de Solorzano CO, Malladi R, Lelievre S, Lockett S. Segmentation of cell and nuclei using membrane related proteins. Journal of Microscopy. 2001;201:1–13
  19. Donoho DL. De-noising by soft-thresholding. IEEE Transactions on Information Theory. 1995;41(3):613–627
  20. Donoho D, Johnstone I. Ideal adaptation via wavelet shrinkage. Biometrika. 1994;81:425–455
  21. Dufour A, Shinin V, Tajbakhsh S, Guillen-Aghion N, Olivo-Marin J, Zimmer C. Segmenting and tracking fluorescent cells in dynamic 3-D microscopy with coupled active surfaces. IEEE Transactions on Image Processing. 2005;14(9):1396–1410
  22. Dzyubachyk, O., Niessen, W., Meijering, E., 2007. A variational model for level-set based cell tracking in time-lapse fluorescence microscopy images. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 97–100.
  23. Figueiredo M, Nowak R. Wavelet-based image estimation: an empirical Bayes approach using Jeffreys’ noninformative prior. IEEE Transactions on Image Processing. 2001;10(9):1322–1331
  24. In:  Gelb A editors. Applied Optimal Estimation. MIT Press; 1979;
  25. Genovesio A, Liedl T, Emiliani V, Parak WJ, Coppey-Moisan M, Olivo-Marin J. Multiple particle tracking in 3-D+t microscopy: method and application to the tracking of endocytosed quantum dots. IEEE Transactions on Image Processing. 2006;15(5):1062–1070
  26. Harder, N., Bermúdez, F., Godinez, W., Ellenberg, J., Eils, R., Rohr, K., 2006. Automated analysis of the mitotic phases of human cells in 3D fluorescence microscopy image sequences. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 840–848.
  27. Harder, N., Neumann, B., Held, M., Liebel, U., Erfle, H., Ellenberg, J., Eils, R., Rohr, K., 2006. Automated recognition of mitotic patters in fluorescence microscopy images of human cells. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 1016–1019.
  28. He, W., Wang, X., Metaxas, D., Mathew, R., White, E., 2006. Cell segmentation for division rate estimation in computerized video time-lapse microscopy. In: Proceedings of Microscopic Image Analysis with Applications in Biology Workshop, pp. 55–59.
  29. Isard, M., MacCormick, J., 2001. BraMBLe: a Bayesian multiple-blob tracker. In: Proceedings of International Conference on Computer Vision, vol. 2, pp. 34–41.
  30. Kachouie N, Fieguth P, Ramunas J, Jervis E. Probabilistic model-based cell tracking. International Journal of Biomedical Imaging. 2006;1–10
  31. Kalman R. A new approach to linear filtering and prediction problems. Transactions of the ASME. 1960;82(D):35–45
  32. Kovalev, V., Harder, N., Neumann, B., Held, M., Liebel, U., Erfle, H., Ellenberg, J., Eils, R., Rohr, K., 2006. Feature selection for evaluating fluorescence microscopy images in genome-wide cell screens. In: Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 276–283.
  33. Kuhn H. The hungarian method for the assignment problem. Naval Research Logistics Quarterly. 1955;2:83–97
  34. Ladi E, Schwickert T, Chtanova T, Chen Y, Herzmark P, Yin X, et al. Thymocyte–dendritic cell interactions near sources of ccr7 ligands in the thymic cortex. The Journal of Immunology. 2008;181(10):7014–7023
  35. Lewis JP. Fast normalized cross-correlation. In: Vision Interface. Canadian Image Processing and Pattern Recognition Society; 1995;p. 120–123
  36. Li, K., Miller, E., Weiss, L., Campbell, P., Kanade, T., 2006. Online tracking of migrating and proliferating cells imaged with phase-contrast microscopy. In: Proceedings of IEEE Computer Vision and Pattern Recognition Workshop, pp. 65–72.
  37. Li, K., Chen, M., Kanade, T., 2007. Cell population tracking and lineage construction with spatiotemporal context. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 295–302.
  38. Li K, Miller ED, Chen M, Kanade T, Weiss LE, Campbell PG. Cell population tracking and lineage construction with spatiotemporal context. Medical Image Analysis. 2008;12(5):546–566
  39. Li, K., Miller, E., Chen, M., Kanade, T., Weiss, L., Campbell, P., 2008. Computer vision tracking of stemness. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 847–850.
  40. Lin G, Adiga U, Olson K, Guzowski J, Barnes C, Roysam B. A hybrid 3-D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks. Cytometry Part A. 2003;56A(1):23–36
  41. Lin G, Chawla M, Olson K, Guzowski J, Barnes C, Roysam B. Hierarchical, model-based merging of multiple fragments for improved 3-D segmentation of nuclei. Cytometry Part A. 2004;63A:20–33
  42. MacCormick, J., Blake, A., 1999. A probabilistic exclusion principle for tracking multiple objects. In: Proceedings of International Conference on Computer Vision, vol. 2, pp. 572 – 578.
  43. Mallat S. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1989;11:674–693
  44. Mallat S. A Wavelet Tour of Signal Processing. Academic Press; 1997;
  45. Mortensen, E.N., Barrett, W.A., 1995. Intelligent scissors for image composition. In: SIGGRAPH ’95, pp. 191–198.
  46. Mukherjee D, Ray N, Acton S. Level set analysis for leukocyte detection and tracking. IEEE Transactions on Image Processing. 2004;13(4):562–572
  47. Nath, S., Palaniappan, K., Bunyak, F., 2006. Cell segmentation using coupled level sets and graph-vertex coloring. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 101–108.
  48. Okuma, K., Taleghani, A., de Freitas, N., Little, J., Lowe, D., 2004. A boosted particle filter: multitarget detection and tracking. In: Proceedings of European Conference on Computer Vision, vol. 1, pp. 28–39.
  49. Olivo-Marin, J., 1996. Automatic detection of spots in biological images by a wavelet-based selective filtering technique. In: Proceedings of International Conference on Image Processing, pp. I:311–I:314.
  50. Osher S, Fedkiw R. Level Set Methods and Dynamic Implicit Surfaces. Springer; 2002;
  51. Osher S, Sethian J. Fronts propagating with curvature-dependent speed: algorithms based on Hamilton–Jacobi formulations. Journal of Computational Physics. 1988;79:12–49
  52. Padfield D, Miller J. A label geometry image filter for multiple object measurement. Insight Journal. 2008;1–13
  53. Padfield, D., Rittscher, J., Sebastian, T., Thomas, N., Roysam, B., 2006. Spatio-temporal cell cycle analysis using 3D level set segmentation of unstained nuclei in line scan confocal fluorescence images. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 1036–1039.
  54. Padfield D, Rittscher J, Thomas N, Roysam B. Automated spatio-temporal cell cycle phase analysis based on covert GFP sensors. In: Microscopic Image Analysis for Life Science Applications. Artech Publishing House; 2008;p. 295–316
  55. Padfield, D., Rittscher, J., Roysam, B., 2008. Spatio-temporal cell segmentation and tracking for automated screening. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 376–379.
  56. Padfield, D., Rittscher, J., Roysam, B., 2008. Defocus and low CNR detection for cell tracking applications. In: Proceedings of Microscopic Image Analysis with Applications in Biology Workshop.
  57. Padfield, D., Rittscher, J., Roysam, B., 2009. Coupled minimum-cost flow cell tracking. In: Proceedings of Information Processing in Medical Imaging, pp. 374–385.
  58. Padfield D, Rittscher J, Thomas N, Roysam B. Spatio-temporal cell cycle phase analysis using level sets and fast marching methods. Medical Image Analysis. 2009;13(1):143–155
  59. Porter R, Canagarajah C. A robust automatic clustering scheme for image segmentation using wavelets. IEEE Transactions on Image Processing. 1996;5(4):662–665
  60. Ray N, Acton S. Data acceptance for automated leukocyte tracking through segmentation of spatiotemporal images. IEEE Transactions on Biomedical Engineering. 2005;52(10):1702–1712
  61. Reddy BS, Chatterji BN. An FFT-based technique for translation, rotation, and scale-invariant image registration. IEEE Transactions on Image Processing. 1996;5(8):1266–1271
  62. Reid D. An algorithm for tracking multiple targets. IEEE Transactions on Automatic Control. 1979;24(6):843
  63. Rousson, M., Deriche, R., 2003. A variational framework for active and adaptive segmentation of vector valued images. In: Proceedings of IEEE Workshop on Motion and Video Computing, pp. 56–61.
  64. Rui, Y., Chen, Y., 2001. Better proposal distributions: object tracking using unscented particle filter. In: Proceedings of IEEE Computer Vision and Pattern Recognition, vol. 2, pp. 786–794.
  65. Sarti A, de Solorzano CO, Lockett S, Malladi R. A geometric model for 3D confocal image analysis. IEEE Transactions on Biomedical Engineering. 2000;47:1600–1609
  66. Sbalzarini IF, Koumoutsakos P. Feature point tracking and trajectory analysis for video imaging in cell biology. Journal of Structural Biology. 2005;151(2):182–195
  67. Sethian J. Level Set Methods and Fast Marching Methods. Cambridge University Press; 1996;
  68. Simon D. Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches. John Wiley & Sons; 2006;
  69. Soille P. Morphological Image Analysis. second ed.. Heidelberg: Springer-Verlag; 2003;
  70. Sorenson HW. Least-squares estimation: from Gauss to Kalman. IEEE Spectrum. 1970;7:63–68
  71. van de Merwe, R., Doucet, A., de Freitas, N., Wan, E., 2000. The unscented particle filter, Technical Report CUED-F-INFENG/TR 380, Cambridge University Engineering Department, August 2000.
  72. Vermaak, J., Doucet, A., Perez, P., 2003. Maintaining multi-modality through mixture tracking. In: Proceedings of International Conference on Computer Vision, pp. 1110–1116.
  73. Wahlby C, Sintorn I-M, Erlandsson F, Borgefors G, Bengtsson E. Combining intensity, edge, and shape information for 2d and 3d segmentation of cell nuclei in tissue sections. Journal of Microscopy. 2004;215:67–76
  74. Welch, G., Bishop, G., 2004. An introduction to the Kalman filter, Technical Report, University of North Carolina at Chapel Hill, Department of Computer Science.
  75. Xie, J., Khan, S., Shah, M., 2008. Automatic tracking of escherichia coli bacteria. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 824–832.
  76. Yang, F., Mackey, M., Ianzini, F., Gallardo, G., Sonka, M., 2005. Cell segmentation, tracking, and mitosis detection using temporal context. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 302–309.
  77. Zhang, L., Li, Y., Nevatia, R., 2008. Global data association for multi-object tracking using network flows. In: Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 1–8.
  78. Zhou X, Chen X, Liu K, Lyman S, King R, Wong S. Time-lapse cell cycle quantitative data analysis using Gaussian mixture models. In: Life Science Data Mining. vol. 2:World Scientific; 2006;p. 17–46
  79. Zijdenbos AP, Dawant BM, Margolin RA, Palmer AC. Morphometric analysis of white matter lesions in mr images: method and validation. IEEE Transactions on Medical Imaging. 1994;13(4):716–724

PII: S1361-8415(10)00098-8

doi: 10.1016/j.media.2010.07.006

Medical Image Analysis
Volume 15, Issue 4 , Pages 650-668 , August 2011

Article Tools

* Image Usage & Resolution