Medical Image Analysis
Volume 14, Issue 6 , Pages 770-783 , December 2010

Detection of neuron membranes in electron microscopy images using a serial neural network architecture

  • Elizabeth Jurrus

      Affiliations

    • Scientific Computing and Imaging Institute, Salt Lake City, UT, United States
    • School of Computing, University of Utah, 50 S. Central Campus Drive, Room 3190, Salt Lake City, UT 84112, United States
    • Corresponding Author InformationCorresponding author at: Scientific Computing and Imaging Institute, 72 South Central Campus Drive, Room 3750, Salt Lake City, UT 84112, United States.
  • ,
  • Antonio R.C. Paiva

      Affiliations

    • Scientific Computing and Imaging Institute, Salt Lake City, UT, United States
  • ,
  • Shigeki Watanabe

      Affiliations

    • Department of Biology, University of Utah, 257 South 1400 East, Salt Lake City, UT 84112, United States
  • ,
  • James R. Anderson

      Affiliations

    • Moran Eye Center, University of Utah School of Medicine, 65 Medical Drive, S3881 Moran, Salt Lake City, UT 84132, United States
  • ,
  • Bryan W. Jones

      Affiliations

    • Moran Eye Center, University of Utah School of Medicine, 65 Medical Drive, S3881 Moran, Salt Lake City, UT 84132, United States
  • ,
  • Ross T. Whitaker

      Affiliations

    • Scientific Computing and Imaging Institute, Salt Lake City, UT, United States
    • School of Computing, University of Utah, 50 S. Central Campus Drive, Room 3190, Salt Lake City, UT 84112, United States
  • ,
  • Erik M. Jorgensen

      Affiliations

    • Department of Biology, University of Utah, 257 South 1400 East, Salt Lake City, UT 84112, United States
  • ,
  • Robert E. Marc

      Affiliations

    • Moran Eye Center, University of Utah School of Medicine, 65 Medical Drive, S3881 Moran, Salt Lake City, UT 84132, United States
  • ,
  • Tolga Tasdizen

      Affiliations

    • Scientific Computing and Imaging Institute, Salt Lake City, UT, United States
    • Department of Electrical and Computer Engineering, University of Utah, 50 S. Central Campus Dr., Rm. 3280 MEB Salt Lake City, UT 84112-9206, United States

Received 23 June 2009 ,Revised 15 April 2010 ,Accepted 3 June 2010.

References 

  1. Anderson J, Jones B, Yang J-H, Shaw M, Watt C, Koshevoy P, et al. A computational framework for ultrastructural mapping of neural circuitry. PLoS Biol. 2009;7(3):e74
  2. Andres B, Köthe U, Helmstaedter M, Denk W, Hamprecht FA. Segmentation of SBFSEM volume data of neural tissue by hierarchical classification. In:  Rigoll G editors. Pattern Recognition. LNCS. vol. 5096:Springer; 2008;pp. 142–152. doi:10.1007/978-3-540-69321-5_15. ISBN: 978-3-540-69320-8
  3. Awate, S.P., Whitaker, R.T., 2006. Unsupervised, information-theoretic, adaptive image filtering for image restoration. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28 (3), pp. 364–376.
  4. Awate, S.P., Tasdizen, T., Whitaker, R.T., 2006. Unsupervised texture segmentation with nonparametric neighborhood statistics. In: Proceedings of the European Conference on Computer Vision, pp. 494–507.
  5. Borenstein, E., Sharon, E., Ullman, S., 2004. Combining top-down and bottom-up segmentation. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW’04), vol. 4. IEEE Computer Society, Washington, DC, USA, p. 46. ISBN: 0-7695-2158-4.
  6. Briggman KL, Denk W. Towards neural circuit reconstruction with volume electron microscopy techniques. Curr. Opin. Neurobiol. 2006;16(5):562–570doi:10.1016/j.conb.2006.08.010. <http://dx.doi.org/10.1016/j.conb.2006.08.010>
  7. Briggman KL, Denk W. Towards neural circuit reconstruction with volume electron microscopy techniques. Curr. Opin. Neurobiol. 2006;16(5):562–570
  8. Buades, A., Coll, B., Morel, J.-M., 2005. A non-local algorithm for image denoising. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 60–65.
  9. Cottrell GW. Extracting features from faces using compression networks. In:  Touretzky DS,  Elman JL,  Sejnowski TJ,  Hinton GE editor. Proceedings of the 1990 Connectionist Models Summer School. San Mateo: Morgan Kaufman; 1990;p. 328–337
  10. Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control, Signals, Syst. 1989;2(4):303–314
  11. DeBello WM, Feldman DE, Knudsen EI. Adaptive axonal remodeling in the midbrain auditory space map. J. Neurosci. 2001;21(9):3161–3174<http://www.jneurosci.org/cgi/content/abstract/21/9/3161>
  12. Dollar, P., Tu, Z., Belongie, S., 2006. Supervised learning of edges and object boundaries. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE Computer Society, Los Alamitos, CA, USA, pp. 1964–1971. doi:10.1109/CVPR.2006.298. ISSN: 1063-6919.
  13. Fiala JC, Harris KM. Extending unbiased stereology of brain ultrastructure to three-dimensional volumes. J. Am. Med. Inform. Assoc. 2001;8(1):1–16
  14. Fowlkes, C., Belongie, S., Chung, F., Malik, J., 2004. Spectral grouping using the Nyström method. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, pp. 214–225.
  15. Freund, Y., Schapire, R.E., 1995. A decision-theoretic generalization of on-line learning and an application to boosting. In: EuroCOLT ’95: Proceedings of the Second European Conference on Computational Learning Theory. Springer-Verlag, London, UK, pp. 23–37. ISBN: 3-540-59119-2.
  16. Haykin S. Neural Networks – A Comprehensive Foundation. second ed.. Prentice-Hall; 1999;
  17. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks. 1991;4(2):251–257doi:10.1016/0893-6080(91)90009-T
  18. Jain, V., Murray, J., Roth, F., Turaga, S., Zhigulin, V., Briggman, K., Helmstaedter, M., Denk, W., Seung, H., 2007. Supervised learning of image restoration with convolutional networks. In: IEEE 11th International Conference on Computer Vision, pp. 1–8.
  19. Jin Y, Hoskins R, Horvitz HR. Control of type-D GABAergic neuron differentiation by C. elegans UNC-30 homeodomain protein. Nature. 1994;372(6508):780–783
  20. Jones BW, Marc RE. Retinal remodeling during retinal degeneration. Exp. Eye Res. 2005;81:123–137
  21. Jones BW, Watt CB, Frederick JM, Baehr W, Chen CK, Levine EM, et al. Retinal remodeling triggered by photoreceptor degenerations. J. Comp. Neurol. 2003;464:1–16
  22. Jones BW, Watt CB, Marc RE. Retinal remodelling. Clin. Exp. Optom. 2005;88:282–291
  23. Jurrus, E., Whitaker, R., Jones, B., Marc, R., Tasdizen, T., 2008. An optimal-path approach for neural circuit reconstruction. In: Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 1609–1612.
  24. Jurrus E, Hardy M, Tasdizen T, Fletcher P, Koshevoy P, Chien C-B, et al. Axon tracking in serial block-face scanning electron microscopy. Med. Image Anal. 2009;13(1):180–188
  25. Koyama R, Yamada MK, Fujisawa S, Katoh-Semba R, Matsuki N, Ikegaya Y. Brain-derived neurotrophic factor induces hyperexcitable reentrant circuits in the dentate gyrus. J. Neurosci. 2004;24:7215–7224
  26. Leung T, Malik J. Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vis. 2001;43(1):29–44doi:10.1023/A:1011126920638. ISSN: 0920-5691
  27. Macke J, Maack N, Gupta R, Denk W, Schölkopf B, Borst A. Contour-propagation algorithms for semi-automated reconstruction of neural processes. J. Neurosci. Methods. 2008;167:349–357
  28. Mahamud, S., Williams, L., Thornber, K., Xu, K., 2003. Segmentation of multiple salient closed contours from real images. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25 (4), pp. 433–444. doi:10.1109/TPAMI.2003.1190570. ISSN: 0162-8828
  29. Marc RE, Jones BW, Watt CB, Strettoi E. Neural remodeling in retinal degeneration. Prog. Retinal Eye Res. 2003;22:607–655
  30. Marc RE, Jones BW, Anderson JR, Kinard K, Marshak DW, Wilson JH, et al. Neural reprogramming in retinal degeneration. Invest. Ophthalmol. Vis. Sci. 2007;48:3364–3371
  31. Marc RE, Jones BW, Watt CB, Vazquez-Chona F, Vaughan DK, Organisciak DT. Extreme retinal remodeling triggered by light damage: implications for age related macular degeneration. Mol. Vis. 2008;14:782–806
  32. Mishchenko, Y., 2009. Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs. J. Neurosci. Methods.
  33. Venkataraju, K.U., Paiva, A., Jurrus, E., Tasdizen, T., 2009. Automatic markup of neural cell membranes using boosted decision stumps. In: Proceedings of the 6th IEEE International Symposium on Biomedical Imaging, pp. 1039–1042.
  34. Paiva, A.R., Jurrus, E., Tasdizen, T., 2010. Using sequential context for image analysis. In: Proceedings of the International Conference on Pattern Recognition.
  35. Peng YW, Hao Y, Petters RM, Wong F. Ectopic synaptogenesis in the mammalian retina caused by rod photoreceptor-specific mutations. Nat. Neurosci. 2000;3:1121–1127
  36. Pizer, S., Johnston, R., Ericksen, J., Yankaskas, B., Muller, K., 1990. Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, pp. 337–345. doi:10.1109/VBC.1990.109340.
  37. Pollard H, Khrestchatisky M, Moreau J, Ben-Ari Y, Represa A. Correlation between reactive sprouting and microtubule protein expression in epileptic hippocampus. Neuroscience. 1994;61:773–787
  38. Pomerleau D. Knowledge-based training of artificial neural networks for autonomous robot driving. In:  Connell J,  Mahadevan S editor. Robot Learning. Kluwer Academic Publishing; 1993;p. 19–43
  39. Principe JC, Euliano NR, Lefebvre WC. Neural and Adaptive Systems: Fundamentals Through Simulations. John Wiley & Sons; 2000;
  40. Rabi G, Lu S. Visual speech recognition by recurrent neural networks. J. Electron. Imag. 1998;7(1):61–69
  41. Ren, X., Malik, J., 2002. A probabilistic multi-scale model for contour completion based on image statistics. In: ECCV ’02: Proceedings of the 7th European Conference on Computer Vision, Part I. Springer-Verlag, London, UK, pp. 312–327. ISBN: 3-540-43745-2.
  42. Ren, X., Fowlkes, C., Malik, J., 2005. Scale-invariant contour completion using conditional random fields. In: Tenth IEEE International Conference on Computer Vision 2005, ICCV 2005, vol. 2, pp. 1214–1221. doi:10.1109/ICCV.2005.213. ISSN: 1550-5499.
  43. Schmid, C., 2001. Constructing models for content-based image retrieval. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2, pp. II–39–II–45. doi:10.1109/CVPR.2001.990922. ISSN: 1063-6919.
  44. Shashua, A., Ullman, S. 1988. Structural saliency: the detection of globally salient structures using a locally connected network. In: Second International Conference on Computer Vision, pp. 321–327.
  45. Shotton, J., Blake, A., Cipolla, R., 2008. Multiscale categorical object recognition using contour fragments. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30 (7), pp. 1270–1281. doi:10.1109/TPAMI.2007.70772. ISSN: 0162-8828.
  46. Sorra KE, Harris KM. Overview on the structure, composition, function, development, and plasticity of hippocampal dendritic spines. Hippocampus. 2000;10:501–511
  47. Sporns O, Tononi G, Ktter R. The human connectome: a structural description of the human brain. PLoS Comput. Biol. 2005;1:e42
  48. Sutula T. Seizure-induced axonal sprouting: assessing connections between injury, local circuits, and epileptogenesis. Epilepsy. Curr. 2002;2:86–91
  49. Tang, C.-K., Medioni, G., 2002. Curvature-augmented tensor voting for shape inference from noisy 3D data. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24 (6), pp. 858–864. doi:10.1109/TPAMI.2002.1008395. ISSN: 0162-8828
  50. Tasdizen, T., 2008. Principal components for non-local means image denoising. In: Proceeding of International Conference on Image Processing.
  51. Tasdizen, T., Whitaker, R., Marc, R., Jones, B., 2005. Enhancement of cell boundaries in transmission electron microscopy images. In: ICIP, pp. 642–645.
  52. Tu Z. Auto-context and its application to high-level vision tasks. IEEE Conf. Comput. Vis. Patt. Recognit. 2008;1–8
  53. Varma, M., Zisserman, A., 2003. Texture classification: are filter banks necessary? In: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-691-8. doi:10.1109/CVPR.2003.1211534. ISSN: 1063-6919.
  54. Vazquez, L., Sapiro, G., Randall, G., 1998. Segmenting neurons in electronic microscopy via geometric tracing. In: Proceedings of ICIP, pp. 814–818.
  55. Vu, N., Manjunath, B., 2008. Graph cut segmentation of neuronal structures from transmission electron micrographs. In: 15th IEEE International Conference on Image Processing 2008, ICIP 2008, pp. 725–728. doi:10.1109/ICIP.2008.4711857. ISSN: 1522-4880.
  56. Wells G, Venaille C, Torras C. Promising research: vision-based robot positioning using neural networks. Image Vis. Comput. 1996;14(10):715–732
  57. White J, Southgate E, Thomson J, Brenner F. The structure of the nervous system of the nematode Caenorhabditis elegans. Phil. Trans. Roy. Soc. Lond. Ser. B Biol. Sci. 1986;314:1–340
  58. White JQ, Nicholas T, Gritton J, Truong L, Davidson ER, Jorgensen EM. The sensory circuitry for sexual attraction in C. elegans males. Curr. Biol. 2007;17(21):1847–1857
  59. Zhu, Q., Song, G., Shi, J., 2007. Untangling cycles for contour grouping. In: IEEE 11th International Conference on Computer Vision 2007, ICCV 2007, pp. 1–8. doi:10.1109/ICCV.2007.4408929. ISSN: 1550-5499.

PII: S1361-8415(10)00065-4

doi: 10.1016/j.media.2010.06.002

Medical Image Analysis
Volume 14, Issue 6 , Pages 770-783 , December 2010