Medical Image Analysis
Volume 14, Issue 6 , Pages 707-722 , December 2010

Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study

  • Bram van Ginneken

      Affiliations

    • Image Sciences Institute, University Medical Center Utrecht, The Netherlands
    • Department of Radiology, Radboud University Nijmegen Medical Centre, The Netherlands
    • Corresponding Author InformationCorresponding author at: Image Sciences Institute, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX, The Netherlands. Tel.: + 31 30 250 4635; fax: +31 30 251 3399.
    • ,
  • Samuel G. Armato III

      Affiliations

    • Department of Radiology, University of Chicago, USA
    • ,
  • Bartjan de Hoop

      Affiliations

    • Department of Radiology, University Medical Center Utrecht, The Netherlands
    • ,
  • Saskia van Amelsvoort-van de Vorst

      Affiliations

    • Department of Radiology, University Medical Center Utrecht, The Netherlands
    • ,
  • Thomas Duindam

      Affiliations

    • Image Sciences Institute, University Medical Center Utrecht, The Netherlands
    • ,
  • Meindert Niemeijer

      Affiliations

    • Image Sciences Institute, University Medical Center Utrecht, The Netherlands
    • ,
  • Keelin Murphy

      Affiliations

    • Image Sciences Institute, University Medical Center Utrecht, The Netherlands
    • ,
  • Arnold Schilham

      Affiliations

    • Image Sciences Institute, University Medical Center Utrecht, The Netherlands
    • ,
  • Alessandra Retico

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Pisa, Pisa, Italy
    • ,
  • Maria Evelina Fantacci

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Pisa, Pisa, Italy
    • Dipartimento di Fisica dell’Università di Pisa, Pisa, Italy
    • ,
  • Niccolò Camarlinghi

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Pisa, Pisa, Italy
    • Dipartimento di Fisica dell’Università di Pisa, Pisa, Italy
    • ,
  • Francesco Bagagli

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Pisa, Pisa, Italy
    • Dipartimento di Fisica dell’Università di Pisa, Pisa, Italy
    • ,
  • Ilaria Gori

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Pisa, Pisa, Italy
    • Bracco Imaging S.p.A., Milano, Italy
    • ,
  • Takeshi Hara

      Affiliations

    • Department of Intelligent Image Information, Gifu University Graduate School of Medicine, Gifu, Japan
    • ,
  • Hiroshi Fujita

      Affiliations

    • Department of Intelligent Image Information, Gifu University Graduate School of Medicine, Gifu, Japan
    • ,
  • Gianfranco Gargano

      Affiliations

    • Dipartimento Interateneo ‘M. Merlin’ dell’Univerisità degli Studi di Bari, Italy
    • Istituto Nazionale di Fisica Nucleare, Sezione di Bari, Italy
    • ,
  • Roberto Bellotti

      Affiliations

    • Dipartimento Interateneo ‘M. Merlin’ dell’Univerisità degli Studi di Bari, Italy
    • Istituto Nazionale di Fisica Nucleare, Sezione di Bari, Italy
    • ,
  • Sabina Tangaro

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Bari, Italy
    • ,
  • Lourdes Bolaños

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Torino, Italy
    • Caeden, Cuba
    • ,
  • Francesco De Carlo

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Bari, Italy
    • ,
  • Piergiorgio Cerello

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Torino, Italy
    • ,
  • Sorin Cristian Cheran

      Affiliations

    • Istituto Nazionale di Fisica Nucleare, Sezione di Torino, Italy
    • ,
  • Ernesto Lopez Torres

      Affiliations

    • Caeden, Cuba
    • ,
  • Mathias Prokop

      Affiliations

    • Department of Radiology, University Medical Center Utrecht, The Netherlands
    • Department of Radiology, Radboud University Nijmegen Medical Centre, The Netherlands

Received 14 August 2009 ,Revised 14 May 2010 ,Accepted 25 May 2010.

References 

  1. Arimura H, Katsuragawa S, Suzuki K, Li F, Shiraishi J, Sone S, et al. Computerized scheme for automated detection of lung nodules in low-dose computed tomography images for lung cancer screening. Academic Radiology. 2004;11(6):617–629
  2. Armato SG, Giger ML, MacMahon H. Automated detection of lung nodules in CT scans: preliminary results. Medical Physics. 2001;28(8):1552–1561
  3. Armato SG, Li F, Giger ML, MacMahon H, Sone S, Doi K. Lung cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology. 2002;225(3):685–692
  4. Armato SG, McLennan G, McNitt-Gray MF, Meyer CR, Yankelevitz D, Aberle DR, et al. Lung image database consortium: developing a resource for the medical imaging research community. Radiology. 2004;232(3):739–748
  5. Armato SG, McNitt-Gray MF, Reeves AP, Meyer CR, McLennan G, Aberle DR, et al. The lung image database consortium (LIDC): an evaluation of radiologist variability in the identification of lung nodules on CT scans. Academic Radiology. 2007;14(11):1409–1421
  6. Armato SG, Roberts RY, Kocherginsky M, Aberle DR, Kazerooni EA, Macmahon H, et al. Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of “truth”. Academic Radiology. 2009;16(1):28–38
  7. Austin JH, Müller NL, Friedman PJ, Hansell DM, Naidich DP, Remy-Jardin M, et al. Glossary of terms for CT of the lungs: recommendations of the nomenclature committee of the Fleischner society. Radiology. 1996;200(2):327–331
  8. Bae KT, Kim JS, Na YH, Kim KG, Kim JH. Pulmonary nodules: automated detection on CT images with morphologic matching algorithm – preliminary results. Radiology. 2005;236:286–294
  9. Bellotti R, De Carlo F, Gargano G, Tangaro S, Cascio D, Catanzariti E, et al. A CAD system for nodule detection in low-dose lung CTs based on region growing and a new active contour model. Medical Physics. 2007;34(12):4901–4910
  10. Bellotti R, Cerello P, Tangaro S, Bevilacqua V, Castellano M, Mastronardi G, et al. Distributed medical images analysis on a grid infrastructure. Future Generation Computer Systems. 2007;23(3):475–484
  11. Brown MS, Goldin JG, Suh RD, McNitt-Gray MF, Sayre JW, Aberle DR. Lung micronodules: automated method for detection at thin-section CT—initial experience. Radiology. 2003;226:256–262
  12. Buscema, P.M., 2004. A method for encoding image pixels, a method for processing images and a method for processing images aimed at qualitative recognition of the object reproduced by one or more image pixels. Patent EP1483721.
  13. Cerello, P., Cheran, S.C., Bagagli, F., Bagnasco, S., Bellotti, R., Bolanos, L., Catanzariti, E., De Nunzio, G., Fiorina, E., Gargano, G., Gemme, G., Lopez Torres, E., Masala, G., Peroni, C., Santoro, M., 2008. The channeler ant model: object segmentation with virtual ant colonies. In: IEEE Nuclear Science Symposium, pp. 3147–3152.
  14. Das M, Mühlenbruch G, Mahnken AH, Flohr TG, Gündel L, Stanzel S, et al. Small pulmonary nodules: effect of two computer-aided detection systems on radiologist performance. Radiology. 2006;241(2):564–571
  15. Dehmeshki J, Ye X, Lin X, Valdivieso M, Amin H. Automated detection of lung nodules in CT images using shape-based genetic algorithm. Computerized Medical Imaging and Graphics. 2007;31(6):408–417
  16. de Hoop B, Gietema H, van Ginneken B, Zanen P, Groenewegen G, Prokop M. A comparison of six software packages for evaluation of solid lung nodules using semi-automated volumetry: what is the minimum increase in size to detect growth in repeated CT examinations. European Radiology. 2009;19(4):800–808
  17. Dolejsí, M., Kybic, J., 2009. The lung TIME annotated lung nodule dataset and nodule detection framework. In: Proceedings of the SPIE, vol. 7260, pp. 72601U1–72601U8.
  18. Enquobahrie AA, Reeves AP, Yankelevitz DF, Henschke CI. Automated detection of small pulmonary nodules in whole lung CT scans. Academic Radiology. 2007;14:579–593
  19. Farag, A., El-Baz, A., Gimel’farb, G.G., Falk, R., Hushek, S.G., 2004. Automatic detection and recognition of lung abnormalities in helical CT images using deformable templates. In: Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science, vol. 3217, pp. 856–864.
  20. Fotin, S.V., Reeves, A.P., Yankelevitz, D.F., Henschke, C.I., 2008. The impact of pulmonary nodule size estimation accuracy on the measured performance of automated nodule detection systems. In: Proceedings of the SPIE, vol. 6915, pp. 6915G1–6915G8.
  21. Fotin, S.V., Reeves, A.P., Biancardi, A.M., Yankelevitz, D.F., Henschke, C.I., 2009. A multiscale Laplacian of Gaussian filtering approach to automated pulmonary nodule detection from whole-lung low-dose CT scans. In: Proceedings of the SPIE, vol. 7260, pp. 72601Q1–72601Q8.
  22. Ge Z, Sahiner B, Chan H, Hadjiiski LM, Cascade PN, Bogot N, et al. Computer-aided detection of lung nodules: false positive reduction using a 3D gradient field method and 3D ellipsoid fitting. Medical Physics. 2005;32(8):2443–2454
  23. Godoy MCB, Cooperberg PL, Maizlin ZV, Yuan R, McWilliams A, Lam S, et al. Detection sensitivity of a commercial lung nodule CAD system in a series of pathologically proven lung cancers. Journal of Thoracic Imaging. 2008;23(1):1–6
  24. Gohagan J, Marcus P, Fagerstrom R, Pinsky P, Kramer B, Prorok P. Baseline findings of a randomized feasibility trial of lung cancer screening with spiral CT scan vs. chest radiograph: the lung screening study of the national cancer institute. Chest. 2004;126(1):114–121
  25. Gori, I., Mattiuzzi, M., 2008. Method for coding pixels or voxels of a digital image and a method for processing digital images. Patent EP1880364.
  26. Gori I, Bagagli F, Fantacci ME, Preite Martinez A, Retico A, De Mitri I, et al. Multi-scale analysis of lung computed tomography images. Journal of Instrumentation. 2007;2(09):P09007
  27. Gori, I., Fantacci, M.E., Preite Martinez, A., Retico, A., 2007b. An automated system for lung nodule detection in low-dose computed tomography. In: Proceedings of the SPIE, vol. 6514, pp. 65143R1–65143R9.
  28. Gori, I., Bagagli, F., Camarlinghi, N., Fantacci, M.E., Retico, A., Barattini, M., Bolanos, L., Falaschi, F., Gargano, G., Massafra, A., Spinelli, C., 2009. Methodology for automated detection of parenchymal and juxtapleural lung nodules in computed tomography images. In: Proceedings of CARS.
  29. Gruden JF, Ouanounou S, Tigges S, Norris SD, Klausner TS. Incremental benefit of maximum-intensity-projection images on observer detection of small pulmonary nodules revealed by multidetector CT. American Journal of Roentgenology. 2002;179(1):149–157
  30. Heimann T, van Ginneken B, Styner M, Arzhaeva Y, Aurich V, Bauer C, et al. Comparison and evaluation of methods for liver segmentation from CT datasets. IEEE Transactions on Medical Imaging. 2009;28(8):1251–1265
  31. Henschke, C.I., the International Early Lung Cancer Action Program Investigators, 2007. Survival of patients with clinical stage I lung cancer diagnosed by computed tomography screening for lung cancer. Clinical Cancer Research 13 (17), 4949–4950.
  32. Henschke CI, Yankelevitz DF, Naidich DP, McCauley DI, McGuinness G, Libby DM, et al. CT screening for lung cancer: suspiciousness of nodules according to size on baseline scans. Radiology. 2004;231(1):164–168
  33. Infante M, Cavuto S, Romano Lutman F, Brambilla G, Chiesa G, Ceresoli G, et al. A randomized study of lung cancer screening with spiral CT (the Dante trial): three-year results. American Journal of Respiratory and Critical Care Medicine. 2009;(June 11. Epub ahead of print)
  34. Kittler J, Hatef M, Duin RPW, Matas J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1998;20(3):226–239
  35. Ko JP, Betke M. Chest CT: automated nodule detection and assessment of change over time-preliminary experience. Radiology. 2001;218(1):267–273
  36. Kostis WJ, Reeves AP, Yankelevitz DF, Henschke CI. Three-dimensional segmentation and growth rate estimation of small pulmonary nodules in helical CT images. IEEE Transactions on Medical Imaging. 2003;22(10):1259–1274
  37. Kung JW, Matsumoto S, Hasegawa I, Nguyen B, Toto LC, Kundel H, et al. Mixture distribution analysis of a computer assisted diagnostic method for the evaluation of pulmonary nodules on computed tomography scan. Academic Radiology. 2004;11(3):281–285
  38. Lee Y, Hara T, Fujita H, Itoh S, Ishigaki T. Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique. IEEE Transactions on Medical Imaging. 2001;20(7):595–604
  39. Lee IJ, Gamsu G, Czum J, Wu N, Johnson R, Chakrapani S. Lung nodule detection on chest CT: evaluation of a computer-aided detection (CAD) system. Korean Journal of Radiology. 2005;6(2):89–93
  40. Li Q. Recent progress in computer-aided diagnosis of lung nodules on thin-section CT. Computerized Medical Imaging and Graphics. 2007;31(4-5):248–257
  41. Li Q, Sone S, Doi K. Selective enhancement filters for nodules, vessels, and airway walls in two- and three-dimensional CT scans. Medical Physics. 2003;30(8):2040–2051
  42. Li Q, Li F, Doi K. Computerized detection of lung nodules in thin-section CT images by use of selective enhancement filters and an automated rule-based classifier. Academic Radiology. 2008;15(2):165–175
  43. MacMahon H, Austin JHM, Gamsu G, Herold CJ, Jett JR, Naidich DP, et al. Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner society. Radiology. 2005;237(2):395–400
  44. Matsumoto S, Kundel HL, Gee JC, Gefter WB, Hatabu H. Pulmonary nodule detection in CT images with quantized convergence index filter. Medical Image Analysis. 2006;10(3):343–352
  45. McCulloch CC, Kaucic RA, Mendonça PRS, Walter DJ, Avila RS. Model-based detection of lung nodules in computed tomography exams. Academic Radiology. 2004;11(3):258–266
  46. Mendonça, P.R.S., Bhotika, R., Zhao, F., Miller, J.V., 2007. Lung nodule detection via Bayesian voxel labeling. In: Information Processing in Medical Imaging. Lecture Notes in Computer Science, vol. 4584, pp. 134–146.
  47. Murphy, K., Schilham, A.M.R., Gietema, H., Prokop, M., van Ginneken, B., 2007. Automated detection of pulmonary nodules from low-dose computed tomography scans using a two-stage classification system based on local image features. In: Proceedings of the SPIE, vol. 6514, pp. 651410-1–651410-12.
  48. Murphy K, van Ginneken B, Schilham AMR, de Hoop BJ, Gietema HA, Prokop M. A large scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification. Medical Image Analysis. 2009;13:757–770
  49. Novak, C.L., Shen, H., Odry, B.L., Ko, J.P., Naidich, D.P., 2004. A system for automatic detection of lung nodules exhibiting growth. In: Proceedings of the SPIE, vol. 5370, pp. 10–21.
  50. Ochs, R., Kimb, H.J., Angel, E., Panknin, C., McNitt-Gray, M., Brown, M., 2007. Forming a reference standard from LIDC data: impact of reader agreement on reported CAD performance. In: Proceedings of the SPIE, vol. 6514, pp. 65142A-1–65142A-6.
  51. Receiver Operating Characteristic Analysis in Medical Imaging. Journal of the ICRU 8.
  52. Osman O, Ozekes S, Ucan ON. Lung nodule diagnosis using 3D template matching. Computers in Biology and Medicine. 2007;37(8):1167–1172
  53. Paik DS, Beaulieu CF, Rubin GD, Acar B, Jeffrey RB, Yee J, et al. Surface normal overlap: a computer-aided detection algorithm with application to colonic polyps and lung nodules in helical CT. IEEE Transactions on Medical Imaging. 2004;23(6):661–675
  54. Pegna AL, Picozzi G, Mascalchi M, Carozzi FM, Carrozzi L, Comin C, et al. Design, recruitment and baseline results of the ITALUNG trial for lung cancer screening with low-dose CT. Lung Cancer. 2009;64(1):34–40
  55. Peloschek P, Sailer J, Weber M, Herold CJ, Prokop M, Schaefer-Prokop CM. Pulmonary nodules: sensitivity of maximum intensity projection versus that of volume rendering of 3D multidetector CT data. Radiology. 2007;243(2):561–569
  56. Retico A, Delogu P, Fantacci ME, Gori I, Preite Martinez A. Lung nodule detection in low-dose and thin-slice computed tomography. Computers in Biology and Medicine. 2008;38(4):525–534
  57. Retico, A., Bagagli, F., Camarlinghi, N., Carpentieri, C., Fantacci, M.E., Gori, I., 2009. A voxel-based neural approach (VBNA) to identify lung nodules in the ANODE09 study. In: Medical Imaging 2009: Computer-Aided Diagnosis, vol. 7260. SPIE, Lake Buena Vista, FL, USA, pp. 72601S–8.
  58. Schneider, C., Amjadi, A., Richter, A., Fiebich, M., 2009. Automated lung nodule detection and segmentation. In: Proceedings of the SPIE, vol. 7260, pp. 72601T1–72601T8.
  59. Sluimer IC, Schilham AMR, Prokop M, van Ginneken B. Computer analysis of computed tomography scans of the lung: a survey. IEEE Transactions on Medical Imaging. 2006;25(4):385–405
  60. Suzuki K, Armato SG, Li F, Sone S, Doi K. Massive training artificial neural network (MTANN) for reduction of false positives in computerized detection of lung nodules in low-dose computed tomography. Medical Physics. 2003;30(7):1602–1617
  61. van den Bergh KAM, Essink-Bot M-L, Bunge EM, Scholten E Th, Prokop M, van Iersel CA, et al. Impact of computed tomography screening for lung cancer on participants in a randomized controlled trial (NELSON trial). Cancer. 2008;113(2):396–404
  62. van Iersel CA, de Koning HJ, Draaisma G, Mali WPTM, Scholten E Th, Nackaerts K, et al. Risk-based selection from the general population in a screening trial: selection criteria, recruitment and power for the Dutch-Belgian randomised lung cancer multi-slice CT screening trial (NELSON). International Journal of Cancer. 2006;120(4):868–874
  63. van Rikxoort EM, de Hoop B, Viergever MA, Prokop M, van Ginneken B. Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. Medical Physics. 2009;36(7):2934–2947
  64. Wei, G.-Q., Fan, L., Qian, J., 2002. Automatic detection of nodules attached to vessels in lung CT by volume projection analysis. In: Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science, vol. 2488, pp. 746–752.
  65. Wiemker, R., Rogalla, P., Zwartkruis, A., Blaffert, T., 2002. Computer aided lung nodule detection on high resolution CT data. In: Proceedings of the SPIE, vol. 4684, pp. 677–688.
  66. Wiemker, R., Rogalla, P., Blaffert, T., Sifri, D., Hay, O., Shah, E., Truyen, R., Fleiter, T., 2005. Aspects of computer-aided detection (CAD) and volumetry of pulmonary nodules using multislice CT. British Journal of Radiology 78 (1), S46–S56.
  67. Xu DM, Gietema H, de Koning H, Vernhout R, Nackaerts K, Prokop M, et al. Nodule management protocol of the NELSON randomised lung cancer screening trial. Lung Cancer. 2006;54(2):177–184
  68. Ye, X., Lin, X., Beddoe, G., Dehmeshki, J., 2007. Efficient computer-aided detection of ground-glass opacity nodules in thoracic CT images. In: Proceedings of the 29th Annual International Conference of the IEEE EMBS, vol. 1, pp. 4449–4452.
  69. Zhang, X., Stockel, J., Wolf, M., Cathier, P., McLennan, G., Hoffman, E.A., Sonka, M., 2007. A new method for spherical object detection and its application to computer aided detection of pulmonary nodules in CT images. In: Medical Image Computing and Computer-Assisted Intervention. Lecture Notes in Computer Science, vol. 4791, pp. 842–849.
  70. Zhao B, Gamsu G, Ginsberg MS, Jiang L, Schwartz LH. Automatic detection of small lung nodules on CT utilizing a local density maximum algorithm. Journal of Applied Clinical Medical Physics. 2003;4(3):248–260

PII: S1361-8415(10)00058-7

doi: 10.1016/j.media.2010.05.005

Medical Image Analysis
Volume 14, Issue 6 , Pages 707-722 , December 2010

Article Tools

* Image Usage & Resolution