Leafsnap: A Computer Vision System for Automatic Plant Species Identification

详细信息    查看全文

• 作者：Neeraj Kumar (21)
  Peter N. Belhumeur (22)
  Arijit Biswas (23)
  David W. Jacobs (23)
  W. John Kress (24)
  Ida C. Lopez (24)
  Jo?o V. B. Soares (23)
  
• 刊名：Lecture Notes in Computer Science
• 出版年：2012
• 出版时间：2012
• 年：2012
• 卷：1
• 期：1
• 页码：517-530
• 全文大小：3889KB
• 参考文献：1. Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. IJCV?42, 145-75 (2001) CrossRef
  2. Branson, S., Wah, C., Schroff, F., Babenko, B., Welinder, P., Perona, P., Belongie, S.: Visual Recognition with Humans in the Loop. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol.?6314, pp. 438-51. Springer, Heidelberg (2010) CrossRef
  3. Nilsback, M., Zisserman, A.: Automated flower classification over a large number of classes. In: Indian Conference on Computer Vision, Graphics and Image Processing (2008)
  4. Go?au, H., Bonnet, P., Joly, A., Boujemaa, N., Barthelemy, D., Molino, J.F., Birnbaum, P., Mouysset, E., Picard, M.: The clef 2011 plant images classification task. In: CLEF (Notebook Papers/Labs/Workshop) (2011)
  5. Belhumeur, P.N., Chen, D., Feiner, S.K., Jacobs, D.W., Kress, W.J., Ling, H., Lopez, I., Ramamoorthi, R., Sheorey, S., White, S., Zhang, L.: Searching the World’s Herbaria: A System for Visual Identification of Plant Species. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol.?5305, pp. 116-29. Springer, Heidelberg (2008) CrossRef
  6. Agarwal, G., Belhumeur, P., Feiner, S., Jacobs, D., Kress, W.J., Ramamoorthi, R., Bourg, N.A., Dixit, N., Ling, H., Mahajan, D., Russell, R., Shirdhonkar, S., Sunkavalli, K., White, S.: First steps toward an electronic field guide for plants. Taxon?55, 597-10 (2006) CrossRef
  7. Ling, H., Jacobs, D.: Shape classification using the inner-distance. TPAMI?29, 286-99 (2007) CrossRef
  8. Cortes, C., Vapnik, V.: Support-vector networks. Machine Learning?20 (1995)
  9. Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 27:1-7:27 (2011)
  10. Douze, M., Jégou, H., Sandhawalia, H., Amsaleg, L., Schmid, C.: Evaluation of gist descriptors for web-scale image search. In: International Conference on Image and Video Retrieval (2009)
  11. Efron, B.: The efficiency of logistic regression compared to normal discriminant analysis. Journal of the American Statistical Association?70, 892-98 (1975) CrossRef
  12. Gonzalez, R., Woods, R.: Digital image processing. Pearson/Prentice Hall (2008)
  13. Connolly, M.L.: Measurement of protein surface shape by solid angles. Journal of Molecular Graphics?4, 3- (1986) CrossRef
  14. Manay, S., Cremers, D., Hong, B.W., Yezzi, A.J., Soatto, S.: Integral invariants for shape matching. TPAMI?28, 1602-618 (2006) CrossRef
  15. Pottmann, H., Wallner, J., Huang, Q.X., Yang, Y.L.: Integral invariants for robust geometry processing. Computer Aided Geometric Design?26, 37-0 (2009) CrossRef
  
• 作者单位：Neeraj Kumar (21)
  Peter N. Belhumeur (22)
  Arijit Biswas (23)
  David W. Jacobs (23)
  W. John Kress (24)
  Ida C. Lopez (24)
  Jo?o V. B. Soares (23)
  
  21. University of Washington, Seattle, WA, USA
  22. Columbia University, New York, NY, USA
  23. University of Maryland, College Park, MD, USA
  24. National Museum of Natural History, Smithsonian Institution, Washington, DC, USA
  
• ISSN：1611-3349

文摘

We describe the first mobile app for identifying plant species using automatic visual recognition. The system -called Leafsnap -identifies tree species from photographs of their leaves. Key to this system are computer vision components for discarding non-leaf images, segmenting the leaf from an untextured background, extracting features representing the curvature of the leaf’s contour over multiple scales, and identifying the species from a dataset of the 184 trees in the Northeastern United States. Our system obtains state-of-the-art performance on the real-world images from the new Leafsnap Dataset -the largest of its kind. Throughout the paper, we document many of the practical steps needed to produce a computer vision system such as ours, which currently has nearly a million users.