We propose a coarse-to-fine detection strategy of weak scratch in the complicated dark-field images of the large-aperture optical element. The coarse detection method is based on the bionic vision which is applicable to various types of linear defect detection. For the classification of defect and pollutants, a classification method based on GIST features is proposed.