A progressive multi-atlas label fusion method by deep dictionary evolution is proposed. A sequence of intermediate dictionaries was constructed to progressively optimize the weights for label fusion. As an extension of the conventional single-layer methods by improving their label fusion performance.