Shear banding in AZ31 magnesium alloy was thoroughly studied. The substructure triggering localized deformation in magnesium was recognized. Formation of nanograins was observed within the shear bands. Micro shear banding was realized as the initial form of strain localization. The substructure transformed into new grain through continuous recrystallization.