A novel simple and efficient algorithm BCDDL is proposed to solve SC–DL problems.
BCDDL is the fastest algorithm in solving SC–DL to date.
BCDDL shows state-of-the-art performance when learning bases with small samples.
BCDDL shows state-of-the-art performance when pursuing comparatively much sparser codes.
BCDDL achieves superior performance in image classification tasks.