Turning agricultural by-products into high quality food ingredients is a trend to combat food security problem. We overview the major types of existing products and current researches related to agricultural by-products. Different modification or processing methods for agricultural waste are covered in this paper. Safety concerns about the utilization of agricultural by-products are highlighted. Bioactivity in different agricultural by-products and their potential ways of fortification are put forward.