This paper presents a supervised diversified dictionaries MIL to address the problem of bridging instance-level representations to bag-level labels. The proposed method exploits bag-level label information for training class-specific dictionaries. The proposed method introduces a diversity regulariser into the class-specific dictionaries to avoid ambiguity between them. To the best of our knowledge, this is the first time that the diversity prior is introduced to solve the MIL problems.