Attribute selection based on a new conditional entropy for incomplete decision systems

详细信息    查看全文

• 作者：Jianhua Dai ; ^{jhdai@zju.edu.cn} ; Wentao Wang ; Haowei Tian ; Liang Liu
• 关键词：Incomplete decision systems ; Attribute selection ; Conditional entropy ; Rough set theory ; Information theory
• 刊名：Knowledge-Based Systems
• 出版年：2013
• 出版时间：February, 2013
• 年：2013
• 卷：39
• 期：Complete
• 页码：207-213
• 全文大小：431 K

文摘

Shannon¡¯s entropy and its variants have been applied to measure uncertainty in rough set theory from the viewpoint of information theory. However, few studies have been done on attribute selection in incomplete decision systems based on information-theoretical measurement of attribute importance. In this paper, we introduce a new form of conditional entropy to measure the importance of attributes in incomplete decision systems. Based on the introduced conditional entropy, we construct three attribute selection approaches, including an exhaustive search strategy approach, a greedy (heuristic) search strategy approach and a probabilistic search approach for incomplete decision systems. To test the effectiveness of these methods, experiments on several real-life incomplete data sets are conducted. The results indicate that two of these methods are effective for attribute selection in incomplete decision system.