基于整数线性规划重构抽象语义图结构的语义摘要算法
|
摘要
针对利用抽象语义(AMR)图来预测摘要子图存在的语义结构不完整问题,该文提出一种基于整数线性规划(ILP)重构AMR图结构的语义摘要算法。首先将数据预处理生成一个AMR总图;然后基于统计特征从AMR总图中抽取出摘要子图重要节点信息;最后利用ILP的方法来对摘要子图中节点关系进行重构,利用完整的摘要子图恢复生成语义摘要。实验结果表明,相比其他语义摘要方法,所提方法的ROUGE值和Smatch值都有显著提高,最多分别提高了9%和14%,该方法有利于提高语义摘要的质量。
In order to solve the incomplete semantic structure problem that occurs in the process of using the Abstract Meaning Representation(AMR) graph to predict the summary subgraph, a semantic summarization algorithm is proposed based on Integer Linear Programming(ILP) reconstructed AMR graph structure. Firstly,the text data are preprocessed to generate an AMR total graph. Then the important node information of the summary subgraph is extracted from the AMR total graph based on the statistical features. Finally, the ILP method is applied to reconstructing the node relationships in the summary subgraph, which is further utilized to generate a semantic summarization. The experimental results show that compared with other semantic summarization methods, the ROUGE index and Smatch index of the proposed algorithm are significantly improved, up to 9% and 14% respectively. This method improves significantly the quality of semantic summarization.
In order to solve the incomplete semantic structure problem that occurs in the process of using the Abstract Meaning Representation(AMR) graph to predict the summary subgraph, a semantic summarization algorithm is proposed based on Integer Linear Programming(ILP) reconstructed AMR graph structure. Firstly,the text data are preprocessed to generate an AMR total graph. Then the important node information of the summary subgraph is extracted from the AMR total graph based on the statistical features. Finally, the ILP method is applied to reconstructing the node relationships in the summary subgraph, which is further utilized to generate a semantic summarization. The experimental results show that compared with other semantic summarization methods, the ROUGE index and Smatch index of the proposed algorithm are significantly improved, up to 9% and 14% respectively. This method improves significantly the quality of semantic summarization.
引文
[1]LYNN H M,CHOI C,and KIM P.An improved method of automatic text summarization for web contents using lexical chain with semantic-related terms[J].Soft Computing,2018,22(12):4013-4023.doi:10.1007/s00500-017-2612-9.
[2]SHETTY K and KALLIMANI J S.Automatic extractive text summarization using K-means clustering[C].International Conference on Electrical,Electronics,Communication,Computer,and Optimization Techniques(ICEECCOT),Mysuru,India,2017:1-9.doi:10.1109/ICEECCOT.2017.8284627.
[3]YU Shanshan,SU Jindian,LI Pengfei,et al.Towards high performance text mining:A TextRank-based method for automatic text summarization[J].International Journal of Grid and High Performance Computing(IJGHPC),2016,8(2):58-75.doi:10.4018/IJGHPC.2016040104.
[4]NGUYEN-HOANG T A,NGUYEN K,and TRAN Q V.TSGVi:A graph-based summarization system for Vietnamese documents[J].Journal of Ambient Intelligence and Humanized Computing,2012,3(4):305-313.doi:10.1007/s12652-012-0143-x.
[5]KHAN A,SALIM N,FARMAN H,et al.Abstractive text summarization based on improved semantic graph approach[J].International Journal of Parallel Programming,2018:1-25.doi:10.1007/s10766-018-0560-3.
[6]BANARESU L,BONIAL C,CAI S,et al.Abstract meaning representation for sembanking[C].Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse,Sofia,Bulgaria,2013:178-186.
[7]LIU Fei,FLANIGAN J,THOMSON S,et al.Toward abstractive summarization using semantic representations[C].Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,Denver,USA,2015:1077-1086.doi:10.3115/v1/n15-1114.
[8]SONG Linfeng,PENG Xiaochang,ZHANG Yue,et al.AMR-to-text generation with synchronous node replacement grammar[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017:7-13.doi:10.18653/v1/P17-2002.
[9]KONSTAS I,IYER S,YATSKAR M,et al.Neural AMR:Sequence-to-sequence models for parsing and generation[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017:146-157.doi:10.18653/v1/P17-1014.
[10]明拓思宇,陈鸿昶,黄瑞阳,等.一种基于加权AMR图的语义子图预测摘要算法[J].计算机工程,2018,44(10):292-297.doi:10.19678/j.issn.1000-3428.0050770.MING Tuosiyu,CHEN Hongchang,HUANG Ruiyang,et al.A semantic subgraph predictive summary algorithm based on improved AMR graph[J].Computer Engineering,2018,44(10):292-297.doi:10.19678/j.issn.1000-3428.0050770.
[11]COLLINS M.Discriminative training methods for hidden markov models:Theory and experiments with perceptron algorithms[C].Proceedings of the ACL-02 conference on Empirical Methods in Natural Language Processing,Philadelphia,USA,2002,10:1-8.doi:10.3115/1118693.1118694.
[12]HERMANN K M,KO?ISKYT,GREFENSTETTE E,et al.Teaching machines to read and comprehend[C].Proceeding NIPS’15 Proceedings of the 28th International Conference on Neural Information Processing Systems,Montreal,Canada,2015,1:1693-1701.
[13]LIN Chinyew.ROUGE:A package for automatic evaluation of summaries[C].Text Summarization Branches Out:Proceedings of the ACL-04 Workshop,Barcelona,Spain,2004,10:74-81.
[14]CAI Shu and KNIGHT K.Smatch:An evaluation metric for semantic feature structures[C].Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics,Sofia,Bulgaria,2013,2:748-752.
[15]SEE A,LIU P J,and MANNING C D.Get to the point:Summarization with pointer-generator networks[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017,1:1073-1083.doi:10.18653/v1/P17-1099.
[16]TAN Jiwei,WAN Xiaojun,and XIAO Jianguo.Abstractive document summarization with a graph-based attentional neural model[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017,1:1171-1181.doi:10.18653/v1/P17-1108.
[2]SHETTY K and KALLIMANI J S.Automatic extractive text summarization using K-means clustering[C].International Conference on Electrical,Electronics,Communication,Computer,and Optimization Techniques(ICEECCOT),Mysuru,India,2017:1-9.doi:10.1109/ICEECCOT.2017.8284627.
[3]YU Shanshan,SU Jindian,LI Pengfei,et al.Towards high performance text mining:A TextRank-based method for automatic text summarization[J].International Journal of Grid and High Performance Computing(IJGHPC),2016,8(2):58-75.doi:10.4018/IJGHPC.2016040104.
[4]NGUYEN-HOANG T A,NGUYEN K,and TRAN Q V.TSGVi:A graph-based summarization system for Vietnamese documents[J].Journal of Ambient Intelligence and Humanized Computing,2012,3(4):305-313.doi:10.1007/s12652-012-0143-x.
[5]KHAN A,SALIM N,FARMAN H,et al.Abstractive text summarization based on improved semantic graph approach[J].International Journal of Parallel Programming,2018:1-25.doi:10.1007/s10766-018-0560-3.
[6]BANARESU L,BONIAL C,CAI S,et al.Abstract meaning representation for sembanking[C].Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse,Sofia,Bulgaria,2013:178-186.
[7]LIU Fei,FLANIGAN J,THOMSON S,et al.Toward abstractive summarization using semantic representations[C].Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies,Denver,USA,2015:1077-1086.doi:10.3115/v1/n15-1114.
[8]SONG Linfeng,PENG Xiaochang,ZHANG Yue,et al.AMR-to-text generation with synchronous node replacement grammar[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017:7-13.doi:10.18653/v1/P17-2002.
[9]KONSTAS I,IYER S,YATSKAR M,et al.Neural AMR:Sequence-to-sequence models for parsing and generation[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017:146-157.doi:10.18653/v1/P17-1014.
[10]明拓思宇,陈鸿昶,黄瑞阳,等.一种基于加权AMR图的语义子图预测摘要算法[J].计算机工程,2018,44(10):292-297.doi:10.19678/j.issn.1000-3428.0050770.MING Tuosiyu,CHEN Hongchang,HUANG Ruiyang,et al.A semantic subgraph predictive summary algorithm based on improved AMR graph[J].Computer Engineering,2018,44(10):292-297.doi:10.19678/j.issn.1000-3428.0050770.
[11]COLLINS M.Discriminative training methods for hidden markov models:Theory and experiments with perceptron algorithms[C].Proceedings of the ACL-02 conference on Empirical Methods in Natural Language Processing,Philadelphia,USA,2002,10:1-8.doi:10.3115/1118693.1118694.
[12]HERMANN K M,KO?ISKYT,GREFENSTETTE E,et al.Teaching machines to read and comprehend[C].Proceeding NIPS’15 Proceedings of the 28th International Conference on Neural Information Processing Systems,Montreal,Canada,2015,1:1693-1701.
[13]LIN Chinyew.ROUGE:A package for automatic evaluation of summaries[C].Text Summarization Branches Out:Proceedings of the ACL-04 Workshop,Barcelona,Spain,2004,10:74-81.
[14]CAI Shu and KNIGHT K.Smatch:An evaluation metric for semantic feature structures[C].Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics,Sofia,Bulgaria,2013,2:748-752.
[15]SEE A,LIU P J,and MANNING C D.Get to the point:Summarization with pointer-generator networks[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017,1:1073-1083.doi:10.18653/v1/P17-1099.
[16]TAN Jiwei,WAN Xiaojun,and XIAO Jianguo.Abstractive document summarization with a graph-based attentional neural model[C].Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Vancouver,Canada,2017,1:1171-1181.doi:10.18653/v1/P17-1108.