Termhood-Based Comparability Metrics of Comparable Corpus in Special Domain

详细信息    查看全文

• 作者：Sa Liu (21)
  Chengzhi Zhang (21)
  
• 关键词：Termhood ; based Comparability ; Comparable Corpus ; Frequencybased Metrics ; Terminology Extraction
• 刊名：Lecture Notes in Computer Science
• 出版年：2013
• 出版时间：2013
• 年：2013
• 卷：7717
• 期：1
• 页码：145-153
• 全文大小：228KB
• 参考文献：1. McEnery, A.M., Xiao, R.Z.: Parallel and comparable corpora: What are they up to. In: Proceedings of Incorporating Corpora: Translation and the Linguist Translating Europe Multilingual Matters, Clevedon, UK (2007)
  2. Talvensaari, T., Laurikkala, J., J盲rvelin, K., Juhola, M., Keskustalo, H.: Creating and Exploiting a Comparable Corpus in Cross - Language Information Retrieval. J. ACM Transactions on Information Systems (TOIS)聽25(1), 322鈥?34 (2007)
  3. D1.3:聽Final report on criteria and metrics of comparability and parallelism and their suitability, http://www.accurat-project.eu/index.php?p=deliverables
  4. Dejean, H., Gaussier, E., Sadat, F.: Bilingual terminology extraction: an approach based on multilingual thesaurus applicable to comparable corpora. In: Proceedings of COLING 2002, Tapei, Taiwan, pp. 218鈥?24 (2002)
  5. Kilgarriff, A.: Using word frequency lists to measure corpus homogeneity and similarity between corpora. In: Proceedings of the Fifth Workshop on Very Large Corpora, Hong Kong, China, pp. 231鈥?45 (1997)
  6. Talvensaari, T., Pirkola, A., J盲rvelin, K., Juhola, M., Laurikkala, J.: Focused web crawling in the acquisition of comparable corpora. J. Information Retrieval聽11(5), 427鈥?45 (2008) CrossRef
  7. Leturia, I., Vicente, I.S., Saralegi, X.: Search engine based approaches for collecting domain-specific Basque-English comparable corpora from the Internet. In: Proceedings of the Fifth Web as Corpus Workshop (WAC5), Basque Country, Spain, pp. 53鈥?1 (2009)
  8. Otero, P.G., L贸pez, I.G.: Wikipedia as Multilingual Source of Comparable Corpora. In: Proceedings of the 3rd Workshop on Building and Using Comparable Corpora, LREC 2010, Malta, pp. 21鈥?5 (2010)
  9. Vasi募jevs, A.: ACCURAT: Metrics for the evaluation of comparability of multilingual corpora. In: Proceedings of the Workshop on Methods for the Automatic Acquisition of Language Resources and their Evaluation Methods, LREC 2010, Malta (2010)
  10. TTC Project, http://www.ttc-project.eu/releases
  11. Li, B., Gaussier, E.: Improving Corpus Comparability for Bilingual Lexicon Extraction from Comparable Corpora. In: Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010), Beijing, China, pp. 644鈥?52 (2010)
  12. CNKI, http://www.cnki.net/
  13. EBscohost, http://www.ebscohost.com/
  14. Google Translate, http://translate.google.cn/
  15. ICTClAS, http://ictclas.org/
  16. Kit, C.Y., Liu, X.Y.: Measuring mono-word termhood by rank difference via corpus comparison. J. Terminology聽14(2), 204鈥?29 (2008) CrossRef
  17. Salton, G., Wong, A., Yang, C.S.: A Vector Space Model for Automatic Indexing. Communications of the ACM, Malta (1975)
  18. Fung, P.: A Statistical view on Bilingual lexicon extraction: From Parallel Corpora to non-parallel corpora. In: Proceedings of Jean Veronis. Parallel Text Processing (2000)
  19. LCD, http://www.ldc.upenn.edu/Catalog/catalogEntry.jsp?catalogId=LDC2002L27
  20. Kondrak, G., Marcu, D., Knight, K.: Cognates Can Improve Statistical Translation Models. In: Proceedings of HLT-NAACL 2003: Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics (2003)
  
• 作者单位：Sa Liu (21)
  Chengzhi Zhang (21)
  
  21. Department of Information Management, Nanjing University of Science and Technology, Nanjing, China
  
• ISSN：1611-3349

文摘

Cross-Language Information Retrieval (CLIR) and machine translation (MT) resources, such as dictionaries and parallel corpora, are scarce and hard to come by for special domains. Besides, these resources are just limited to a few languages, such as English, French, and Spanish and so on. So, obtaining comparable corpora automatically for such domains could be an answer to this problem effectively. Comparable corpora, that the subcorpora are not translations of each other, can be easily obtained from web. Therefore, building and using comparable corpora is often a more feasible option in multilingual information processing. Comparability metrics is one of key issues in the field of building and using comparable corpus. Currently, there is no widely accepted definition or metrics method of corpus comparability. In fact, Different definitions or metrics methods of comparability might be given to suit various tasks about natural language processing. A new comparability, namely, termhood-based metrics, oriented to the task of bilingual terminology extraction, is proposed in this paper. In this method, words are ranked by termhood not frequency, and then the cosine similarities, calculated based on the ranking lists of word termhood, is used as comparability. Experiments results show that termhood-based metrics performs better than traditional frequency-based metrics.