Using Dictionary and Lemmatizer to Improve Low Resource English-Malay Statistical Machine Translation System

详细信息    查看全文

• 作者：Yin-Lai Yeong ; ^{yyl09_em0751@student.usm.my" class="auth_mail" title="E-mail the corresponding author} ; Tien-Ping Tan ; Siti Khaotijah Mohammad
• 关键词：Statistical machine tranlstion ; English-Malay ; dictionary ; parallel corpus ; lemmatization
• 刊名：Procedia Computer Science
• 出版年：2016
• 出版时间：2016
• 年：2016
• 卷：81
• 期：Complete
• 页码：243-249
• 全文大小：182 K

文摘

Statistical Machine Translation (SMT) is one of the most popular methods for machine translation. In this work, we carried out English-Malay SMT by acquiring an English-Malay parallel corpus in computer science domain. On the other hand, the training parallel corpus is from a general domain. Thus, there will be a lot of out of vocabulary during translation. We attempt to improve the English-Malay SMT in computer science domain using a dictionary and an English lemmatizer. Our study shows that a combination of approach using bilingual dictionary and English lemmatization improves the BLEU score for English to Malay translation from 12.90 to 15.41.