Dictionary-based Word Segmentation for Javanese

详细信息    查看全文

• 作者：Dipta Tanaya ; Mirna Adriani ; ^{mirna@cs.ui.ac.id" class="auth_mail" title="E-mail the corresponding author}
• 关键词：javanese character ; word segmentation
• 刊名：Procedia Computer Science
• 出版年：2016
• 出版时间：2016
• 年：2016
• 卷：81
• 期：Complete
• 页码：208-213
• 全文大小：156 K

文摘

Word segmentation is the first step to process language that written in non-Latin letters such as such as Javanese script. In this study, we report our work on word segmentation based on dictionary approach. In the first phase, we generate all possible segmented word series using a word dictionary. The correct word is selected based on the last character in a word, the last two characters in a word, the difference of two consecutive words, and the frequency of the word in the additional corpus. The experimental results show that identifying words using the frequency of words in the additional corpus yield the best accuracy that is 91.08%.