Fast q-gram mining on SLP compressed strings

详细信息    查看全文

• 作者：Keisuke Goto ; ^{keisuke.gotou@inf.kyushu-u.ac.jp} ; Hideo Bannai ^{bannai@inf.kyushu-u.ac.jp} ; Shunsuke Inenaga ^{inenaga@inf.kyushu-u.ac.jp} ; Masayuki Takeda ^{takeda@inf.kyushu-u.ac.jp}
• 关键词：q-grams ; Straight-line programs ; Compressed string mining
• 刊名：Journal of Discrete Algorithms
• 出版年：2013
• 出版时间：January, 2013
• 年：2013
• 卷：18
• 期：Complete
• 页码：89-99
• 全文大小：1652 K

文摘

We present simple and efficient algorithms for calculating q-gram frequencies on strings represented in compressed form, namely, as a straight line program (SLP). Given an SLP of size n that represents string T, we present an time and space algorithm that computes the occurrence frequencies of all q-grams in T. Computational experiments show that our algorithm and its variation are practical for small q, actually running faster on various real string data, compared to algorithms that work on the uncompressed text. We also discuss applications in data mining and classification of string data, for which our algorithms can be useful.