Research on Light-Weight Compression Schemes Based on Simulative Column-Store

详细信息    查看全文

• 关键词：Column ; stores ; Simulative column ; store ; Light ; weight compression ; Dictionary encoding
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：9196
• 期：1
• 页码：55-68
• 全文大小：902 KB
• 参考文献：1.Abadi, D., Madden, S., Ferreira, M.: Integrating compression and execution in column-oriented database systems. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, pp. 671鈥?82. ACM (2006)
  2.Abadi, D.J.: Query execution in column-oriented database systems. Ph.D. thesis, Massachusetts Institute of Technology (2008)
  3.Abadi, D.J., Boncz, P.A., Harizopoulos, S.: Column-oriented database systems. Proceedings of the VLDB Endowment 2(2), 1664鈥?665 (2009)View Article
  4.Abadi, D.J., Madden, S.R., Hachem, N.: Column-stores vs. row-stores: how different are they really? In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 967鈥?80. ACM (2008)
  5.Apte, T., Ingle, M., Goyal, A.: Dictionary symbol encoding: A column-store case study. In: 2014 World Congress on Computer Applications and Information Systems (WCCAIS), pp. 1鈥?. IEEE (2014)
  6.Boncz, P.A., Kersten, M.L.: Monet: An impressionist sketch of an advanced database system. In: Proc. IEEE BIWIT Workshop. Citeseer (1994)
  7.Bruno, N.: Teaching an old elephant new tricks. arXiv preprint (2009). 0909.鈥?758
  8.El-Helw, A., Ross, K.A., Bhattacharjee, B., Lang, C.A., Mihaila, G.A.: Column-oriented query processing for row stores. In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, pp. 67鈥?4. ACM (2011)
  9.Ferreira, M.C.: Compression and query execution within column oriented databases. Ph.D. thesis, Massachusetts Institute of Technology (2005)
  10.Hall, A., Bachmann, O., B眉ssow, R., G膬nceanu, S., Nunkesser, M.: Processing a trillion cells per mouse click. Proceedings of the VLDB Endowment 5(11), 1436鈥?446 (2012)View Article
  11.Harizopoulos, S., Liang, V., Abadi, D.J., Madden, S.: Performance tradeoffs in read-optimized databases. In: Proceedings of the 32nd International Conference on Very Large Data Bases, pp. 487鈥?98. VLDB Endowment (2006)
  12.Jagodits, S.K.G.C.T., Valduriez, H.B.P.: A query processing strategy for the decomposed storage model. In: Proceedings, p. 636. Order from IEEE Computer Society (1987)
  13.Lemire, D., Kaser, O.: Reordering columns for smaller indexes. Information Sciences 181(12), 2550鈥?570 (2011)MathSciNet View Article
  14.Lemire, D., Kaser, O., Gutarra, E.: Reordering rows for better compression: Beyond the lexicographic order. ACM Transactions on Database Systems (TODS) 37(3), 20 (2012)View Article
  15.MacNicol, R., French, B.: Sybase iq multiplex-designed for analytics. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, vol. 30, pp. 1227鈥?230. VLDB Endowment (2004)
  16.Stonebraker, M., Abadi, D.J., Batkin, A., Chen, X., Cherniack, M., Ferreira, M., Lau, E., Lin, A., Madden, S., O鈥橬eil, E., et al.: C-store: a column-oriented dbms. In: Proceedings of the 31st International Conference on Very Large Data Bases, pp. 553鈥?64. VLDB Endowment (2005)
  17.Yu, L., Zhang, Y., Wang, S., Zhang, Q.: Research on simulative column-storage model policy based on row-storage model. J. Comput. Res. Dev. 47, 78鈥?85 (2010)
  
• 作者单位：Meng Huang (18)
  Xiaofeng Qiu (18)
  Shufang Li (18)
  Daowei Liu (19)
  
  18. Beijing University of Posts and Telecommunications, Beijing, 100876, China
  19. China Electric Power Research Institute, Beijing, 100192, China
  
• 丛书名：Big Data Computing and Communications
• ISBN：978-3-319-22047-5
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

Column-stores have achieved significant improvement over row-oriented databases and various light-weight compression schemes make this architecture more efficient. However these performance benefits cannot be utilized directly by most relational DBMSs though they still occupy the largest share of database market. In this paper we explore the potential of row-stores by simulating column-store within a traditional engine and additionally introduce light-weight compression algorithms that are commonly used in column-stores. Besides we propose a novel light-weight algorithm in the context of simulative column-store. Experimental analysis demonstrates that these optimization techniques bring encouraging performance gains in certain OLAP query scenarios.