Optimizing disk storage to support statistical analysis operations

详细信息    查看全文

• 作者：Parrish ; Allen ; Vrbsky ; Susan ; Dixon ; Brandon ; Ni ; Weigang
• 关键词：Database systems ; Data warehouses ; Statistical tools ; Business intelligence tools ; Data mining
• 刊名：Decision Support Systems
• 出版年：2005
• 出版时间：January, 2005
• 年：2005
• 卷：38
• 期：4
• 页码：621-628
• 全文大小：249 K

文摘

Data stored in spreadsheets and relational database tables can be viewed as “worksheets” consisting of rows and columns, with rows corresponding to records. Correspondingly, the typical practice is to store the data on disk in row major order. While this practice is reasonable in many cases, it is not necessarily the best practice when computation is dominated by column-based statistics. This short note discusses the performance tradeoffs between row major and column major storage of data in the context of statistical data analysis. A comparison of a software package utilizing column major storage and one using row major storage confirms our results.