基于数据服务的嵌套视图动态更新方法
|
摘要
数据服务屏蔽了数据访问的复杂性,并且支持用户以可视化方式定义装载异构数据源的嵌套视图.然而,当异构数据源输出的数据发生更新时,该更新需要通过数据服务逐层传播到顶层的嵌套视图,一类挑战性问题是,如何减少更新传播过程中的冗余计算,提高嵌套视图的数据新鲜度.为此文中提出了基于数据服务的嵌套视图动态更新方法,该方法利用指针为嵌套视图中的元组建立嵌套任意层次的数据服务的引用,同时给出了一种记录数据服务更新的日志以及在该日志上的嵌套视图增量更新算法.文中在原型系统中实现了该算法并且进行了实验分析,实验结果表明,该方法减少了70%的嵌套视图的更新时间,提高了60%的嵌套视图的数据新鲜度.
Data service hides the complexity of the multi-source and heterogeneous data sources,and helps the implementation of user-steering nested view generation.However,once heterogeneous data sources are updated,the updates must be propagated to the top-level nested views through data services step by step.A challenging problem is how to reduce the redundant computation and improve the data freshness.In this paper,a dynamic update strategy is proposed.The strategy uses the pointer to establish the relationship between the data services and the nested views,and designs the log data structure for data service,and proposes an incremental update algorithm based on the log data structure.Experiments show that our strategy can effectively reduce 70% redundant computation,and improve 60% data freshness.
Data service hides the complexity of the multi-source and heterogeneous data sources,and helps the implementation of user-steering nested view generation.However,once heterogeneous data sources are updated,the updates must be propagated to the top-level nested views through data services step by step.A challenging problem is how to reduce the redundant computation and improve the data freshness.In this paper,a dynamic update strategy is proposed.The strategy uses the pointer to establish the relationship between the data services and the nested views,and designs the log data structure for data service,and proposes an incremental update algorithm based on the log data structure.Experiments show that our strategy can effectively reduce 70% redundant computation,and improve 60% data freshness.
引文
①http://www.tpc.org/tpch/
①http://pipes.yahoo.com/
[1]Carey M J,Onose N,Petropoulos M.Data services.Com-munications of ACM,2012,55(6):86-97
[2]Carey M J.Declarative data services:This is your data on SOA//Proceedings of the IEEE International Conference on Service-Oriented Computing and Applications.California,USA,2007:4
[3]Carey M J.Data delivery in a service oriented world:The BEA AquaLogic data services platform//Proceedings of the ACM SIGMOD.Chicago,USA,2006:695-705
[4]Erwig M.Xing:A visual XML query language.Journal of Visual Languages&Computing,2003,14(1):5-45
[5]Braga D,Campi A,Ceri S.XQBE:A visual interface to the standard XML query language.ACM Transactions on Data-base Systems,2005,30(2):398-443
[6]Altinel M,Brown P,Cline S et al.Damia:A data Mashup fabric for intranet applications//Proceedings of the33rd International Conference on Very Large Data Bases.Vienna,2007:1370-1373
[7]Jones M C,Churchill E F,Twidale M B.Mashing up visual languages and Web Mashups//Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing.Corvallis,USA,2008:143-146
[8]Lin J,Wong J,Nichols J et al.End-user programming of Mashups with vegemite//Proceedings of the13th Interna-tional Conference on Intelligent User Interfaces.Sanibel Island,USA,2009:97-106
[9]Liu B,Jagadish H.A spreadsheet algebra for a direct data manipulation query interface//Proceedings of the International Conference on Data Engineering.Shanghai,China,2009:417-428
[10]Kongdenfha W,Benatallah B,Vayssi J et al.Rapid develop-ment of spreadsheet-based Web Mashups//Proceedings of the International Conference on World Wide Web.Madrid,Spain,2009:851-860
[11]Han Y,Wang G,Ji G,Zhang P.Situational data integration with data services and nested table.Service Oriented Compu-ting and Application,2012,1-22
[12]Di Lorenzo G,Hacid H,Paik H,Benatallah B.Data inte-gration in Mashups.ACM Sigmod Record,2009,38(1):59-66
[13]Gupta A,Mumick I S,Subrahmanian V S.Maintaining views incrementally//Proceedings of the International Con-ference on Management of Data.Washington,USA,1993:157-166
[14]Sheth A P,Larson J A.Federated database systems for managing distributed,heterogeneous,and autonomous data-bases.ACM Computing Surveys,1990,22(3):183-236
[15]Wiederhold G.Mediators in the architecture of future infor-mation systems.Computer Journal,1992,25(3):38-49
[16]Kimball R,Ross M.The Data Warehouse Toolkit:The Complete Guide to Dimensional Modeling.New York:Wiley,2011
[17]Zhang Peng,Wang Gui-Ling,Ji Guang,Liu Chen.Optimi-zation update for data composition view based on data serv-ice.Chinese Journal of Computers,2011,34(12):2344-2354(in Chinese)(张鹏,王桂玲,季光,刘晨.基于数据服务的数据组合视图的优化更新.计算机学报,2011,34(12):2344-2354)
[18]Bramandia R,Cheng J,Choi B,Yu J X.Optimizing updates of recursive XML views of relations.The VLDB Journal,2009,18(6):1313-1333
[19]Michael B,Vinayak B,Michael C.Updates in the AquaLogic data services platform//Proceedings of the ICDE09.Shanghai,China,2009:1431-1442
[20]Shevertalov Maxim,Mancoridis Spiros.On the maintenance of UI-integrated Mashup appliactions//Proceedings of the 27th IEEE International Conference on Software Mainte-nance.Williamsburg,USA,2011:203-212
[21]Chen W,Kifer M,Warren D.HiLog:A first order seman-tics for higher-order logic programming constructs//Proceed-ings of the North American Conference on Logic Program-ming.USA,1989:1090-1114
[22]Hassan O A,Ramaswarny L,Miller J A.Enhancing scal-ability and performance of Mashups through merging and operator reordering//Proceedings of the ICWS.Miami,USA,2010:171-178
①http://pipes.yahoo.com/
[1]Carey M J,Onose N,Petropoulos M.Data services.Com-munications of ACM,2012,55(6):86-97
[2]Carey M J.Declarative data services:This is your data on SOA//Proceedings of the IEEE International Conference on Service-Oriented Computing and Applications.California,USA,2007:4
[3]Carey M J.Data delivery in a service oriented world:The BEA AquaLogic data services platform//Proceedings of the ACM SIGMOD.Chicago,USA,2006:695-705
[4]Erwig M.Xing:A visual XML query language.Journal of Visual Languages&Computing,2003,14(1):5-45
[5]Braga D,Campi A,Ceri S.XQBE:A visual interface to the standard XML query language.ACM Transactions on Data-base Systems,2005,30(2):398-443
[6]Altinel M,Brown P,Cline S et al.Damia:A data Mashup fabric for intranet applications//Proceedings of the33rd International Conference on Very Large Data Bases.Vienna,2007:1370-1373
[7]Jones M C,Churchill E F,Twidale M B.Mashing up visual languages and Web Mashups//Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing.Corvallis,USA,2008:143-146
[8]Lin J,Wong J,Nichols J et al.End-user programming of Mashups with vegemite//Proceedings of the13th Interna-tional Conference on Intelligent User Interfaces.Sanibel Island,USA,2009:97-106
[9]Liu B,Jagadish H.A spreadsheet algebra for a direct data manipulation query interface//Proceedings of the International Conference on Data Engineering.Shanghai,China,2009:417-428
[10]Kongdenfha W,Benatallah B,Vayssi J et al.Rapid develop-ment of spreadsheet-based Web Mashups//Proceedings of the International Conference on World Wide Web.Madrid,Spain,2009:851-860
[11]Han Y,Wang G,Ji G,Zhang P.Situational data integration with data services and nested table.Service Oriented Compu-ting and Application,2012,1-22
[12]Di Lorenzo G,Hacid H,Paik H,Benatallah B.Data inte-gration in Mashups.ACM Sigmod Record,2009,38(1):59-66
[13]Gupta A,Mumick I S,Subrahmanian V S.Maintaining views incrementally//Proceedings of the International Con-ference on Management of Data.Washington,USA,1993:157-166
[14]Sheth A P,Larson J A.Federated database systems for managing distributed,heterogeneous,and autonomous data-bases.ACM Computing Surveys,1990,22(3):183-236
[15]Wiederhold G.Mediators in the architecture of future infor-mation systems.Computer Journal,1992,25(3):38-49
[16]Kimball R,Ross M.The Data Warehouse Toolkit:The Complete Guide to Dimensional Modeling.New York:Wiley,2011
[17]Zhang Peng,Wang Gui-Ling,Ji Guang,Liu Chen.Optimi-zation update for data composition view based on data serv-ice.Chinese Journal of Computers,2011,34(12):2344-2354(in Chinese)(张鹏,王桂玲,季光,刘晨.基于数据服务的数据组合视图的优化更新.计算机学报,2011,34(12):2344-2354)
[18]Bramandia R,Cheng J,Choi B,Yu J X.Optimizing updates of recursive XML views of relations.The VLDB Journal,2009,18(6):1313-1333
[19]Michael B,Vinayak B,Michael C.Updates in the AquaLogic data services platform//Proceedings of the ICDE09.Shanghai,China,2009:1431-1442
[20]Shevertalov Maxim,Mancoridis Spiros.On the maintenance of UI-integrated Mashup appliactions//Proceedings of the 27th IEEE International Conference on Software Mainte-nance.Williamsburg,USA,2011:203-212
[21]Chen W,Kifer M,Warren D.HiLog:A first order seman-tics for higher-order logic programming constructs//Proceed-ings of the North American Conference on Logic Program-ming.USA,1989:1090-1114
[22]Hassan O A,Ramaswarny L,Miller J A.Enhancing scal-ability and performance of Mashups through merging and operator reordering//Proceedings of the ICWS.Miami,USA,2010:171-178