Subscription-based data aggregation techniques for top-k monitoring queries
详细信息 查看全文
- 作者：Kamalas Udomlamlert ; Takahiro Hara ; Shojiro Nishio
- 关键词：Distributed databases ; Query processing ; Top ; k query ; Monitoring query ; Publish ; subscribe system
- 刊名：World Wide Web
- 出版年：2017
- 出版时间：March 2017
- 年：2017
- 卷：20
- 期：2
- 页码：237-265
- 全文大小：
- 刊物类别：Computer Science
- 刊物主题：Information Systems Applications (incl.Internet); Database Management; Operating Systems;
- 出版者：Springer US
- ISSN：1573-1413
- 卷排序：20
文摘
With the increase of data generation in distributed fashions such as peer-to-peer systems and sensor networks, top-k query processing which is a way to aggregate only a small set of data that sufficiently satisfies many users’ preferences, becomes a substantial issue. When data are periodically updated in each epoch e.g., weather information, without any techniques, a naive solution is to aggregate all data and their updates to ensure the completeness of final answers, however, it is too costly in terms of data transfer especially for data aggregator nodes (intermediate nodes). In this paper, we propose a top-k monitoring query processing method in 2-tier distributed systems based on a publish-subscribe scheme. A set of top-k subscriptions specifying summary scope of users’ interests is informed to aggregators to limit the number of transferred data records for each epoch. In addition, instead of issuing subscriptions of all queries, our method identifies a small set of minimal subscriptions as well as utilizes some adaptive heuristic rules to efficiently maintain those subscriptions resulting in lower communication overhead. Our experiments through both synthetic and real datasets show that our technique is efficient and outperforms other comparative reactive methods.