基于概率生成模型的相似度建模技术研究及应用
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
互联网上海量的内容和资源给人们生活带来了便利,与此同时,也带来了信息超载的负面影响。如何通过数据挖掘技术解决信息过载问题掀起了学术界和工业界的一股研究狂潮,其中基于相似度建模技术的以下两大方案应运而生:(1)将资源按照内容相似性进行归类组织管理;(2)基于在线行为的用户相似性建模,从而实现个性化的服务。然而,针对这些应用的相似度建模技术面临着共同的挑战:变量之间存在的内在结构关系需要被挖掘并利用,数据空间高维稀疏的困扰需要被消除。为此,本文开展了基于概率生成模型的相似度建模技术研究及应用。主要成果及贡献如下:
     首先,提出了基于概率生成模型的标签间结构关系表示方法,设计了基于内容相似性的文本多标签分类方法。文本多标签分类问题中,类别标签存在多种结构关系,然而以往的研究工作一般仅关注成对标签关系的建模,从而影响分类效果。鉴于此,为了能够学习并利用多标签间的高阶关系,本文提出了L-F-L-PAM四层概率生成模型,通过统一的框架建模类别标签上的单词概率分布以及类别之间的相关性,并给出了基于L-F-L-PAM的多标签分类算法。具体而言,在训练阶段,应用L-F-L-PAM建模已标注的训练文档并推理模型的参数,在测试阶段,基于标准的Four-Level Pachinko Allocation Model预测未标记测试文档的类别标签排序。为了提高测试阶段的运行效率,本文还提出了剪枝的Gibbs抽样算法用于测试数据模型推导。最后在大量标准数据集上的实验结果表明,该方法比基准方法取得了更好的类别排序预测结果。
     其次,提出了基于概率生成模型的移动用户行为习惯相似性建模方法。移动设备感知的用户丰富情境数据为更精准地刻画用户的行为习惯提供了可能。现有的相关研究工作主要集中在建模用户的位置和时间情境,而忽略了其它一些有意义的情境。尽管也有一些工作研究基于丰富情境的行为习惯挖掘方法(比如,行为模式挖掘),然而如何针对挖掘的结果建模用户相似性方面的研究较少。鉴于此,本文探索了基于行为模式向量的移动用户相似性建模方案,并针对行为模式空间的高维稀疏问题,提出了一个两阶段的解决方法。具体而言,首先在行为模式挖掘之前,将位置情境抽象到社会位置中以及将交互记录转换成交互类别,从而规范化原始的情境日志,并在规范化后的情境日志上挖掘用户行为模式,然后采用了一个概率生成模型将用户从高维稀疏行为模式空间转化到低维可解释的超级行为模式空间。最后,同基准方法相比,在真实数据集上的实验结果表明该方法能够更精准地发现行为习惯相似的用户。
     最后,提出了一个融合多重相似信息(用户行为习惯相似性和App类别相似性)的移动App推荐算法。本文的前两个工作表明,结合用户的情境感知行为习惯有利于理解用户兴趣;将资源进行类别分析可以帮助充分了解资源特性。基于此发现,本文基于用户使用App历史日志构建用户-App偏好矩阵,提出了一个情境感知的移动App偏好预测模型实现排序推荐。该模型在传统的PMF协同过滤推荐算法框架中,有效结合了用户的情境感知行为模式空间相似性和App的类别相似性信息。在真实数据集上的实验分析表明该技术方案提高了排序推荐效果。
With the rapid development of current internet, huge amounts of resources can be utilized to improve human's life. However, it also causes the problem of information overload. How to deal with the information overload problem has been becoming one of the focused topics in academia and industry. To solve this problem, different data mining techniques were widely studied and applied recent-ly. Along this line, two most important methods based on similarity modeling were proposed:(1) classification and management of resources based on content similarity;(2) user similarity modeling based on online behaviors that provides personalized services. However, there are still several important challenges should be addressed for improving the existing work:how to model the inner structure among variables, and how to eliminate the negative effect of sparse data in a high-dimensional space. Consequently, we launch a study on the topic of simi-larity modeling techniques and its applications based on probability generation model. The contributions could be summarized as follows:
     Firstly, we propose a generative model to capture correlations among mul-tiple labels, and design a multi-label document classification algorithm. Recent years have witnessed a considerable surge of interest in the multi-label learning problem. It has been shown that a key factor for a successful multi-label learn-ing algorithm is to effectively exploit relations between labels. However, most of the previous work exploiting label relations focuses on pairwise relations. To handle the situations where there are intrinsic correlations among multiple labels, we apply the proposed model L-F-L-PAM for inferring the training data and the standard Four-Level Pachinko Allocation model for the test data. Furthermore, we propose a pruned Gibbs Sampling algorithm in the test stage to reduce the inference time. Finally, extensive experiments have been performed to validate the effectiveness and efficiency of our new approach in label ranking performance. The results demonstrate significant improvements of our model over Labeled L-DA (L-LDA), and superioriority in terms of both effectiveness and computational efficiency over other high-performing multi-label learning methods.
     Secondly, we propose a generative model based method for mobile user sim-ilarity mining with respect to their habits. Recently, the progressing ability of sensing user contexts of smart mobile devices makes it possible to discover mobile users with similar habits by mining their habits from their context-rich device logs. However, though some researchers have proposed effective methods for min-ing user habits such as behavior pattern mining, how to leverage the mined results for user similarity mining remains less explored. To this end, we propose a novel approach for conquering the sparseness of behavior pattern space and thus make it possible to discover similar mobile users with respect to their habits by leverag-ing behavior pattern mining. To be specific, first, we normalize the raw context log of each user by transforming the location-based context data and user inter-action records to more general representations. Second, we take advantage of a constraint-based Bayesian Matrix Factorization generative model for extracting the latent common habits among behavior patterns and then transforming be-havior pattern vectors to the vectors of mined common habits which are in a much more dense space. The extensive experiments conducted on real data sets show that our approach outperforms three baselines in terms of the effectiveness of discovering similar mobile users with respect to their habits.
     Last, we design a context-aware App recommendation algorithm, which in-tegrates information of users' similarity with respect to their habits and Apps' category similarity. Our previous work has shown that users'context-aware be-havior habit and Apps' category information may provide very useful information for App recommendation, since the two kind of information might make better understanding of users' preferences. Along this line, we propose a matrix fac-torization framework, to seamlessly integrate the users' habit information and Apps'category information into the collaborative filtering procedure. Experi-mental results conducted on real data sets demonstrate that our approach can achieve better recommendation performance than other baselines.
引文
[1]G W. Information overload. Communications International,1995,22(1):55-58.
    [2]陈雨彤.信息焦虑症:新世纪的时髦病.医药世界,2001,(1):40.
    [3]张光鉴.相似论.江苏科学技术出版社,1992.
    [4]Beyer K S, Goldstein J, Ramakrishnan R, et al. When is "nearest neighbor" meaningful? Pro-ceedings of Proceedings of the 7th International Conference on. Database Theory,1999.217-235.
    [5]Tammel A. How to survive as an ISP. Proceedings of Proceedings of Networld Interop, volume 97, 1997.
    [6]Page L, Brin S, Motwani R, et al. The PageRank citation ranking:bringing order to the web. 1999..
    [7]刘建国,周涛,汪秉宏.个性化推荐系统的研究进展.自然科学进展,2009,19(1):1-15.
    [8]Basili R, Moschitti A. Automatic text categorization. Aracne,2005.
    [9]Sebastiani F. A tutorial on automated text categorisation. Proceedings of Proceedings of ASAI-99, 1st Argentinian Symposium on Artificial Intelligence. Buenos Aires, AR,1999.7-35.
    [10]林洋港.概率主题模型在文本分类中的应用研究[M].中国科学技术大学,2009.
    [11]Cho J, Shivakumar N, Garcia-Molina H. Finding replicated web collections. Proceedings of ACM SIGMOD Record, volume 29. ACM,2000.355-366,
    [12]Tsoumakas G, Katakis I, Vlahavas I. Effective and efficient multilabel classification in domains with large number of labels. Proceedings of Proc. ECML/PKDD 2008 Workshop on Mining Multidimensional Data (MMD'08),2008.30-44.
    [13]Boutell M R, Luo J, Shen X, et al. Learning multi-label scene classification. Pattern recognition, 2004,37(9):1757-1771.
    [14]Read J. A pruned problem transformation method for multi-label classification. Proceedings of Proc.2008 New Zealand Computer Science Research Student Conference (NZCSRS 2008),2008. 143-150.
    [15]Hullermeier E, Furnkranz J, Cheng W, et al. Label ranking by learning pairwise preferences. Artificial Intelligence,2008,172(16):1897-1916.
    [16]Fiirnkranz J, Hullermeier E, Mencia E L, et al. Multilabel classification via calibrated label ranking. Machine Learning,2008,73(2):133-153.
    [17]Mencia E L, Furnkranz J. Pairwise learning of multilabel classifications with perceptrons. Pro-ceedings of Neural Networks,2008. IJCNN 2008.(IEEE World Congress on Computational Intel-ligence). IEEE International Joint Conference on. IEEE,2008.2899-2906.
    [18]Clare A, King R D. Knowledge discovery in multi-label phenotype data. Proceedings of Principles of Data Mining and Knowledge Discovery. Springer,2001:42-53.
    [19]Tsoumakas G, Vlahavas I. Random k-labelsets:An ensemble method for multilabel classification. Proceedings of Machine Learning:ECML 2007. Springer,2007:406-417.
    [20]Godbole S, Sarawagi S. Discriminative methods for multi-labeled classification. Proceedings of Advances in Knowledge Discovery and Data Mining. Springer,2004:22-30.
    [21]Ji S, Tang L, Yu S, et al. Extracting shared subspace for multi-label classification. Proceedings of Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2008.381-389.
    [22]Yan R, Tesic J, Smith J R. Model-shared subspace boosting for multi-label classification. Proceed-ings of Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2007.834-843.
    [23]Kirchmeyer C. Demographic similarity to the work group:A longitudinal study of managers at the early career stage. Journal of Organizational Behavior,1995,16(1):67-83.
    [24]Li Q, Zheng Y, Xie X, et al. Mining user similarity based on location history. Proceedings of GIS, 2008.34.
    [25]Xiao X, Zheng Y, Luo Q, et al. Finding similar users using category-based location history. Proceedings of GIS,2010.442-445.
    [26]Ying J J C, Lu E H C, Lee W C, et al. Mining user similarity from semantic trajectories. Proceedings of GIS-LBSN,2010.19-26.
    [27]Karatzoglou A, Amatriain X, Baltrunas L, et al. Multiverse recommendation:n-dimensional tensor factorization for context-aware collaborative filtering. Proceedings of RecSys,2010.79-86.
    [28]Cao H, Bao T, Yang Q, et al. An effective approach for mining mobile user habits. Proceedings of Proceedings of the 19th ACM Conference on Information and Knowledge Management (CIKM'10), 2010.1677-1680.
    [29]Ma H, Zhou D, Liu C, et al. Recommender systems with social regularization. Proceedings of Proceedings of the fourth ACM international conference on Web search and data mining, ACM, 2011.287-296.
    [30]Ma H, King I, Lyu M R. Learning to recommend with social trust ensemble. Proceedings of Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval. ACM,2009.203-210.
    [31]Bedi P, Kaur H, Marwaha S. Trust based recommender system for semantic web. Proceedings of. proceedings of the 2007 International Joint Conferences on Artificial Intelligence,2007.2677-2682.
    [32]Zhen Y, Li W, Yeung D. TagiCoFi:tag informed collaborative filtering. Proceedings of Proceed-ings of the third ACM conference on Recommender systems. ACM,2009.69-76.
    [33]Woerndl W, Schueller C, Wbjtech R. A hybrid recommender system for context-aware recom-mendations of mobile applications. Proceedings of Data Engineering Workshop,2007 IEEE 23rd International Conference on. Ieee,2007.871-878.
    [34]Karatzoglou A, Baltrunas L, Church K, et al. Climbing the app wall:enabling mobile app discovery through context-aware recommendations. Proceedings of Proceedings of the 21st ACM international conference on Information and knowledge management. ACM,2012.2527-2530.
    [35]Dumais S T. Latent semantic analysis. Annual review of information science and technology, 2004,38(1):188-230.
    [36]Hofmann T. Probabilistic latent semantic analysis. Proceedings of Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc.,1999. 289-296.
    [37]Blei D, Ng A, Jordan M. Latent dirichlet allocation. The Journal of Machine Learning Research, 2003,3:993-1022.
    [38]Aas K, Eikvil L. Text categorisation:A survey,1999.
    [39]Joachims T. A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categoriza-tion. Technical report, DTIC Document,1996.
    [40]Duda R O, Hart P E, et al. Pattern classification and scene analysis, volume 3. Wiley New York, 1973.
    [41]Joachims T. Text categorization with support vector machines:Learning with many relevant features. Springer,1998.
    [42]Schapire R E, Singer Y. Improved boosting algorithms using confidence-rated predictions. Machine learning,1999,37(3):297-336.
    [43]Zhang M L, Zhou Z H. ML-KNN:A lazy learning approach to multi-label learning. Pattern Recognition,2007,40(7):2038-2048.
    [44]Crammer K, Singer Y. On the algorithmic implementation of multiclass kernel-based vector machines. The Journal of Machine Learning Research,2002,2:265-292.
    [45]Zhang M L, Zhou Z H. Multilabel neural networks with applications to functional genomic-s and text categorization. Knowledge and Data Engineering, IEEE Transactions on,2006, 18(10):1338-1351.
    [46]McCallum A. Multi-label text classification with a mixture model trained by EM. Proceedings of AAAI'99 Workshop on Text Learning,1999.1-7.
    [47]Ueda N, Saito K. Parametric mixture models for multi-labeled text. Advances in neural informa-tion processing systems,2002,15:721-728.
    [48]Streich A P, Buhmann J M. Classification of multi-labeled data:A generative approach. Pro-ceedings of Machine Learning and Knowledge Discovery in Databases. Springer,2008:390-405.
    [49]Ramage D, Hall D, Nallapati R, et al. Labeled LDA:A supervised topic model for credit attribution in multi-labeled corpora. Proceedings of Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing:Volume 1-Volume 1. Association for Computational Linguistics, 2009.248-256.
    [50]Srivastava J, Cooley R, Deshpande M, et al. Web usage mining:Discovery and applications of usage patterns from web data. ACM SIGKDD Explorations Newsletter,2000, 1(2):12-23.
    [51]Cooley R W. Web usage mining:discovery and application of interesting patterns from web data[D]. University of Minnesota,2000.
    [52]Hussain T, Asghar S, Masood N. Web usage mining:A survey on preprocessing of web log file. Proceedings of Information and Emerging Technologies (ICIET),2010 International Conference on. IEEE,2010.1-6.
    [53]Schilit B, Adams N, Want R. Context-aware computing applications. Proceedings of Mobile Computing Systems and Applications,1994. WMCSA 1994. First Workshop on,1994.85-90.
    [54]Agrawal R, Srikant R, et al. Fast algorithms for mining association rules. Proceedings of Proc. 20th Int. Conf. Very Large Data Bases, VLDB, volume 1215,1994.487-499.
    [55]Wang J, Zeng C, He C, et al. Context-aware role mining for mobile service recommendation. Proceedings of Proceedings of the 27th Annual ACM Symposium on Applied Computing. ACM, 2012.173-178.
    [56]Lu E, Lee W, Tseng V. A Framework for Personal Mobile Commerce Pattern Mining and Pre-diction. Knowledge and Data Engineering, IEEE Transactions on,2011, (99):1-1.
    [57]Monreale A, Pinelli F, Trasarti R, et al. WhereNext:a location predictor on trajectory pat-tern mining. Proceedings of Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2009.637-646.
    [58]Baralis E, Cagliero L, Cerquitelli T, et al. CAS-Mine:providing personalized services in context-aware applications by means of generalized rules. Knowledge and Information Systems,2011, 28(2):283-310.
    [59]Mabroukeh N, Ezeife C. A taxonomy of sequential pattern mining algorithms. ACM Computing Surveys (CSUR),2010,43(1):3.
    [60]Giannotti F, Nanni M, Pinelli F, et al. Trajectory pattern mining. Proceedings of Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2007.330-339.
    [61]Li Z, Ding B, Han J, et al. Mining periodic behaviors for moving objects. Proceedings of Pro-ceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2010.1099-1108.
    [62]Zheng Y, Zha Z, Chua T. Mining Travel Patterns from Geotagged Photos. ACM Transactions on Intelligent Systems and Technology (TIST),2012,3(3):56.
    [63]Singh A, Gordon G. A unified view of matrix factorization models. Machine Learning and Knowledge Discovery in Databases,2008.358-373.
    [64]Ma'H, Zhou T, Lyu M, et al. Improving recommender systems by incorporating social contextual information. ACM Transactions on Information Systems (TOIS),2011,29(2):9.
    [65]Ma H, King I, Lyu M. Learning to recommend with explicit and implicit social relations. ACM Transactions on Intelligent Systems and Technology (TIST),2011,2(3):29.
    [66]Zheng V W, Zheng Y, Xie X, et al. Collaborative location and activity recommendations with GPS history data. Proceedings of Proceedings of the 19th international conference on World wide web. ACM,2010.1029-1038.
    [67]Baltrunas.L, Ludwig B, Ricci F. Matrix factorization techniques for context aware recommenda-tion. Proceedings of Proceedings of the fifth ACM conference on Recommender systems. ACM, 2011.301-304.
    [68]Yu K, Zhang B, Zhu H, et al. Towards personalized context-aware recommendation by mining context logs through topic models. Advances in Knowledge Discovery and Data Mining,2012. 431-443.
    [69]Bao T, Cao H, Chen E, et al. An unsupervised approach to modeling personalized contexts of mobile users. Knowledge and information systems,2012,31(2):345-370.
    [70]Liu Q, Ge Y, Li Z, et al. Personalized Travel Package Recommendation. Proceedings of Data Mining (ICDM),2011 IEEE 11th International Conference on,2011.407-416.
    [71]Yuan J, Zheng Y, Xie X. Discovering regions of different functions in a city using human mobility and pois. KDD?2,2012..
    [72]Czarnowski I. Cluster-based instance selection for machine classification. Knowledge and infor-mation systems,2012,30(1):113-133.
    [73]Zhu H, Cao H, Chen E, et al. Exploiting enriched contextual information for mobile app classifi-cation. Proceedings of Proceedings of the 21st ACM international conference on Information and knowledge management. ACM,2012.1617-1621.
    [74]Zheng Y, Zhang L, Xie X, et al. Mining interesting locations and travel sequences, from GPS trajectories. Proceedings of Proceedings of the 18th international conference on World wide web. ACM,2009.791-800.
    [75]Leung K, Lee D, Lee W. Clr:a collaborative location recommendation framework based on co-clustering. Proceedings of Proceedings of the 34th international ACM SIGIR conference on Research and development in Information. ACM,2011.305-314.
    [76]Pelekis N, Kopanakis I, Kotsifakos E, et al. Clustering uncertain trajectories. Knowledge and Information Systems,2011,28(1):117-147.
    [77]Wang Y, Cong G, Song G, et al. Community-based greedy algorithm for mining top-k influ-ential nodes in mobile social networks. Proceedings of Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2010.1039-1048.
    [78]Ge Y, Xiong H, Tuzhilin A, et al. An energy-efficient mobile recommender system. Proceedings of Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2010.899-908.
    [79]Yuan J, Zheng Y, Zhang L, et al. Where to find my next passenger. Proceedings of Proceedings of the 13th international conference on Ubiquitous computing. ACM,2011.109-118.
    [80]Lu E, Tseng V, Yu P. Mining cluster-based temporal mobile sequential patterns in location-based service environments. Knowledge a.nd Data Engineering, IEEE Transactions on,2010, (99):1-1.
    [81]Zheng Y, Liu L, Wang L, et al. Learning transportation mode from raw gps data for geographic applications on the web. Proceedings of Proceedings of the 17th international conference on World Wide Web. ACM,2008.247-256.
    [82]Ye M, Shou D, Lee W, et al. On the semantic annotation of places in location-based social networks. Proceedings of Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2011.520-528.
    [83]Li X, Cao H, Chen E, et al. Learning to Infer the Status of Heavy-Duty Sensors for Energy-Efficient Context-Sensing. ACM Transactions on Intelligent Systems and Technology (TIST), 2012,3(2):35.
    [84]Baldauf M, Dustdar S, Rosenberg F. A survey on context-aware systems. International Journal of Ad Hoc and Ubiquitous Computing,2007,2(4):263-277.
    [85]Adomavicius G, Tuzhilin A. Toward the next generation of recommender systems:A survey of the state-of-the-art and possible extensions. Knowledge and Data Engineering, IEEE Transactions on,2005,17(6):734-749.
    [86]Mooney R, Roy L. Content-based book recommending using learning for text categorization. Proceedings of Proceedings of the fifth ACM conference on Digital libraries. ACM,2000.195-204.
    [87]Resnick P, Iacovou N, Suchak M, et al. GroupLens:an open architecture for collaborative filtering of netnews. Proceedings of Proceedings of the 1994 ACM conference on Computer supported cooperative work. ACM,1994.175-186.
    [88]Linden G, Smith B, York J. Amazon, com recommendations:Item-to-item collaborative filtering. Internet Computing, IEEE,2003,7(1):76-80.
    [89]Fouss F, Pirotte A, Renders J, et al. Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. Knowledge and Data Engineering, IEEE Transactions on,2007,19(3):355-369.
    [90]Song X, Tseng B, Lin C, et al. Personalized recommendation driven by information flow. Pro-ceedings of Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval. ACM,2006.509-516.
    [91]Koren Y, Bell R, Volinsky C. Matrix factorization techniques for recommender systems. Computer, 2009,42(8):30-37.
    [92]Salakhutdinov R, Mnih A. Probabilistic matrix factorization. Advances in neural information processing systems,2008,20:1257-1264.
    [93]Luo X, Ouyang Y, Zhang X. Improving Matrix Factorization-Based Recommender via En-semble Methods. International Journal of Information Technology and Decision Making,2011, 10(3):539-561.
    [94]Leite Dantas Bezerra B, Carvalho F. Symbolic data analysis tools for recommendation systems. Knowledge and Information Systems,2011,26(3):385-418.
    [95]Koren Y. Collaborative filtering with temporal dynamics. Communications of the ACM,2010, 53(4):89-97.
    [96]Muhlestein D, Lim S. Online learning with social computing based interest sharing. Knowledge and information systems,2011,26(1):31-58.
    [97]Wang J, Zhang Y. Utilizing marginal net utility for recommendation in e-commerce. Proceedings of Proceedings of the 34th international ACM SIGIR conference on Research and development in Information. ACM,2011.1003-1012.
    [98]Quercia D, Capra L. FriendSensing:recommending friends using mobile phones. Proceedings of Proceedings of the third ACM conference on Recommender systems. ACM,2009.273-276.
    [99]Zheng Y, Xie X. Learning travel recommendations from user-generated gps traces. ACM Trans-actions on Intelligent Systems and Technology (TIST),2011,2(1):2.
    [100]Ricci F. Mobile recommender systems. Information Technology &; Tourism,2011,12(3):205-231.
    [101]Ge Y, Liu Q, Xiong H, et al. Cost-aware travel tour recommendation. SIGKDD, San Diego, CA, 2011..
    [102]Saleh B, Masseglia F. Discovering frequent behaviors:time is an essential element of the context. Knowledge and Information Systems,2011,28(2):311-331.
    [103]Yuan J, Zheng Y, Zhang C, et al. T-drive:driving directions based on taxi trajectories. Proceedings of Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems,2010.99-108.
    [104]Adomavicius G, Tuzhilin A. Context-aware recommender systems. Recommender Systems Hand-book,2011.217-253.
    [105]Abowd G, Atkeson C, Hong J, et al. Cyberguide:A mobile context-aware tour guide. Wireless networks,1997,3(5):421-433.
    [106]Van Setten M, Pokraev S, Koolwaaij J. Context-aware recommendations in the mobile tourist application COMPASS. Proceedings of Adaptive Hypermedia and Adaptive Web-Based Systems. Springer,2004.515-548.
    [107]Zheng V W, Cao B, Zheng Y, et al. Collaborative filtering meets mobile recommendation:A user-centered approach. Proceedings of Proceedings of the 24rd AAAI Conference on Artificial Intelligence,2010.
    [108]Panniello U, Tuzhilin A, Gorgoglione M, et al. Experimental comparison of pre-vs. post-filtering approaches in context-aware recommender systems. Proceedings of Proceedings of the third ACM conference on Recommender systems. ACM,2009.265-268.
    [109]Zhu H, Yu K, Cao H, et al. Mining Personal Context-Aware Preferences for Mobile Users. Pro-ceedings of the 2012 IEEE International Conference on Data Mining,2012..
    [110]Scellato S, Noulas A, Mascolo C. Exploiting place features in link prediction on location-based social networks. Proceedings of Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2011.1046-1054.
    [111]Cena F, Console L, Gena C, et al. Integrating heterogeneous adaptation techniques to build a flexible and usable mobile tourist guide. Al Communications,2006,19(4):369-384.
    [112]Averjanova O, Ricci F, Nguyen Q. Map-based interaction with a conversational mobile recom-mender system. Proceedings of Mobile Ubiquitous Computing, Systems, Services and Technolo-gies,2008. UBICOMM'08. The Second International Conference on. IEEE,2008.212-218.
    [113]Ricci F, Nguyen Q. Mobyrek:A conversational recommender system for on-the-move travelers. Destination Recommendation Systems:Behavioural Foundations and Applications,2006.281-294.
    [114]Lawrence R, Almasi G, Kotlyar V, et al. Personalization of supermarket product recommendations. Data Mining and Knowledge Discovery,2001,5(1):11-32.
    [115]Yang B, Sun J T, Wang T, et al. Effective multi-label active learning for text classification. Proceedings of Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2009.917-926.
    [116]Xue X B, Zhou Z H. Distributional features for text categorization. Knowledge and Data Engi-neering, IEEE Transactions on,2009,21(3):428-442.
    [117]Yang Y. An evaluation of statistical approaches to text categorization. Information retrieval, 1999, 1(1-2):69-90.
    [118]Wang H, Huang M, Zhu X. A generative probabilistic model for multi-label classification. Pro-ceedings of Data Mining,2008. ICDM'08. Eighth IEEE International Conference on. IEEE,2008. 628-637.
    [119]Zhu S, Ji X, Xu W, et al. Multi-labelled classification using maximum entropy method. Pro-ceedings of Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval. ACM,2005.274-281.
    [120]Schapire R E, Singer Y. BoosTexter:A boosting-based system for text categorization. Machine learning,2000,39(2-3):135-168.
    [121]Elisseeff A, Weston J. A kernel method for multi-labelled classification. Advances in neural information processing systems,2001,14:681-687.
    [122]Ghamrawi N, McCallum A, Collective multi-label classification. Proceedings of Proceedings of the 14th ACM international conference on Information and knowledge management. ACM,2005. 195-200.
    [123]Zhang M L, Zhang K. Multi-label learning by exploiting label dependency. Proceedings of Pro-ceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2010.999-1008.
    [124]Read J, Pfahringer B, Holmes G, et al. Classifier chains for multi-label classification. Proceedings of Machine Learning and Knowledge Discovery in Databases. Springer,2009:254-269.
    [125]Park S H, Furnkranz J. Multi-label classification with label constraints. Proceedings of Proceed-ings of the ECML PKDD 2008 Workshop on Preference Learning (PL 2008), Antwerp, Belgium, 2008.157-171.
    [126]Li W, McCallum A. Pachinko allocation:DAG-structured mixture models of topic correlations. Proceedings of Proceedings of the 23rd international conference on Machine learning. ACM,2006. 577-584.
    [127]Krishnan V. Short comings of latent models in supervised settings. Proceedings of Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval. ACM,2005.625-626.
    [128]Blei D M, McAuliffe J D. Supervised topic models. arXiv preprint arXiv:1003.0783,2010..
    [129]Lacoste-Julien S, Sha F, Jordan M I. DiscLDA:Discriminative learning for dimensionality re-duction and classification. Advances in Neural Information Processing Systems (NIPS),2008, 21.
    [130]Buntine W L. Operations for learning with graphical models. arXiv preprint cs/9412102,1994..
    [131]Griffiths T L, Steyvers M. Finding scientific topics. Proceedings of the National academy of Sciences of the United States of America,2004,101(Suppl 1):5228-5235.
    [132]Casella G, Berger R L. Statistical inference, volume 70. Duxbury Press Belmont, CA,1990.
    [133]Lewis D D, Yang Y, Rose T G, et al. Rcvl:A new benchmark collection for text categorization research. The Journal of Machine Learning Research,2004,5:361-397.
    [134]Ueda N, Saito K. Single-shot detection of multiple categories of text using parametric mixture models. Proceedings of Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2002.626-631.
    [135]Kazawa H, Izumitani T, Taira H, et al. Maximal margin labeling for multi-topic text categoriza-tion. Advances in neural information processing systems,2005,17:649-656.
    [136]Liu Q, Chen E, Xiong H, et al. Exploiting user interests for collaborative filtering:interests . expansion via personalized ranking. Proceedings of Proceedings of the 19th ACM international conference on Information and knowledge management. ACM,2010.1697-1700.
    [137]Chang C C, Lin C J. LIBSVM:a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST),2011,2(3):27.
    [138]Garcia S, Herrera F. An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons. Journal of Machine Learning Research,2008,9(2677-2694):66.
    [139]Das A, Datar M, Garg A, et al. Google news personalization:scalable online collaborative filtering. Proceedings of WWW,2007.271-280.
    [140]Zheng Y, Zhang L, Ma Z, et al. Recommending friends and locations based on individual location history. TWEB,2011,5(1):5.
    [141]Zhou K Y, Mobasher B. Web user segmentation based on a mixture of factor Analyzers. Proceed-ings of Proceedings of the 7th International Conference on E-Commerce and Web Technologies (EC-Web'06),2006.11-20.
    [142]Wu X, Yan J, Liu N, et al. Probabilistic latent semantic user segmentation for behavioral tar-geted advertising. Proceedings of KDD Workshop on Data Mining and Audience Intelligence for Advertising,2009.10-17.
    [143]Mobasher B, Dai H, Luo T, et al. Discovery and evaluation of aggregate usage profiles for web personalization. Data Mining and Knowledge Discovery,2002,6:61-82.
    [144]Han J, Pei J, Yin Y, et al. Mining Frequent Patterns without Candidate Generation:A Frequent-Pattern. Tree Approach. Data Min. Knowl. Discov.,2004,8(1):53-87.
    [145]Schmidt M. Linearly constrained Bayesian matrix factorization for blind source separation. In: Bengio Y, Schuurmans D, Lafferty J, et al., (eds.). Proceedings of Advances in Neural Information Processing Systems 22.2009:1624-1632.
    [146]Hopfgartner F, Jose J M. Semantic user profiling techniques for personalised multimedia recom-mendation. Multimedia Syst.,2010,16(4-5):255-274.
    [147]Lu E H C, Tseng V S. Mining Cluster-Based Mobile Sequential Patterns in Location-Based Service Environments. Proceedings of Mobile Data Management,2009.273-278.
    [148]Tseng S M, Tsui C F. An Efficient Method for Mining Associated Service Patterns in Mobile Web Environments. Proceedings of SAC,2003.455-459.
    [149]Tseng S M, Tsui C F. Mining multilevel and location-aware service patterns in mobile web envi-ronments. IEEE Transactions on Systems, Man, and Cybernetics, Part B,2004,34(6):2480-2485.
    [150]Tseng V S, Lin K W. Efficient mining and prediction of user behavior patterns in mobile web systems. Information and Software Technology,2006,48(6):357-369.
    [151]Yang G. Discovering Significant Places from Mobile Phones-A Mass Market Solution. Proceedings of MELT,2009.34-49.
    [152]Laasonen K, Raento M, Toivonen H. Adaptive On-Device Location Recognition. Proceedings of Pervasive, volume 3001,2004.287-304.
    [153]Cao H, Hu D H, Shen D, et al. Context-aware query classification. Proceedings of Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval,2009.3-10.
    [154]Chib S. Marginal Likelihood from the Gibbs Output. Journal of the American Statistical Associ-ation,1995,90(432):1313-1321.
    [155]Jarvelin K, Kekalainen J. IR evaluation methods for retrieving highly relevant documents. Pro-ceedings of SIGIR,2000.41-48.
    [156]Xie M, Lakshmanan L, Wood P. Breaking out of the box of recommendations:from items to packages. Proceedings of Proceedings of the fourth ACM conference on Recommender systems. ACM,2010.151-158.
    [157]Cao H, Jiang D, Pei J, et al. Context-aware query suggestion by mining click-through and session data. Proceedings of KDD,2008.875-883.
    [158]Balabanovic M, Shoham Y. Fab:content-based, collaborative recommendation. Communications of the ACM,1997,40(3):66-72.
    [159]Herlocker J L, Konstan J A, Borchers A, et al. An algorithmic framework for performing col-laborative filtering. Proceedings of Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval. ACM,1999.230-237.
    [160]Gu Q, Zhou J, Ding C. Collaborative filtering:Weighted nonnegative matrix factorization incor-porating user and item graphs. Proceedings of SIAM SDM,2010.199-210.
    [161]Sarwar B, Karypis G, Konstan J, et al. Item-based collaborative filtering recommendation al-gorithms. Proceedings of Proceedings of the 10th international conference on World Wide Web. ACM,2001.285-295.
    [162]Wang J, De Vries A P, Reinders M J. Unifying user-based and item-based collaborative filtering approaches by similarity fusion. Proceedings of Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval. ACM,2006.501-508.
    [163]Hofmann T. Latent semantic models for collaborative filtering. ACM Transactions on Information Systems (TOIS),2004,22(1):89-115.
    [164]Si L, Jin R. Flexible mixture model for collaborative filtering. Proceedings of MACHINE LEARNING-INTERNATIONAL WORKSHOP THEN CONFERENCE-, volume 20,2003.704.
    [165]Srebro N, Jaakkola T. Weighted low-rank approximations. Proceedings of MACHINE LEARNING-INTERNATIONAL WORKSHOP THEN CONFERENCE-, volume 20,2003.720.
    [166]Pennock D M, Horvitz E, Lawrence S, et al. Collaborative filtering by personality diagnosis:A hybrid memory-and model-based approach. Proceedings of Proceedings of the Sixteenth conference on Uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc.,2000.473-480.
    [167]Yang B, Lee S, Park S, et al. Exploiting various implicit feedback for collaborative filtering. Proceedings of Proceedings of the 21st international conference companion on World Wide Web. ACM,2012.639-640.
    [168]Hu Y, Koren Y, Volinsky C. Collaborative filtering for implicit feedback datasets. Proceedings of Data Mining,2008. ICDM'08. Eighth IEEE International Conference on. IEEE,2008.263-272.
    [169]Lee D, Park S, Kahng M, et al. Exploiting contextual information from event logs for personalized recommendation. Computer and Information Science 2010,2010.121-139.
    [170]Wang J, Vries A, Reinders M. A user-item relevance model for log-based collaborative filtering. Advances in Information Retrieval,2006.37-48.
    [171]Takeuchi Y, Sugimoto M. City Voyager:an outdoor recommendation system based on user location history. Proceedings of Ubiquitous intelligence and computing. Springer,2006:625-636.
    [172]Park M, Hong J, Cho S. Location-based, recommendation system using Bayesian user's preference model in mobile devices. Ubiquitous Intelligence and Computing,2007.1130-1139.
    [173]Horozov T, Narasimhan N, Vasudevan V. Using location for personalized POI recommendations in mobile environments. Proceedings of Applications and the Internet,2006. SAINT 2006. Inter-national Symposium on. IEEE,2006.6-pp.
    [174]Bennett P, Radlinski F, White R, et al. Inferring and using location metadata to personalize web search. Proceedings of Proceedings of the 34th international ACM SIGIR conference on Research and development in Information. ACM,2011.135-144.
    [175]Ying J, Lu E, Lee W, et al. Mining user similarity from semantic trajectories. Proceedings of Proceedings of the 2nd ACM SIGSPATIAL International Workshop on Location Based Social Networks. ACM,2010.19-26.
    [176]Wang D, Pedreschi D, Song C, et al. Human mobility, social ties, and link prediction. Proceedings of Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2011.1100-1108.
    [177]Shi K, Ali K. GetJar mobile application recommendations with very sparse datasets. Proceedings of Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2012.204-212.
    [178]Yan B, Chen G. Appjoy:personalized mobile application discovery. Proceedings of Proceedings of the 9th international conference on Mobile systems, applications, and services. ACM,2011. 113-126.
    [179]Koren Y. Factorization meets the neighborhood:a multifaceted collaborative filtering model. Proceedings of Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM,2008.426-434.