主题模型及其在中医临床诊疗中的应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
主题模型(Topic Model)能够提取隐含在文档(或其它离散数据集)中的主题,其中每个主题是语义相关的词上的多项式分布。主题模型的主要目的是提取数据集中隐含的统计规律且利用主题进行直观表达,然后可以利用获得的主题进行信息检索、分类、聚类、摘要提取以及进行信息间相似性、相关性判断等一系列应用。近年来,主题模型已逐渐成为文本挖掘、信息检索等领域的一个新的研究方向。
     中国传统医学(简称中医)作为传统生命科学的一个重要组成部分,在疾病诊疗方面具有特色和显著的临床疗效。几千年的中医诊疗实践积累了大量的临床数据,这些数据中包含着丰富的符合中医理论的知识与规律。在中医信息化建设的背景下,利用现代化手段挖掘隐藏在这些临床数据中的中医诊疗规律具有重要意义。随着数据挖掘技术的逐渐成熟和广泛应用,利用数据挖掘等手段,分析挖掘中医诊疗规律已逐渐成为国内中医理论研究热点。近年来,研究人员应用聚类分析、关联规则以及回归分析和判别分析等方法研究中医理论,并已取得了一定的研究进展,但是,仍然难以体现中医的语义复杂性特点以及中医诊疗的系统性特点。
     本文首次尝试把主题模型引入中医临床诊疗规律的研究中。使用主题模型的动机是我们不仅认为主题模型能够捕获中医临床诊疗数据集中的语义特征,而且认为主题模型中的主题推理及生成过程与《伤寒论》所述的“观其脉症,知犯何逆,随证治之”的中医辨证论治过程基本一致,都是由显变量到隐变量再到显变量的过程。本文利用主题模型分析了2型糖尿病、冠心病的临床诊疗数据以及中医文献数据。实验表明,利用主题模型能够提取出有临床意义的中医诊疗规律,为中医临床研究提供一种新颖的理论方法,为中医临床辨证治疗提供一种客观依据。
     本文的主要工作如下:
     (1)以隐狄利克雷分配(Latent Dirichlet Allocation, LDA)模型为代表的主题模型,是近年来文本挖掘和信息检索等领域的一个新的研究热点。本文系统地对主题模型的产生背景、发展过程、LDA主题模型常用的推理方法以及典型的主题模型进行归纳总结。为本文的研究奠定基础,为相关研究人员在主题模型领域的应用研究提供较系统的参考依据。
     (2)提出LDA主题模型的特征加权机制。我们直接采用LDA主题模型分析中医临床症状主题时,发现主题分布向高频词倾斜,能够代表主题特征的词被少量的高频词淹没,导致主题的解释性和区分性不佳,而且在建模过程中影响其它词在主题上的合理分配。于是,针对标准文本数据,采用倒排文档频率(Inverse Document Frequency, IDF)进行特征加权;针对中医临床数据,提出一种新颖的高斯函数特征加权方法。实验表明:加权LDA主题模型能够提高主题间的区分能力、提高主题的可解释性以及提高主题模型的建模速度;在Newsgroups标准数据集上,利用建模后的主题作为特征进行支持向量机(Support Vector Machine, SVM)分类时,能够提高分类准确率(Accuracy);能够在一定条件下,降低模型的困惑度/复杂度(Perplexity)。
     (3)针对LDA主题模型不能自动确定主题数目的问题,提出一种结合词相似性与中国餐馆过程(Chinese Restaurant Process, CRP)的主题模型;同时,针对LDA主题模型的Gibbs抽样近似推理中的两个Dirichlet超参数难以合理设置的问题,提出一种新颖的超参数设置方法。实验表明:提出的模型可以自适应地动态更新主题内容,确定合理的主题数目;超参数的设置能够方便灵活地适应不同的数据集,取得较低的模型复杂度。
     (4)分析主题模型和中医辨证论治的联系,在LDA模型和作者-主题模型的基础上,提出一种症状-中药-诊断主题模型,用于自动提取中医临床数据中症状、中药和诊断间的主题结构,系统地探索具有临床意义的多个实体间的关系。在2型糖尿病临床数据的分析实验中,获得了2型糖尿病典型的并发症/合并病(如糖尿病合并肾病,糖尿病外围神经病变等)的诊疗主题结构。实验结果分析表明:一类症状或其组合仅为人群/疾病分类找到了一种划分方式或依据,并不等同于该症状组合就对应唯一的证候或诊断,中医存在个性化诊疗特点;同时中医也存在共性的诊疗规律;提出的症状-中药-诊断主题模型能较好地揭示疾病的症状和中药分布特征以及中医诊疗规律。
     (5)对于一种复杂疾病(如糖尿病),通常存在多种并发症。于是,体现出的症状存在疾病主症和伴随症状间的层次关系;同时,用药也存在相应的分层关系,即对方剂进行随症加减。针对上述情况,为了揭示症状及相应用药的层次关系,本文在分层LDA模型和连接LDA模型的基础上,提出一种分层症状-中药主题模型。该模型在糖尿病临床数据的实验中,发现了有临床意义的症状分层结构和对应的用药分层规律。为探索中医临床诊疗中的方剂随症加减规律提供一种新颖的统计方法。
Topic models could be used to extract topics which are hidden in the documents (or discrete corpora), where each topic is a multinomial distribution over words semantically related each other. The main purpose of topic models is to explore statistical laws hidden in the discrete corpora and to express these information directly using topics, and then the topics obtained could be used for information retrieval, classification, clustering, abstract extraction, similarity and relativity estimation and so on. Topic model has recently been a new research issue in domains of text mining and information retrieval, etc.
     Traditional Chinese Medicine (TCM), an important component of traditional life sciences, has significant clinical efficacy in diagnosis and treatment of diseases. Large amount of clinical data, containing lots of knowledge and rules that are consistent with TCM theory, have been accumulated during thousands of years'TCM practice. In the trend of TCM informatics, it is very important to use modern techniques for mining the rules of TCM diagnosis and treatment hidden in clinical data. Although lots of methods, such as cluster analysis, association rules, regression analysis and discriminant analysis, have been used to study TCM theory, and some research progresses have been made, it is still difficult to reflect the TCM characteristics that are semantic complexity and systematicity of diagnosis and treatment.
     In this dissertation, we firstly introduce topic models to the study of the rules of TCM clinical diagnosis and treatment. The motivation is that we think not only topic models could capture the semantic characteristics hidden in TCM clinical data, but also there are relatively consistent route between the process of inference and generative of topics in the topic models and the process of "syndrome differentiation and treatment" which is described as "inspect the pulse-symptom, infer the diseases, and then to treat them" in the famous book Treatise on Exogenous Febrile Diseases. Both of the routes are from observable variable to latent variable to observable variable. We apply topic models to analyzing the clinical data of type 2 diabetes mellitus (T2DM), the clinical data of coronary heart disease and the TCM literature. Experiments indicate that the topic models could extract meaningful clinical law of diagnosis and treatment. It can provide a kind of academic method for TCM clinical study, and offer a kind of impersonality foundation for TCM clinical diagnosis and treatment.
     The main contributions of this dissertation are as follows:
     (1) Topic models represented by Latent Dirichlet Allocation (LDA) are recently one of the new research focuses in the domain of text mining and information retrieval. The formed background and development process of topic models, general inference methods of LDA and some typical topic models are systematically summarized in this dissertation. These contents are the basis of the research of this thesis and the reference of other researchers in the future.
     (2) We propose feature weighting mechanism in LDA model. When learning TCM clinical symptom topics by original LDA model, we found that the word distributions in the topics incline to high frequence words. That means those feature words representing topics are submerged by few high frequence words, which result in somewhat poor ability of elucidation and discrimination of the topics and rational allocation of other words on the topics. Therefor, we weight for the feature words using IDF method in standard text data, and then for TCM clinical data, we propose a novel feature words weighting method by Gauss function. The experiments indicate:weighted LDA model could improve the ability of elucidation and discrimination of topics; improve the modeling speed; improve Support Vector Machine (SVM) classification accuracy in Newsgroups dataset; reduce the perplexity under appropriate condition.
     (3) Aiming at the problem that the number of topics can't be automatically determined in LDA model, a latent topic model is proposed by combining the similarity between words and Chinese Restaurant Process (CRP). At the same times, aiming at the problem that hard to rationally set the two Dirichlet hyperparameters during Gibbs sample of topic models, a novel method of setting the Dirichlet hyperparameters is put forward. Experiments indicate:the proposed model could adaptively update the contents and determine the rational number of topics; the method of setting hyperparaments is conveniently fit to different datasets and the low perplexity is obtained.
     (4) Analyzing the relationships between topic models and TCM "syndrome differentiation and treatment", we propose Symptom-Herb-Diagnosis Topic (SHDT) model based on LDA model and Author-Topic model, to automatically extract the topic structure among symptoms, herb combinations, and to explore the common relationships among clinical meaningful multi-entity. In the clinical data of Type 2 Diabetes Mellitus (T2DM), the SHDT model capture some meaningful diagnosis and treatment topics (clusters), which clinically indicated some important medical groups corresponding to comorbidity diseases (e.g. diabetic kidney diseases and diabetic peripheral neuropathy). The experiment demonstrates:a class of symptom or the combination of symptoms only give an manner or evidence for classification of population/diease, and they could not be explain that there is distinct syndrome or diagnosis correspondingly, and there exist individualised TCM therapies. At the same time, there exist common TCM diagnosis and treatment rules. So the results demonstrate that this method is helpful for opening out the distribution character of symptoms of diseases, TCM diagnosis and treatment rules.
     (5) For complex disease, such as T2DM, there is much kind of comorbidity diseases. And then, there are hierarchical relationships among main symptoms and concomitant symptoms of diseases. At the same times, there is hierarchical structure among herbs to cure above disease, which means the prescription modification according to symptoms. For opening out the hierarchical latent topic structures both symptoms and their corresponding used herbs in the TCM clinical data, we propose a Hierarchical Symptom-Herb Topic (HSHT) model. The HSHT model is a combination of Hierarchical Latent Dirichlet Allocation (HLDA) model and Link Latent Dirichlet Allocation (LinkLDA) model. Using HSHT model in clinical T2DM, we get meaningful hierarchical topic structure of symptoms and corresponding herbs. We propose a novel statistical method for research TCM clinical rules of modification according to symptoms of prescriptions.
引文
[1]刘保延,张志斌.古代辨证方法的研究思路探讨.中国中医基础医学杂志.2004,10(5):325-331.
    [2]邓铁涛.辨证论治是中医临床医学的灵魂.中医药学刊.2002,20(4):394-395.
    [3]胡镜清,刘保延,王永炎.中医临床个体化诊疗信息特征与数据挖掘技术应用分析.世界科学技术—中医药现代化.2004,6(1):14-16.
    [4]刘保延,周雪忠.中医临床研究方法的思考与实践—系统生物学湿干研究模式与中医临床研究.世界科学技术-中医药现代化.2007,9(1):85-89.
    [5]周雪忠.中医临床数据仓库构建及临床数据挖掘方法研究.博士后出站报告.中国中医科学院.2007.
    [6]刘明武.是告别,还是积极传承?中国中医基础医学杂志.2007,13(3):161-166.
    [7]袁占国.十大问题困扰中医药的生存与发展.甘肃中医.2008,21:11-13.
    [8]朱杭溢.中医的生存与发展是历史的必然.中华中医药学刊.2007,25(11):2377-2379.
    [9]T. Mitchell. Machine learning and data mining. Communications of the ACM.1999,42(11): 31-36.
    [10]J. Han, M. Kamber. Data mining:Concepts and techniques. Morgan Kaufmann, San Francisco, CA.2001.
    [11]D. Hand, H. Mannila, P. Smyth. Principles of data mining. MIT Press, Cambridge, CA.2001.
    [12]史忠植.知识发现.清华大学出版社,北京.2002.
    [13]I. Witten, E. Frank. Data mining:Practical Machine Learning Tools and Techniques.2nd Edition, Morgan Kaufmann, Massachusetts, USA.2005.
    [14]王珏,周志华,周傲英.机器学习及其应用.清华大学出版社,北京.2006.
    [15]http://www.cintcm.ac.cn/opencms/opencms/xxyj/wxzyyj/gujidiaoyan.html.
    [16]http://satcm.gov.cn/96/全国中医药统计摘编/atog/2008/d2-25.htm..
    [17]S. Lukman, Y. He, S. Hui. Computational methods for traditional Chinese medicine:a survey. Computer Methods and Programs in Biomedicine.2007,88:283-294.
    [18]http://tcmlab.cintcm.ac.cn:8012/tcm/sys/lmService?channelid=YSTSJS&recid=400.
    [19]李垠含,石岩.数据挖掘技术在中医研究中的运用初探.长春中医药大学学报.2009,25(1):8-9.
    [20]郝先中.近代中医废存之争研究.华中师范大学博士论文.2005.
    [21]封毅.中医药知识发现可靠性研究.浙江大学博士论文.2008.
    [22]吴朝晖,封毅.数据库中知识发现在中医药领域的若干探索(Ⅰ).中国中医药信息杂志.2005,12(10):93-95.
    [23]宋小莉.中西医思维方式的差异.中国中医药报.2004,4(17):6-7.
    [24]http://satcm.gov.cn/96/全国中医药统计摘编/atog/2008/A01.htm.
    [25]童元元,何巍,赵英凯.世界卫生组织传统医学政策回顾.中国中医药信息杂志.2010,17(1):2-3.
    [26]B. Liu, J. Hu, Y. Xie, et al. Effects of integrative Chinese and western medicine on arterial saturation in patients with severe acute respiratory syndrome. Journal of Chinese Integrative Medicine.2004,10(2):117-122.
    [27]World Health Organization. SARS:Clinical trials on treatment using a combination of traditional Chinese medicine and western medicine.2004.
    [28]V. Konkimalla, T. Efferth. Evidence-based Chinese medicine for cancer therapy. Journal of Ethnopharmacology.2008,116:207-210.
    [29]Z. Wang, Z. Chen. Acute promyelocytic leukemia:from highly fatal to highly curable. Blood. 2008,111:2505-2515.
    [30]L. Wang, G. Zhou, P. Liu, et al. Dissection of mechanisms of Chinese medicinal formula Realgar-Indigo naturalis as an effective treatment for promyelocytic leukemia. Proceedings of the National Academy of Sciences.2008,105:4826-4831.
    [31]H. Diener, K.. Kronfeld, G. Boewing, et al. Efficacy of acupuncture for the prophylaxis of migraine:a multicentre randomised controlled clinical trial. Lancet Neurol.2006,5:310-316.
    [32]B. Flaws, P. Sionneau. The treatment of modern western medical diseases with Chinese medicine:a textbook and clinical manual.2nd ed. Blue Poppy Press.2005.
    [33]J. Rao, K. Mihaliak, K. Kroenke, et al. Use of complementary therapies for arthritis among patients of rheumatologists. Annals of Internal Medicine.1999,131:409-416.
    [34]D. Eisenberg, R. Davis, S. Ettner, et al. Trends in alternative medicine use in the United States 1097:results of a follow-up national survey. Journal of the American Medical Association. 1998,280(18):1569-1575.
    [35]K. Honda, J. Jacobson. Use of complementary and alternative medicine among United States adults:the influences of personality, coping strategies, and social support. Preventive Medicine. 2005,40(1):46-53.
    [36]K. Thomas, J. Nicholl, P. Coleman. Use and expenditure on complementary medicine in England:a population based survey. Complementary Therapies in Medicine.2001,9:2-11.
    [37]H. Yamashita, H. Tsukayama, C. Sugishita. Popularity of complementary and alternative medicine in Japan:a telephone survey. Complementary Therapies in Medicine.2002,10:84-93.
    [38]姚美村,袁月梅,艾路,等.数据挖掘及其在中医药现代化研究中的应用.北京中医药大学学报.2002,25(5):20-23.
    [39]乔延江,李澎涛,苏钢强,等.中药(复方)KDD研究开发的意义.北京中医药大学学报.1998,21(3):15-17.
    [40]田琳.数据挖掘及其在中医药领域中的应用.中国中医基础医学杂志.2006,11(9):710-711.
    [41]丁维,蒋永光,宋姚屏,等.中医知识发现研究现状.数理医药学杂志.2007,20(3):403-404.
    [42]李志更,王天芳,任婕,等.中医科研中几种常用数据挖掘方法浅析.中医药学报.2008,36(2):29-32.
    [43]X. Zhou, B. Liu. Traditional Chinese medicine clinical data mining:experiences and issues. Proceedings of the Workshop on Advances and Issues in Biomedical Data Mining at the 13th Pacific-Asia Conference on Knowledge Discovery and Data Mining.2009,11-20.
    [44]Y. Feng, Z. Wu, X. Zhou, et al. Knowledge discovery in traditional Chinese medicine:State of the art and perspectives. Artificial Intelligence in Medicine.2006,38(3):219-236.
    [45]X. Zhou, S. Chen, B. Liu, et al. Development of traditional Chinese medicine clinical data warehouse for medical knowledge discovery and decision support. Artificial Intelligence in Medicine.2010,48:139-152.
    [46]刘稼.聚类分析在中医药研究中的应用及意义.中医药学刊.2004,22(5):927-928.
    [47]李建生,胡金亮,余学庆.基于聚类分析的径向基神经网络用于证候诊断的研究.中国中医基础医学杂志.2005,11(9):685-687.
    [48]邓兆智,何弈亭,余煜绵,等.计算机模式识别法对类风湿关节炎中医证候判断与常规临床判断的比较.中国中西医结合杂志.1996,16(12):727-729.
    [49]刘明,王米渠.六纲与肾虚症状聚类分析的方法及问题探索.现代中西医结合杂志.2005,14(9):1117-1119.
    [50]张世筠,沈明秀,王先春,等.中医肝证的变量聚类分析.中国中西医结合杂志.2004,24(1):75-76.
    [51]Q. Zhang, W. Zhang, J. Wei, et al. Combined use of factor analysis and cluster analysis in classification of traditional Chinese medical syndromes in patients with posthepatitic cirrhosis. Journal of Chinese Integrative Medicine.2005,3(1):14-18.
    [52]Q. He, J. Wang, Y. Zhang, et al. Cluster analysis on symptoms and signs of traditional Chinese medicine in 815 Patients with Unstable Angina. Proceedings of the 6th International Conference on Fuzzy Systems and Knowledge Discovery.2009,435-439.
    [53]李国春,史欣德.半夏泻心汤临床案例用药量的聚类分析.中医药学刊.2005,23(5):836-838.
    [54]周德生.明清时期津液亏损案573例辨证用药统计分析.中医药研究.1998,14(4):12-13.
    [55]周君,冯妍.明清时期消渴病案59例用药统计分析.国医论坛.2005,20(6):18-18.
    [56]王华,胡学钢.基于关联规则的数据挖掘在临床上的应用.安徽大学学报(自然科学版).2006,30(2):21-25.
    [57]钟颖,胡雪蕾,陆建峰.基于关联规则和决策树的中医胃炎诊断分析.中国中医药信息杂志.2008,15(8):97-99.
    [58]李文林,赵国平,陆建峰,等.关联规则在名医临证经验分析挖掘中的应用.南京中医药大学学报.2008,24(1):21-24.
    [59]朱立成,林色奇,薛汉荣,等.名中医哮喘医案445例关联规则分析.江西中医学院学报.2007,19(5):83-87.
    [60]吴荣,王阶,周雪忠,等.基于关联规则的名老中医冠心病用药规律研究.中国中药杂志.2007,32(17):1786-1788.
    [61]姚美村,艾路,袁月梅,等.消渴病复方配伍规律的关联规则分析.北京中医药大学学报.2002,25(6):48-50.
    [62]陈擎文.数据挖掘技术在古代名中医中风医案之应用研究.中华中医药学刊.2008,26(10):2254-2257.
    [63]Z. Zhou, Z. Wu, C. Wang, et al. Mining both associated and correlated patterns. Proceedings of International Conference on Computational Science.2006,468-475.
    [64]C. Li, C. Tang, J. Peng, et al. NNF:An effective approach in medicine paring analysis of traditional Chinese medicine prescriptions. Proceedings of 10th International Conference of Database Systems for Advanced Applications.2005,576-581.
    [65]何前锋,崔蒙,吴朝晖,等.方剂中配伍知识的发现.中国中医药信息杂志.2004,11(7):655-658.
    [66]B. Pang, D. Zhang, N. Li, et al. Computerized tongue diagnosis based on Bayesian networks. IEEE Transaction on Biomedical Engineering.2004,51(10):1803-1810.
    [67]H. Wang, J. Wang. A quantitative diagnostic method based on Bayesian networks in traditional Chinese medicine. Lecture Notes in Computer Science.2006,4234:176-183.
    [68]朱文锋,晏峻峰,黄碧群.贝叶斯网络在中医证素辨证体系中的应用.中西医结合学报.2006,4(6):567-571.
    [69]K. Deng, D. Liu, S. Gao, et al. Structural learning of graphical models and its applications to traditional Chinese medicine. Proceedings of FSKD.2005,362-367.
    [70]X. Wang, H. Qu, P. Liu, et al. A self-learning expert system for diagnosis in traditional Chinese medicine. Expert Systems with Applications.2004,26(4):557-566.
    [71]孙燕,臧传新,任廷革,等.支持向量机方法在《伤寒论》方分类建模中的应用.中国中医药信息杂.2007,14(1):101-102.
    [72]Z. Gao, L. Po, W. Jiang, et al. A novel computerized method based on support vector machine for tongue diagnosis. Proceedings of the 3rd International IEEE Conference on Signal-Image Technologies and Internet-Based System.2007,849-854.
    [73]焦月,张新峰,卓力.中医舌象样本分类中加权SVM的应用研究.测控技术.2010,29(5):1-4.
    [74]刘士敬,朱倩.中医产科病证脾气虚证型量化诊断标准研究—92例本证刑诊断因素的多元回归分析.中国中医基础医学杂志.1998,4(9):49-51.
    [75]李小兵,方永奇,洪永敦,等.心脑血管病痰证宏观辨证的计量化研究.中国中医基础医学杂志.2000,6(5):44-47.
    [76]由松,胡立胜:.中医症状及证候的量化方法探讨.北京中医药大学学报.2002,25(2):13-15.
    [77]黄小波,李宗信,陈文强,等.慢性疲劳综合征中医证型判别分析.中国中医药信息杂志.2006,6(13):21-22.
    [78]吴芸,周昌乐,张志枫.中医舌诊神经网络的优化遗传算法.计算机应用研究.2007,24(9):50-52.
    [79]韦玉科,汪仁煌,陈群,等.基于竞争神经网络的中医智能诊断推理新方法.计算机工程与应用.2006,42(7):224-226.
    [80]秦中广,毛宗源.粗糙神经网络及其在中医智能诊断系统中的应用.计算机工程与应用.2001,37(18):34-35.
    [81]郭红霞,王炳和,郑思仪,等.基于概率神经网络的中医脉象识别方法研究.计算机工程与应用.2007,43(20):194-196.
    [82]J. Yan, Y. Peng, W. Zhu. Experimental study of syndrome elements based on the rough set theory. Proceedings of the 2nd International Conference on Information and Computing Science. 2009,39-41.
    [83]秦中广,毛宗源.粗糙集在中医类风湿证候诊断中的应用.中国生物医学工程学报.2001,20(4):357-363.
    [84]晏峻峰,朱文锋.粗糙集理论在中医证素辨证研究中的应用.中国中医基础医学杂志.2006,12(2):90-93.
    [85]谢国明.基于粗集理论的中医诊断模型的建立.数理医药学杂志.2005,18(4):302-304.
    [86]X. Zhou, Y. Peng, B. Liu. Text mining for traditional Chinese medical knowledge discovery:A survey. Journal of Biomedical Informatics.2010,43(4):650-60.
    [87]X. Zhou, B. Liu, Z. Wu. Text mining for clinical Chinese herbal medical knowledge discovery. Lecture notes comput science.2005,3735:396-398.
    [88]S. Li, Z. Zhang, L. Wu, X. Zhang, et al. Understanding ZHENG in traditional Chinese medicine in the context of neuro-endocrine-immune network. IET Systems Biology.2007, (1):51-60.
    [89]C. Cao, H. Wang, Y. Sui. Knowledge modeling and acquisition of traditional Chinese herbal drugs and formulae from text. Artificial Intelligence in Medicine 2004,32(1):3-13.
    [90]X. Zhou, R. Zhang, Y. Wang, et al. Network analysis for core herbal combination knowledge discovery from clinical Chinese medical formulae. Porceeding or the 1st International Workshop on Database Technology and Applications.2009,25-26.
    [91]X. Zhou, S. Chen, B. Liu, et al. Extraction of hierarchical core structures from traditional Chinese medicine herb combination network. Proceedings of the 2008 International Conference on Advanced Intelligence.2008,262-67.
    [92]胡申宁,李文书,施国生,等.基于PCA-AdaBoost的舌象颜色分类研究.广西师范大学学报(自然科学版).2009,27(3):158-161.
    [93]刘莺,朱文锋,卢芳国,等.152例胃癌患者术前病证聚类与主成份分析.江苏中医药.2004,25(6):20-22.
    [94]王阶,邢雁伟,陈建新,等.1069例冠心病心绞疝证候因子分析方法的分类研究.北京中医药大学学报.2008,31(5):344-346.
    [95]张连文,袁世宏.隐结构模型与中医辨证研究(Ⅰ)—隐结构法的基本思想以及隐结构分析工具.北京中医药大学学报,2006,29(6):365-369.
    [96]张连文,袁世宏,陈锼,等.隐结构模型与中医辨证研究(Ⅱ)—肾虚数据分析.北京中医药大学学报.2008,31(9):584-587.
    [97]袁世宏,张连文,陈弢,等.隐结构模型与中医辨证研究(Ⅲ)—模型辨证与专家辨证.北京中医药大学学报.2008,659-663.
    [98]N. Zhang, S. Yuan. Latent Structure Models and Diagnosis in Tradition Chinese Medicine. Technical Report HKUST-CS04-12. Department of computer science, The Hong Kong University of Science and Technology.2006.
    [99]N. Zhang, S. Yuan, T. Chen, et al. Statistical validation of traditional Chinese medicine theories. The Journal of Alternative and Complementary Medicine.2008,14(5):583-587.
    [100]N. Zhang, S. Yuan, T. Chen, et al. Latent tree models and diagnosis in traditional Chinese medicine. Artificial Intelligence in Medicine.2008,42:229-245.
    [101]张连文,郭海鹏.贝叶斯网络.科学出版社,北京.2006.
    [102]张煜斌,陆建峰,李文林,等.隐结构模型在慢性胃炎辨证中的应用探索—基于EM算法的因子分析方法.北京生物医学工程.2009,28(3):259-267.
    [103]M. Sobel. Causal Inference in latent variable models. A.von Eye and C. Clogg (Eds.) Latent variables analysis:Applications for Developmental.1994.
    [104]D. Bartholomew, M. Knott. Latent Variable Models and Factor Analysis. Arnold, London. 1999.
    [105]N. Zhang. Hierarchical latent class models for cluster analysis. Journal of Machine Learning Research.2004,5(6):697-723.
    [106]M. Steyvers, T Griffiths. Probabilistic topic models. T. Landauer, D McNamara, S. Dennis, et al. (Eds.), Handbook of Latent Semantic Analysis. Hillsdale, NJ:Erlbaum.2007,427-448.
    [107]T. Hofmann. Probabilistic latent semantic analysis. Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence.1999,289-296.
    [108]T. Hofmann. Probabilistic Latent Semantic Indexing. Proceedings of the 22nd Annual International S1G1R Conference on research and development in information retrieval.1999, 50-57.
    [109]T. Hofmann. Unsupervised learning by probabilistic latent semantic analysis. Machine Learning Journal.2001,42(1):177-196.
    [110]D. Blei, A. Ng, M. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research. 2003,3:993-1022.
    [111]D. Blei, J. Lafferty. Correlated Topic Models. Advances in Neural Information Processing Systems.2006,18:147-154.
    [112]D. Blei, J. Lafferty. A correlated topic model science. The Annals of Applied Statistics,2007, 1(1):17-35.
    [113]D. Blei, T. Griffiths, M. Jordan, et al. Hierarchical topic models and the nested Chinese restaurant. Advances in Neural Information Processing Systems.2004,16:17-24.
    [114]W. Li, A. McCallum. Pachinko allocation:DAG-structured mixture models of topic correlations. Proceedings of the 23rd International Conference on Machine Learning.2006, 577-584.
    [115]W. Li, D. Blei, A. McCallum. Nonparametric bayes pachinko allocation. Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence.2007.
    [116]D. Blei, J. McAuliffe. Supervised topic models. Advances in Neural Information Processing Systems.2008,20:121-128.
    [117]M. Rosen-Zvi, T. Griffiths, M. Steyvers, et al. The author-topic model for authors and documents. Proceedings of the 20th Conference Conference on Uncertainty in Artificial Intelligence.2004,487-494.
    [118]M. Steyvers, P. Smyth, M. Rosen-Zvi, et al. Probabilistic author-topic models for information discovery. Proceedings of KDD'04.2004,306-315.
    [119]E. Erosheva, S. Fienberg, J. Lafferty. Mixed-membership models of scientific publications. Proceedings of the National Academy of Sciences of the United States of America.2004,101 (Suppl 1):5220-5227.
    [120]I. Biro, D. Siklosi, J. Szabo, et al. Linked latent Dirichlet allocation in web spam filtering. Proceedings of the 5th International Workshop on Adversarial Information Retrieval on the Web.2009,37-40.
    [121]D. Blei, M. Jordan, A. Ng, Hierarchical bayesian models for applications in information retrieval. Bayesian Statistics.,2003,7:25-43.
    [122]X. Wei, W. Croft. LDA-based document models for ad-hoc retrieval. Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development on Information Retrieval.2006,178-185.
    [123]R. Arora, B. Ravindran. Latent Dirichlet allocation based multi-document summarization. Proceedings of the Second Workshop on Analytics for Noisy Unstructured Text Data.2008, 91-97.
    [124]T. Griffiths, M. Steyvers. A probabilistic approach to semantic representation. Proceedings of the 24th Annual Conference of the Cognitive Science Society.2002,381-386.
    [125]T. Griffiths, M. Steyvers. Prediction and semantic association. Advances in Neural Information Processing Systems.2003,15:11-18.
    [126]T. Griffiths, M. Steyvers. Finding Scientific Topics. Proceedings of the National Academy of Science.2004,5228-5235.
    [127]R. Arora, B. Ravindran. Latent Dirichlet allocation and singular value decomposition based multi-document summarization. Proceedings of 8th IEEE International Conference on Data Mining.2008,713-718.
    [128]A. Haghighi, I. Vanderwende. Exploring content models for multi-document summarization. Human Language Technologies:the Annual Conference of the North American Chapter of the ACL Boulder.2009,362-370.
    [129]J. Niebles, L. Fei-Fei. A hierarchical model of shape and appearance for human action classification. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2007,1-8.
    [130]L. Fei-Fei, P. Perena. A bayesian hierarchical model for learning natural scene categories. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.2005,2: 524-531.
    [131]P. Elango. Clustering images using the latent dirichlet allocation model. http://pages.cs.wisc.edu/-pradheep/Clust-LDA.pdf.
    [132]J. Sivic, B. Russell, A. Efros, et al. Discovering objects and their localization in images. Proceedings of 10th IEEE International Conference on Computer Vision.2005,1:370-377.
    [133]X. McCallum, A. Wang. Corrada-Emmanuel. Topic and role discovery in social networks with experiments on enron and academic email. Journal of Artificial Intelligence Research. 2007,30:249-272.
    [134]R. Baeza-Yates, B. Ribiero-Neto. Modern Information Retrieval. Addison-Wesley, New York.1999.
    [135]宗成庆.统计自然语言处理.清华大学出版社,北京.2008.
    [136]D. Radev, E. Hovy, K. Mckeown. Introduction to the special issue on summarization. Computational Linguistics.2002,28(4):399-408.
    [137]R. Grishman. Information extraction:techniques and challenges. Maria Teresa Pazienza, Editor, Information Extraction:a Multidisciplinary Approach to an Emerging Information Technology. Springer, Berling.1997.
    [138]G. Salton, A. Wong, C. Yang, A vector space model for automatic indexing. Communications of the ACM.1975,18(11):613-620.
    [139]G. Salton, M. McGill. Introduction to modem information retrieval.McGraw-Hill, New York. 1983.
    [140]A. Aizawa. An information-theoretic perspective of TF-IDF measures. Information Processing and Management.2003,39(1):45-65.
    [141]H. Wu, R. Luk, K. Wong, et al. Interpreting TF-IDF term weights as making relevance decisions. ACM Transactions on Information Systems.2008,26(3):article 13:1-37.
    [142]G. Amati, C. Van Rijsbergen. Semantic information retrieval. In Information Retrieval: Uncertainty and Logics, C. Van Rijsbergen et al. (Eds.) Kluwer Academic.1998,189-220.
    [143]J. Pont, W. Croft. A Language Modeling Approach to Information Retrieval. Proceedings of 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.1998,275-281.
    [144]S. Deerwester, S. Dumais, G. Furnas, et al. Indexing by latent semantic analysis. Journal of the American Society for Information Science.1990,41(6):391-407.
    [145]S. Dumais. Latent semantic indexing (LSI). The 2nd Text Retrieval Conference (TREC-2).1994,105-116.
    [146]S. Dumais. Latent Semantic Indexing (LSI). The 3rd of the Text Retrieval Conference (TREC-3).1995,219-230.
    [147]G. Forsythe, M. Malcolm, C. Moler. Least squares and the singular value decomposition, In Computer methods for mathematical computations. Englewood Cliffs, Pretice Hall, NJ.1977.
    [148]H. Schutze, C. Silverstein. Projections for efficient document clustering. Proceedings of 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.1997,74-81.
    [149]S.Dumais. Improving the retrieval of information from external sources. Behavior Research Methods, Instruments and Computers.1991,23(2):229-236.
    [150]D. Hull. Improving text retrieval for the routing problem using latent semantic indexing. Proceedings of the 17th ACM SIGIR Conference.1994,282-290.
    [151]H. Zha, O. Marques, H. Simon. A subspace-based model for information retrieval with applications in latent semantic indexing. Proceedings of Irregular'98.1998,29-42.
    [152]Y. Yang. Noise Reduction in a statistical approach to text categorization. Proceedings of Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.1995,256-263.
    [153]P. Husbands, H. Simon, C. Ding. Term norm distribution and its effects on Latent Semantic Indexing. Information Processing and Management.2005,41(4):777-787.
    [154]S. Banerjee, T. Pedersen. The design, implementation, and use of the ngram statistics package. Proceedings of the 4th International Conference on Intelligent Text Processing and Computational Linguistics.2003,17-21.
    [155]T. Mitchell. Machine learning. McGraw-Hill, New York.1997.
    [156]D. Lewis, W. Gale. A sequential algorithm for training text classifiers. Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.1994,3-12.
    [157]J. Ponte. A language modeling approach to information retrieval. PhD Dissertation, UMass, 1998.
    [158]K. Nigam, A. McCallum, S. Thrun, et al. Text classification from labeled and unlabeled documents using em. Machine Learning.2000,39(2/3):103-134.
    [159]X. Liu, W. Croft. Cluster-based retrieval using language models. Proceedings of the 27th ACM SIGIR Conference on Research and Development on Information Retrieval.2004, 186-193.
    [160]T. Hofmann, J. Puzicha, M. Jordan. Learning from dyadic data. Advances in Neural Information Processing Systems.1998,11:466-472.
    [161]A. Dempster, N. Laird, D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society:Series B.1977,39:1-38.
    [162]J.Chien, M. Wu, C. Wu. Bayesian learning for latent semantic language. Proceedings of European Conference on Speech Communication and Technology.2005,25-28.
    [163]Y. Akita, T. Kawahara. Language model adaptation based on PLSA of topics and Speakers. Proceedings of International Conference on Spoken Language Processing.2004,1045-1048.
    [164]T. Brants, F. Chen, I. Tsochantaridis. Topic-based document segmentation with probabilistic latent semantic analysis. Proceedings of the 11th International Conference on Information and Knowledge Management.2002,211-218.
    [165]A. Bosch, A. Zisserman, X. Munoz. Scene classification via pLSA. European Conference on Computer Vision.2006,4:517-530.
    [166]R. Fergus, L. Fei-Fei, P. Perona, et al. Learning object categories from google's image search. Proceedings of IEEE International Conference on Computer Vision.2005,2:1816-1823.
    [167]J. Sivic, B. Russell, A. Efros, et al. Discovering objects and their location in images. Proceedings of IEEE International Conference on Computer Vision.2005,1:370-377.
    [168]D. Mrva, P. Woodland. A PLSA-based language model for conversational telephone speech. Proceedings of International Conference on Spoken Language Processing.2004,2257-2260.
    [169]M. Girolami, A. Kaban. On an Equivalence between PLSI and LDA. Proceedings of the 26nd Annual ACM SIGIR Conference on Research and Development in Information Retrieval. 2003,433-434.
    [170]D. Blei. Probabilistic models of text and images. PhD Dissertation. University of California, Berkeley.2004.
    [171]M. Jordan, Z. Ghahramani, T. Jaakkola, et al. Introduction to variational methods for graphical models. Machine Learning.1999,37:183-233.
    [172]T. Minka, J. Lafferty. Expectation-propagation for the generative aspect model. Proceedings of the 18th Conference on Uncertainty in Artificial Intelligence.2002,352-359.
    [173]Y. Teh, D. Newman, M. Welling. A collapsed variational bayesian inference algorithm for latent dirichlet allocation. Advanced in Neural Information Processing Systems.2006,18: 1353-1360.
    [174]W. Buntine, A. Jakulin. Applying discrete PCA in data analysis. UAI,2004,59-66.
    [175]T. Minka. Expectation propagation for approximate bayesian inference. Proceedings of the 17th Conference in Uncertainty in Artificial Intelligence.2001,362-369.
    [176]I. Porteous, D. Newman, A. Ihler, et al. Fast collapsed Gibbs sampling for latent Dirichlet allocation. Proceedings of the 14th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining.2008,569-577.
    [177]X. Song, C. Lin, B. Tseng, et al. Modelingand predicting personal information dissemination behavior. The 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.2005,479-488.
    [178]A. Banerjee, S. Basu. Topic models over text streams:a study of batch and online unsupervised learning. Proceedings of the 7th SIAM International Conference on Data Mining.2007,431-436.
    [179]K. Canini, L. Shi, T. Griffiths. Online Inference of Topics with Latent Dirichlet Allocation. Proceedings of the 12th International Conference on Articial Intelligence and Statistics.2009.
    [180]L. Yao, D. Mimno, A. McCallum. Efficient methods for topic model inference on streaming document collections. Proceedings of the 15th ACM SIGKDD Conference on Knowledge Discovery and Data Mining.2009,937-946.
    [181]D. Mimno, A. McCallum. Organizing the OCA:learning faceted subjects from a library of digitalbooks. Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries. 2007,376-385.
    [182]R. Nallapati, W. Cohen, J. Lafferty. Parallelized variational EM for latent Dirichlet allocation: An experimental evaluation of speed and scalability. ICDM Workshop on High Perfomance Data Mining,2007.
    [183]Y. Wang, H. Bai, M. Stanton, et al. PLDA:Parallel latent Dirichlet allocation for large-scale applications. Proceedings of 5th International Conference Algorithmic Aspects in Information and Management.2009,301-314.
    [184]D. Newman, A. Asuncion, P. Smyth, et al. Distributed inference for latent Dirichlet allocation. Advances in Neural Information Processing Systems.2008,20:1081-1088.
    [185]A. Asuncion, P. Smyth, M. Welling. Asynchronous distributed learning of topic models. Advances in Neural Information Processing Systems.2009,21:81-88.
    [186]M. Abramowitz, I. Stegun. Handbook of Mathematical Functions. Dover, New York.1970.
    [187]S. Geman, D. Geman. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence.1984,6(6): 721-741.
    [188]M. Jordan. Learning in graphical models. MIT Press, Cambrige, MA,1999.
    [189]W. Gilks, S. Richardson, D. Spiegelhalter. Markov chain Monte Carlo in practice Chapman & Hall, New York.1996.
    [190]T. Mink. Estimating a Dirichlet distribution. Technical Report. MIT.2000.
    [191]B. Russell, A. Efros, J. Sivic, et al. Using multiple segmentations to discover objects and their extent in image collections. IEEE Conference on Computer Vision and Pattern Recognition. 2006,2:1605-1614.
    [192]D. Blei, T. Griffiths, M. Jordan. The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies. Journal of the ACM.2010,57(2):1-30.
    [193]Y. Teh, M. Jordan, M. Beal, et al. Hierarchical Dirichlet processes. Journal of the American Statistical Association.2006,101(476):1566-1581.
    [194]J. Cao, T. Xia, J. Li, et al. A density-based method for adaptive LDA model selection. Neurocomputing.2009,72(7-9):1775-1781.
    [195]S. Lacoste-Julien, F. Sha, M. Jordan. DiscLDA:Discriminative learning for dimensionality reduction and classification. Advances in Neural Information Processing Systems.2008,20: 897-904.
    [196]W. Xu. Supervising latent topic model for maximum-margin text classification and regression. Proceedings of the 14th Pacific-Asia Conference in Advances in Knowledge Discovery and Data Mining.2010,403-414.
    [197]D. Ramage, D. Hall, R. Nallapati, et al. Labeled LDA:A supervised topic model for credit attribution in multi-labeled corpora. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing.2009,248-256.
    [198]Y. Wang, P. Sabzmeydani, G. Mori. Semi-latent Dirichlet allocation:A hierarchical model for human action recognition. Proceedings of the 3rd Workshop on Human Motion: Understanding. Modeling, Capture and Animation.2007,240-254.
    [199]J. Tang, J. Zhang, L. Yao, et al. ArnetMiner:extraction and mining of academic social networks. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discorery and Data Mining.2008,990-998.
    [200]R. Nallapati, A. Ahmed, E. Xing, et al. Joint latent topic models for text and citations. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discorery and Data Mining.2008,542-550.
    [201]T. Yano, W. Cohen, N. Smith. Predicting response to political blog posts with topic models. Proceedings of Human Language Technologies:The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics.2009,477-485.
    [202]X. Wang, A. McCallum. Topics over time:a non-markov continuous-time model of topical trends. Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discorery and Data Mining.2006,424-433.
    [203]W. Li, X. Wang, A. McCallum. A continuous-time model of topic co-occurrence trends. Proceedings of the 21st National Conference on Artificial Intelligence Workshop on Event Extraction and Synthesis.2006,48-53.
    [204]L. AlSumait, D. Barbar a, C. Domeniconi. On-line LDA:adaptive topic models for mining text streams with applications to topic detection and tracking. Proceedings of the IEEE International Conference on Data Mining.2008,3-12.
    [205]D. Blei, J. Lafferty. Dynamic topic models. Proceedings of the 23rd International Conference on Machine Learning.2006,113-120.
    [206]C. Wang, D. Blei, D. Heckerman. Continuous time dynamic topic models. Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence.2008.
    [207]H. Wallach. Topic modeling:beyond bag-of-words. Proceedings of the 23rd International Conference on Machine Learning.2006,977-984.
    [208]T. Griffiths, M. Steyvers, J. Tenenbaum. Topic in semantic representation. Psychological Review.2007,114(2):211-244.
    [209]X. Wang, A. McCallum, XingWei. Topical N-grams:phrase and topic discovery, with an application to information retrieval. Proceedings of the 7th IEEE International Conference on Data Mining.2007,697-702.
    [210]T. Griffiths, M. Steyvers, D. Blei, et al. Integrating Topics and Syntax. Advances in Neural Information Processing.2005,17:537-554.
    [211]D. Aldous. Exchangeability and related topics. In Ecole d'etede probabilite's de Saint Flour, ⅩⅢ-1983. Springer Press, Berlin.1985,1-198.
    [212]http://psiexp.ss.uci.edu/research/programs_data/toolbox.htm.
    [213]http://mallet.cs.umass.edu/.
    [214]http://www.arbylon.net/projects/.
    [215]http://www.cs.princeton.edu/~blei/lda-c/.
    [216]http://chasen.org/~daiti-m/dist/lda/.
    [217]http://gibbslda.sourceforge.net/.
    [218]http://code.google.com/p/lsa-lda/.
    [219]G. Kirby. ZIPF's Law. Journal of Naval Science.1985,10(3):180-185.
    [220]A. Wilson, P. Chew. Term weighting schemes for latent Dirichlet allocation. Proceedings of the 2010 Annual Conference of the North American Chapter of the ACL.2010,465-473.
    [221]D. Ramage, P. Heymann, C. Manning, and et al. Clustering the tagged web. Proceedings of the 2nd ACM International Conference on Web Search and Data Mining.2009,54-63.
    [222]张小平,周雪忠,黄厚宽,等.一种改进的LDA主题模型.北京交通大学学报(自然科学版).2010,34(2):111-114.
    [223]H.Wallach, I. Murray, R. Salakhutdinov, et al. Evaluation methods for topic models. Proceedings of the 26th International Conference on Machine Learning.2009,1105-1112.
    [224]C. Chang, C. Lin. LIBSVM:A library for support vector machines.2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
    [225]T. Ferguson. A Bayesian analysis of some nonparametric problems. Annals of Statistics.1973, 1(2):209-230.
    [226]J. Sethuraman. A constructive definition of Dirichlet priors. Statistica Sinica.1994,4: 639-650.
    [227]D. Blackwell, D, J. MacQueen. Ferguson distributions via Polya urn schemes. Annals of Statistics.1973,1:353-355.
    [228]S. Kim, M. Tadesse, M. Vannucci. Variable selection in clustering via Dirichlet process mixture models. Biometrika.2006,93(4):877-893.
    [229]H. Daume-Ⅲ, D. Marcu. A Bayesian model for supervised clustering with the Dirichlet process prior. Journal of Machine Learning Research.2005,6:1551-1577.
    [230]X Zhou, B Liu, Z Wu, Y Feng. Integrative mining of traditional Chinese medicine literature and MEDLINE for functional gene networks. Artificial Intelligence in Medicine, 41(2007)87-104.
    [231]陈世波.病证结合的中介—“症”的分类原理和方法研究.博士后出站报告.中国中医科学院.2008.
    [232]J. Chang, D. Blei. Relational topic models for document networks. Proceedings of the 12th International Conference on Artificial Intelligence and Statistics.2009,81-88.
    [233]B. Maggie, M.Covington. Traditional Chinese medicine in the Treatment of Diabetes. Diabetes Spectrum.2001,14(11):154-159.
    [234]http://www.zhongyao365.com/.
    [235]D. Cohn, T. Hofmann. The missing link-a probabilistic model of document content and hypertext connectivity. Advances in Neural Information Processing Systems.2001,13: 430-436.
    [236]http://www.zgtnw.com/tnb/tnzl/zy/200808/5896.html.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700