几类马氏骨架过程的研究与Q过程的若干性质
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
马尔可夫过程是一类重要的随机过程,它的原始模型马尔可夫链,由俄国数学家A.A.马尔可夫于1907年提出。马尔可夫过程的“核心”是马尔可夫性,其直观描述是:在已知系统的目前状态的条件下,系统未来的演变不依赖于它以往的演变。可列马尔可夫过程是马尔可夫过程的一个非常活跃而且研究成果非常丰富的分支,如文献[1]~[4]等。其中,积分型随机泛函、数字特征以及Q矩阵问题的研究是其重要的研究内容。
     马尔可夫骨架过程是在一列停时处具有马氏性的随机过程。它较马氏过程、半马氏过程更为广泛,为一类更广泛的实际问题提供了随机模型。马尔可夫骨架过程是由侯振挺教授等人于1997年首先提出,随后他和他的学生们在这一领域开展了卓有成效的工作,发表了一系列文章并出版了专著,如文献[6]等。
     本文的研究包含两部分内容:一是研究几类马尔可夫骨架过程,其中包括:半马氏过程,半马氏生灭过程以及生灭型半马氏骨架过程;二是讨论了Q过程的一些重要性质,并构造了一类全稳定Q过程。全文共分七章,主要结果有:
     1.研究了半马氏过程的一维分布,构造及积分型随机泛函。
     2.给出了半马氏生灭过程的定义,引进了其数字特征,讨论了向上和向下积分随机泛函、遍历性及平稳分布。
     3 提出了生灭型半马氏骨架过程的定义,求出了两骨架时τ_(n-1)(ω)与τ_n(ω)之间的嵌入过程X~((n))(t,ω)的初始分布及寿命分布,得到了生灭型半马氏骨架过程的一维分布,构造了生灭型半马氏骨架过程,引进了生灭型半马氏骨架过程的数字特征并讨论了它们的概率意义,最后讨论了向上和向下的积分型随机泛函。
     4.研究了马氏过程P(t)的分解及p_(∞j)(s,t)的定义,Q过程的B条件成立的充分必要条件,引进了数字特征并讨论了其概率意义,研究了Q过程的积分型随机泛函,引进了极小过程的概念,得到了两个解析结构定理。
     5.引进了向后首达时间和向前道达时间,讨论了他们的分布及性质,得到了向前禁止概率分解定理和向后禁止概率分解定理。
     6.讨论了Q矩阵问题。我们得到了全稳定Q过程构造的等价条件。构造出了
Markov processes is one class of important stochastic processes. Markov chain which is proposed by Russian mathematician A.A. Markov in 1907 is its primitive model.The core of Markov processes is Markov property which can be described as: known current state condition,the change of Markov processes in the future will not depend on previous change.Countable Markov processes is an active branch of Markov processes, and its research fruit is very abundant.The study of integral type random functional, numerical characteristic and Q-matrix is countable Markov processes important research contents.The Markov skeleton processes is stochastic processes which has Markov property at stopping time. Its area is more extensive than Markov processes and semi Markov processes and provide random models to more extensive applied problem. The Markov skeleton processes is proposed by professor Hou Zhengting etc in 1997.He and his students get fruitful works in this field.A series of articles and bibliographies have been published,for example bibliography [6],etc.The study of this thesis includes two aspects.One is to study several classes of Markov skeleton processes which include the semi Markov processes,the birth and death semi Markov processes,the birth and death type semi Markov skeleton processes, the other is to discuss important theories of the Q-processes and to construct one class of all-stable Q-processes.It consists of seven chapters.We drew the following conclusions.1. We study the one-dimensional distribution,integral type random functional and construction of the semi Markov processes.2. We introduce the concept of the birth and death semi Markov processes,and its numerals characteristics,and discuss up and down integral random functionals meanwhile.3. We introduce the definition of the birth and death type semi Markov skeleton processes,and get the initial distribution and the life distribution of X~(n)(t,w)
    which imbed between skeleton sequence time rn_i(u;) and rn(w).We get the one-dimensional distribution of the birth and death type semi Markov skeleton processes. We make use of the one-dimensional distribution and initials distribution to construct the birth and death type semi Markov skeleton processes. We introduce the numerals characteristics of the birth and death type semi Markov skeleton processes ,and discuss their probability meanings.In finally,we study the up and down integral type random functionals.4. We study the decomposition of Markov processes and give the definition of Pooj(t).The necessary and sufficient condition of the Q-processes's B-condition is given.We introduce in Q-processes's figure characteristics ,and discuss probability meanings of the figure characteristics .We study the integral random functional of the Q-processes.By introducing the concept of the minimal processes,we have obtained two analytic construction theorems.5. We introduce the backward first arrival time and the forward first arrival time,and discuss their probability distributions and properties.Finally,we get the decomposition theorems of the forward taboo probability and the backward taboo probability.6. Q-matrix problem is discussed.We obtain equivalent conditions of Q-processes structure,and construct all-stable Q-processes and all-stable honest Q-processes about the same flow into on A(i).We get honest Q-processes's criterion of the existence.Finally,we get the analytical expression of (Q, II) processes.
引文
[1] 王梓坤,生灭过程与马尔科夫链,北京:科学出版社,1980
    [2] 侯振挺等,马尔可夫过程的Q—矩阵问题,长沙:湖南科学技术出版社,1994
    [3] K.L.Chung,Markov Chains with Stationary Transition Probabilities, Znded, Springer, Berlin,1967(1st,ed,Springer-Verlag,1960)
    [4] 杨向群,可列马尔科夫过程构造论,长沙:湖南科学技术出版社,第二版,1986
    [5] B.C.Koporok,半马尔可夫过程及应用(俄文),1976.(中文译稿)
    [6] 侯振挺/等著,马尔可夫骨架过程-混杂系统模型,长沙:湖南科学技术出版社,2000
    [7] 侯振挺/等著,生灭过程,长沙:湖南科学技术出版社,2000
    [8] 张建康,ON THE GENERALIZED BIRTH AND DEATH PROCESSES.数学物理学报,VOL.4(2),1984,241~259
    [9] 申鼎煊,随机过程,武昌:华中理工大学出版社,1990
    [10] 刘再明,一类随机环境中的广生灭过程,长沙铁道学院学报,VOL.8,NO.2,JUNE,1990.
    [11] 刘再明,一类随机环境下的随机游动,长沙铁道学院学报,VOL.5,NO.4,DEC,1987.
    [12] 徐光辉,随机服务系统,北京:科学出版社,第二版,1988
    [13] 孟玉珂,排队论基础及应用,上海:同济大学出版社,1989
    [14] 官建成,随机服务过程及其在管理中的应用,北京:北京航空航天大学出版社,1990
    [15] 刘再明、侯振挺,含瞬时态生灭Q矩阵问题,科学通报,第38卷,第7期,1994
    [16] Adke s R,A birth, death and migration process. J Appl. Prob.,1969(6):687~691
    [17] Adke s R,A multi-dimensional birth and death process.Biometrics,1964(20): 213~216
    [18] Aksland M, A birth, death,and migration Process with immigration.Adv.Appl. Prob., 1975(7):44~60
    [19] Aksland M, On interconnected birth and death processes with immigration .In Transaction of the Seventh Prague Conference on Information Theory, etc.,Reidel Dordrecht, 1977,23~28
    [20] Archinard E,Taboo Probabilities in the entrance boundary theory of Markov chains.Z.Wahrs.Verw. Geb., 1974 (29) :165~179
    [21] Baba Y, Maximum likelihood estimation of parameters in birth and death processes by Poisson sampling.J.Oper.Res.Soc.Japan.1982,25(2):99~112
    [22] Bailey N T J,Stochastic birth,death and migration process for spatially distributed populations .Biometrika, 1968(55): 189~198
    [23] Billard I, Generalized two-dimensional bounded birth and death processes and some applications.J.Appl.Prob., 1981,18(2) :335~347
    [24] Bramson M and Griffeath D,A note on the extinction rates of some birth-death processes.J Appl. Prob.,1979,16(4) :897~902
    [25] Branford A J, A self-excited migration process.J Appl.Prob.1985(22):58~67
    [26] Branford A J,On property of finite-state birth and death processes.J Appl.Prob. 1986(23):859~866
    [27] Brockwell P J,The extinction time of a general birth and death process with catastrophes. J Appl.Prob.,1986(23):851~858
    [28] Brockwell P J, Cani J and Resnick S I,Birth,immigration and catastrophe processes, Adv.Appl.Prob.,1982(14):709~731
    [29] Buhler W J, Integrals of birth and death processes. J Math.Biol.1980,10(2);25~207
    [30] Callaert H, On the rate of convergence in birth and death processes. Bull.Soc.Math. Belg.,1974,(26) (2) :173~184
    [31] Callaert H and Keilson J,On exponential ergodicity and spectral structure for birth-death processes I.Stochastic Proc. Appl.,1973,a(1):187~216
    [32] Callaert H and Keilson J,On exponential ergodicity and spectral strucure for birth-death processes Ⅱ .Stochastic Proc. Appl.,1973,a(1):217~235
    [33] 陈安岳,带瞬时态Q过程的构造问题.数学年刊,1987,8A(1):52~60
    [34] 陈安岳,带瞬时态Q过程构造论的若干问题:[博士学位论文].长沙:长沙铁道学院,1988
    [35] 陈木法, From Markov Chains to Non-Equilibrium particle systems,Singapore:World Scientific,1992
    [36] 陈木法, Estimation of Spectral Gap for Markov Chains,Acta Mathematics sinica, New Series,1966,12(4):337~360
    [37] 陈木法, Estimate of Exponential Convergence Rate in Total Variation by spec- tral Gap.Acta.Math.Sin New Ser,1988,14(1):9~16
    [38] 陈木法, 王凤雨, Application of Coupling method to the first eigenvalue on manifold,Sci Sin(A),(Chinese Edition) 1993,23(11):1130~1140,(English Edition)1994, 37(1~14)
    [39] 费志凌,含有限个瞬时态生灭矩阵的特征.长沙铁道学院学报,1986,4(3)
    [40] Feller W, On the integral-differential equations of purely discontinuous Markoff processes. Trans .Amer.Math.Soc. 1940(48)~515.ibid., 1945, (58):474
    [41] 侯振挺,生灭过程由0~+-系统的唯一决定性,经济数学,1985,1(2)
    [42] 刘再明,含有限个瞬时态生灭过程的构造,数学年刊,15A:6(1994),657-664
    [43] 刘再明、侯振挺,生灭Q-矩阵,数学学报,第37卷,第5期,1994
    [44] 刘再明,随机环境中的排队问题,湖南数学年刊,VOL,15(1),1995.3
    [45] 刘再明,瞬时态Q过程定性理论的若干问题:[博士学位论文].长沙:长沙铁道学院,1988
    [46] 刘再明,“双无限”不中断Q过程唯一性的注记.数学年刊,1991,12 A(5):619~626
    [47] 刘再明,一类单瞬时态Q-矩阵.长沙铁道学院学报,1991,9(2):80~86
    [48] 刘再明,不满足(s)条件Q-矩阵问题.长沙铁道学院学报,1992,10(2)86~91
    [49] 刘再明,含瞬时态的B型Q过程(Ⅰ),(Ⅱ),(Ⅲ).长沙铁道学院学报,1993,11(4):79~85;1994,12(1):91~93;1994,12(3)
    [50] 刘再明,一类含保守瞬时态Q-矩阵.数学杂志,1994,14(2)
    [51] 刘再明,一类随机环境下的广生灭过程.长沙铁道学院学报,1990,8(2):10~19
    [52] 刘再明, The construction of the birth-and death processes with finite instantaneous states.Proceedings of the Symposium on Applied Math.,the Chinese Academy of Sciences, 1992,46~47
    [53] 刘再明、陈安岳,瞬时对角型Q-矩阵的特征.数学杂志,1990,2(10):191~198
    [54] Reuter G E H, Remarks on a Markov Chain Example of Kolmogorov.Z W verw.Geb.1969(13):315~320
    [55] Denumerable Markov processes Ⅱ. J London Math.Soc.,1959(34):81~91
    [56] Reuter G E H and Riley P W, The Feller Property for Markov Semigroups on Countable State Space.Jondon Math.Society,1972(2):265~275
    [57] Rogers L C G and Williams D, Construction and Approximation of Transition Matrix Functions. Applied probability Trust,1986,133~160
    [58] Saunders I W, A convergence theorem for parities in a birth and death process.J Appl.Prob.,1976,13(2) :231~238
    [59] Siegmund D, The Equivalence of Absorbing and Reflecting Barrier problems for Stochastically Monotone Markov process.The Annals of probability,1976A(6):914~924
    [60] 王梓坤,随机过程论.北京:科学出版社,1965
    [61] 王梓坤,生灭过程构造论.数学进展,1962,5(2):137~187
    [62] 王梓坤,The Martin boundary and limit theorems for excessive function,scientia (中国科学),1965,ⅪⅤ(8):1118~1129
    [63] 王梓坤,生灭过程的遍历性与零壹律.南开大学学报(自然科学),1964,5(5):89~94
    [64] 王梓坤, On distributions of functions of birth and death processes and their applications in theory of queues,Scientia Sinia(中国科学), 1961, Ⅹ(2):160~170
    [65] 王梓坤, Sojourn times first passage times for birth and death processes. Sci. Sinica, 1980, 23(3): 269~279
    [66] 王梓坤、杨向群,中断生灭过程的构造.数学学报,1978,21(2):66~71
    [67] 王梓坤、杨向群,中断生灭过程构造中的概率分析方法.南开大学学报(自然科学),1979(3):1~32
    [68] 杨向群,一类生灭过程,数学学报,1965,15(1):9~031
    [69] 杨向群,关于生灭过程构造论的注记.数学学报,1965,15(2):173~187
    [70] 杨向群,可列马氏过程的积分型泛函和双边生灭过程的边界性质.数学进展,1964,7(4):397~424
    [71] 杨向群,生灭过程的性质.数学进展,1966,9(4):365~380
    [72] 杨向群,双边生灭过程.南开大学学报(自然科学),1964,5(5):9~40
    [73] 张汉君,生灭过程由0~+-系统的唯一决定性.经济数学,1985,2(2):62~72
    [74] 张汉君,Q过程构造论中的H-条件。长沙铁道学院学报,1992,10(1):68~72
    [75] 张汉君,含有限个瞬时态的Kolmogorov矩阵.长沙铁道学院学报,1993,11(4):68~73
    [76] 张汉君,瞬时态可和的Q-矩阵.数学年刊(A),1994,15(3):111~118
    [77] 张汉君,广义Kolmogorov矩阵定性理论.应用概率统计,1994,10(1):18~24
    [78] 张汉君,端Q过程构造理论:[博士论文].长沙:长沙铁道学院,1988
    [79] 邹捷中,单瞬时生灭过程由0~+-系统的唯一决定性.长沙铁道学院学报,1985,3(3):57~62
    [80] 邹捷中、刘再明,一类含瞬时态的Q-矩阵.应用概率统计,1991,7(2):125~132
    [81] 侯振挺、郭表峰,齐次可列马尔可夫过程.北京:科学出版社,1978
    [82] 侯振挺、邹捷中、袁成桂,输入过程(独立同分布情形).经济数学,1996,13(1):1~8
    [83] 侯振挺、刘再明、周弋,输入过程(成批到达情形).经济数学,1996,13(2):1~3
    [84] 侯振挺、刘再明、邹捷中、李学伟,Markov骨架过程,科学通报,1998,43(5):457~466
    [85] 侯振挺、刘再明、邹捷中、李学伟,Markov skeleton processes.Chinese Science Bulletin.1998,43(11):881~889
    [86] 侯振挺、刘再明,数学生态学随机模型.生物数学学报,2000
    [87] 侯振挺、刘再明、郭先平,QNQL过程(Ⅳ):(H_m,Q_m)_(m-1)~∞-过程及其在排队论中的应用,长沙:“马尔可夫过程与受控马尔可夫链”国际会议,1999,8
    [88] 侯振挺、郭先平,马尔可夫决策过程,长沙:湖南科学技术出版社,1998
    [89] Ikeda N,Nagasawa M and Watanabe S , Branching Markov processes and Ⅰ, Ⅱ, Ⅲ, Math J. Kyoto Univ., 8,233~278, 9,95~160,1968
    [90] Ikeda N and Watanabe, Stochastic Differential Equations and Diffusion processes. Noth-Holland:Amsterdam, 1981
    [91] Isaacson D L and Mabson R W, Markov Chains Theory and Applications,New york:John Wiley,1976
    [92] Jacod J, Multivariate point processes:predictable projections, Radon-Nikodym deriv-atives,representation of martingales. Z Wahrscheinlchkeitstheorie ver. Geb., 1975 (31):235~253
    [93] Kendall D G, Some problems in the theory ofqueues, J.Roy.Statist.Soc.,B,1951(13): 151~185
    [94] 刘国欣,Kolmogorov三级数定理的推广,数学物理学报,1995,15(3):311~314
    [95] 刘国欣,逐段决定的马尔可夫过程:[博士学位论文].长沙:长沙铁道学院,1998
    [96] 刘国欣, Onthe conditional version of Kohnogorov's three-series theorem, Acta Math. Sci.1999,19(3):300~306
    [97] 刘万荣、刘再明、侯振挺,马尔可夫骨架过程的构造,经济数学,2000,17(2):38~41
    [98] 刘万荣、刘再明、侯振挺,Markov 骨架过程的随机时变换,系统科学与数学,2000,2(3):361~366
    [99] 唐有荣、刘再明、侯振挺,广生灭过程的遍历性及平稳分布,数学物理学报,1996,No.4
    [100] 唐有荣、刘再明、侯振挺,广生灭过程的积分型随机泛函,国防科技大学学报,1998,No.4
    [101] 唐有荣、刘再明、侯振挺,随机环境中的M/M~Y/1排队系统,国防科技大学学报,1999,No.1
    [102] 唐有荣、刘再明、侯振挺,广生灭马氏链(Ⅰ),湖南数学年刊,1996,No.1
    [103] 何列卡,马尔可夫骨架过程的极限理论及其应用,[博士学位论文],长沙:中南大学,2004
    [104] 李民,马尔可夫骨架过程与GI/G/n排队系统:[博士学位论文],长沙:中南大学,2002.
    [105] 王益民,马尔可夫骨架过程在GI/G/n排队系统中的应用:[博士学位论文],长沙:中南大学,2003.
    [106] 戴清,马尔可夫骨架过程及其在Frac/G/I排队论中的应用:[博士学位论文],长沙:中南大学,2004.
    [107] 侯振挺,马尔可夫骨架过程及其应用,长沙:中南大学数学学院概率统计研究所,2004.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700