Multi-scale metastable dynamics and the asymptotic stationary distribution of perturbed Markov chains

详细信息    查看全文

• 作者：Volker Betz^a ; ^{betz@mathematik.tu-darmstadt.de" class="auth_mail" title="E-mail the corresponding author} ; ; Sté ; phane Le Roux^b ; ^{stephane.le.roux@ulb.ac.be" class="auth_mail" title="E-mail the corresponding author} ;
• 关键词：60J10 ; 60J22
• 刊名：Stochastic Processes and their Applications
• 出版年：2016
• 出版时间：November 2016
• 年：2016
• 卷：126
• 期：11
• 页码：3499-3526
• 全文大小：408 K

文摘

We assume that the transition matrix of a Markov chain depends on a parameter ε$\epsilon$, and converges as ε→0$\epsilon \to 0$. The chain is irreducible for ε>0$\epsilon >0$ but may have several essential communicating classes when ε=0$\epsilon =0$. This leads to metastable behavior, possibly on multiple time scales. For each of the relevant time scales, we derive two effective chains. The first one describes the (possibly irreversible) metastable dynamics, while the second one is reversible and describes metastable escape probabilities. Closed probabilistic expressions are given for the asymptotic transition probabilities of these chains. As a consequence, we obtain efficient algorithms for computing the committor function and the limiting stationary distribution.