Research ArticleOpen accessPhrase in the titleComputational Discrete Time Markov Chain with Correlated Transition ProbabilitiesPeerayuth CharnsethikulThis study presents a computational procedure for analyzing statistics of steady state probabilities in a discrete time Markov chain with correlations among their transition probabilities. The proposed model simply uses the first order Taylor’s series expansion and statistical expected value properties to obtain the resulting linear matrix equations system. Computationally, the bottleneck is O(n4) but can be improved by distributed … …Journal of Mathematics and Statistics, Vol. 2, Issue 4 · 31 Dec 2007 · 6,648 accessesView PDFCite