APPLICATION OF POWER NUMERICAL METHOD FOR THE STATIONARY DISTRIBUTION OF MARKOV CHAIN
DOI:
https://doi.org/10.33003/fjs-2023-0702-1625Keywords:
Eigenvalue, infinitesimal generator, normalization, power method, stationary distributionAbstract
The evolution of this model is represented by transitions from one state to the next. Also, the physical or mathematical behavior of this system can also be illustrated by identifying all of the possible states and explaining how it transitions between them. The iterative solution approaches for the stationary distribution of Markov chains, which begin with an initial estimate of the solution vector and it becomes closer and closer to the true solution with each iteration are investigated. Our goal is to compute solutions of stationary distribution of Markov chain by utilizing the power iterative method which leaves the transition matrices unchanged and saves time by considering the discretization effect, and the convergency. Matrices operations such as multiplication with one or more vectors, lower, diagonal and upper concepts of matrix, with the help of several existing Markov chain laws, theorems, formulas, and the normalization principle are applied. For the illustrative examples, the stationary distribution vectors and table of convergence are obtained.
References
Cook, R.D. and Weisberg S. (1983). Diagnostics for heteroscedasticity in regression. Biometrika.70: 1–10
Diblasi, A. and Bowman, A.W. (1997). Testing for constancy of variance. Statistics and Probability,Letters. 33: 95–103
Draper, N. R. and Smith, H. (2003). Applied Regression Analysis. New York:Wiley.
Published
How to Cite
Issue
Section
FUDMA Journal of Sciences