APPLICATION OF POWER NUMERICAL METHOD FOR THE STATIONARY DISTRIBUTION OF MARKOV CHAIN

Authors

  • Sunday Agboola Nigerian Army University Biu
  • Dr. Adebiyi Adeleke University Ede, Osun State, Nigeria

DOI:

https://doi.org/10.33003/fjs-2023-0702-1625

Keywords:

Eigenvalue, infinitesimal generator, normalization, power method, stationary distribution

Abstract

The evolution of this model is represented by transitions from one state to the next. Also, the physical or mathematical behavior of this system can also be illustrated by identifying all of the possible states and explaining how it transitions between them. The iterative solution approaches for the stationary distribution of Markov chains, which begin with an initial estimate of the solution vector  and it becomes closer and closer to the true solution with each iteration are investigated. Our goal is to compute solutions of stationary distribution of Markov chain by utilizing the power iterative method which leaves the transition matrices unchanged and saves time by considering the discretization effect, and the convergency. Matrices operations such as multiplication with one or more vectors, lower, diagonal and upper concepts of matrix, with the help of several existing Markov chain laws, theorems, formulas, and the normalization principle are applied. For the illustrative examples, the stationary distribution vectors  and table of convergence are obtained.

References

Cook, R.D. and Weisberg S. (1983). Diagnostics for heteroscedasticity in regression. Biometrika.70: 1–10

Diblasi, A. and Bowman, A.W. (1997). Testing for constancy of variance. Statistics and Probability,Letters. 33: 95–103

Draper, N. R. and Smith, H. (2003). Applied Regression Analysis. New York:Wiley.

Published

2023-04-30

How to Cite

Agboola, S., & Adebiyi, O. O. (2023). APPLICATION OF POWER NUMERICAL METHOD FOR THE STATIONARY DISTRIBUTION OF MARKOV CHAIN. FUDMA JOURNAL OF SCIENCES, 7(2), 19 - 24. https://doi.org/10.33003/fjs-2023-0702-1625