APPLICATION OF RENEWAL REWARD PROCESSES IN HOMOGENEOUS DISCRETE MARKOV CHAIN
Abstract
A renewal process which is a special type of a counting process, which counts the number of events that occur up to (and including) time has been investigated, in order to provide some insight into the performance measures in renewal process and sequence such as, the mean time between successive renewals, ; Laplace-Stiltjes transform (LST) of the mean time, ; the Laplace-Stieltjes transform (LST) of the mean time distribution function, ; Laplace-Stiltjes transform (LST) of fold convolution of distribution function, ; the time at which the renewal occurs, the average number of renewals per unit time over the interval (0, t], and expected reward, . Our quest is to analyse the distribution function of the renewal process and sequence using the concept of discrete time Markov chain to obtain the aforementioned performance measures. Some properties of the Erlang , exponential and geometric distributions are used with the help of some existing laws, theorems and formulas of Markov chain. We concluded our study through illustrative examples that, it is not possible for an infinite number of renewals to occur in a finite period of time; Also, the expected number of renewals increases linearly with time; and from the uniqueness property, we affirmed that, the Poisson process is the only renewal process with a linear mean-value function; and lastly, we obtained the optimal replacement policy for a manufacturing machine which showed that, the exponential property of the lifetime
References
Agboola, S. O. (2016). Repairman problem with multiple batch deterministic repairs, Unpublished Ph.D. Thesis, Obafemi Awolowo University, Ile-Ife, Nigeria, 256pp.
Azizah, A., Welastica, R., Nur, F., Ruchjana, B. and Abdullah, A. (2019). An application of Markov chain for predicting rainfall data at West Java using data mining approach, Earth and Environmental Science, 303(1): 203 – 216.
Clemence. T. (2019). Markov chain modelling of HIV, Tuberculosis, and Hepatitis B transmission in Ghana, Hindawi, Interdisciplinary Perspective on Infectious Disease, 27(1): 204 – 214.
Pesch, T., Schroder, S., Allelein, H. and Hake, J. (2015). A new Markov chain related statistical approach for modelling synthetic wind power time series, New Journal of Physics, Dentsche Physikalishe, 35(2): 64 – 85.
Ramaswami, V. (1988). A Stable Recursion for the Steady State Vector in Markov chains of M/G/1 type. Communication in Statist. Stochastic Models, 4(1): 183–188.
Ramaswami, V and Neuts, M. F. (1980). Some explicit formulas and computational methods for infinite server queues with phase type arrivals. Journal of Applied Probability, 17(1): 498–514.
Romanovsky, V.I. (1970). Discrete Markov Chains, Wolters-Noord off, Groningen, Netherlands.pp.23 – 44.
Stewart, W. J. (1994). Introduction to the Numerical Solution of Markov Chains. Princeton University Press, Princeton, N.J. pp. 14 – 38.
Stewart, W. J. (2009). Probability, Markov Chain, Queues and Simulation, Princeton University Press, United Kingdom. pp. 1- 42.
Uzun, B. and Kiral, E. (2017). Application of Markov chain-fuzzy states to gold price, Science Direct. ELSEVIER, 120(1): 365 – 371.
Vermeer, S. And Trilling, D. (2020): Toward a better understanding of a new user journeys: A Markov chain approach. Journalism Journal, 21(1): 879 – 894.
Zakaria, N. N., Mahmod, O., Rajalmgan, S., Hamita, D., Lazim, A. and Evizal, A. (2019). Markov chain model development for forecasting air pollution index of Miri, Sarawak, Sustainability 11(1): 5190 -5202.
Copyright (c) 2021 FUDMA JOURNAL OF SCIENCES
This work is licensed under a Creative Commons Attribution 4.0 International License.
FUDMA Journal of Sciences
