Volume 56, Number 4, July-August 2022
|2881 - 2894
|24 August 2022
Analysis of a discrete-time Markov process with a bounded continuous state space by the Fredholm integral equation of the second kind
Nagoya Institute of Technology, Nagoya, Japan
2 Jashore University of Science and Technology, Jashore, Bangladesh
* Corresponding author: firstname.lastname@example.org
Accepted: 11 June 2022
A discrete-time Markov process with a bounded continuous state space is considered. We show that the equilibrium equations on steady-state probability and densities form Fredholm integral equations of the second kind. Then, under a sufficient condition that the transition densities from one state to another state inside the boundaries of the state space can be expressed in the same separate forms, the steady-state probability and density functions can be obtained explicitly. We use it to demonstrate an economic production quantity model with stochastic production time, derive the expressions of the steady-state probabilities and densities, and find the optimal maximum stock level. A sensitivity analysis of the optimal stock level is performed using production time and cost parameters. The optimal stock level decreases with respect to the holding cost and the production cost, whereas it increases with respect to the lost sale cost and the arrival rate.
Mathematics Subject Classification: 60J05 / 45B05
Key words: Markov process / continuous state / Fredholm integral equation / steady state probability
© The authors. Published by EDP Sciences, ROADEF, SMAI 2022
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.