Volume 53, Number 5, November-December 2019
|Page(s)||1819 - 1841|
|Published online||15 October 2019|
A Markov decision model with dead ends for operating room planning considering dynamic patient priority
Laboratoire Nanomédecine, Imagerie et Thérapeutiques, Université Bourgogne Franche-Comté, UTBM, Rue Thierry Mieg, 90010 Belfort cedex, France
* Corresponding author: email@example.com
Accepted: 25 November 2018
This paper addresses an operating room planning problem with surgical demands from both the elective patients and the non-elective ones. A dynamic waiting list is established to prioritize and manage the patients according to their urgency levels and waiting times. In every decision period, sequential decisions are taken by selecting high-priority patients from the waiting list to be scheduled. With consideration of random arrivals of new patients and uncertain surgery durations, the studied problem is formulated as a novel Markov decision process model with dead ends. The objective is to optimize a combinatorial cost function involving patient waiting times and operating room over-utilizations. Considering that the conventional dynamic programming algorithms have difficulties in coping with large-scale problems, we apply several adapted real-time dynamic programming algorithms to solve the proposed model. In numerical experiments, we firstly apply different algorithms to solve the same instance and compare the computational efficiencies. Then, to evaluate the effects of dead ends on the policy and the computation, we conduct simulations for multiple instances with the same problem scale but different dead ends. Experimental results indicate that incorporating dead ends into the model helps to significantly shorten the patient waiting times and improve the computational efficiency.
Mathematics Subject Classification: 90B36 / 90B50 / 90C39 / 90C40
Key words: Operating room planning / Markov decision process / dead end / real-time dynamic programming
© EDP Sciences, ROADEF, SMAI 2019
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.