Results 21 to 30 of about 9,481,834 (176)

Optimal Intervention in Semi-Markov-Based Asynchronous Probabilistic Boolean Networks

Complexity, 2018
Synchronous probabilistic Boolean networks (PBNs) and generalized asynchronous PBNs have received significant attention over the past decade as a tool for modeling complex genetic regulatory networks.
Qiuli Liu, Qingguo Zeng, Jinghao Huang, Deliang Li   +3 more
doaj   +1 more source

Efficient qualitative analysis of classes of recursive markov decision processes and simple stochastic games [PDF]

, 2006
. Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs) are natural models for recursive systems involving both probabilistic and non-probabilistic actions.
Mihalis Yannakakis, Yannakakis, Mihalis, Etessami, Kousha; id_orcid, Kousha Etessami   +3 more
core   +1 more source

Mean-variance optimality for semi-Markov decision processes under first passage criteria [PDF]

, 2017
summary:This paper deals with a first passage mean-variance problem for semi-Markov decision processes in Borel spaces. The goal is to minimize the variance of a total discounted reward up to the system's first entry to some target set, where the ...
Xiangxiang Huang, Huang, Yonghui, Huang, Xiangxiang, Yonghui Huang   +3 more
core   +1 more source

Asymptotic Expansions for Moments of Hitting Times for Nonlinearly Perturbed Semi-Markov Processes

, 2017
In Chapter 3, we introduce a model of perturbed semi-Markov processes, formulate basic perturbation conditions, describe a one-step time-space screening procedure of phase space reduction for perturbed semi-Markov processes, introduce hitting times, and ...
Sergei Silvestrov, Silvestrov, Sergei,, Silvestrov, D.,, Dmitrii Silvestrov   +3 more
core   +1 more source

Undiscounted Semi-Markov Decision Processes with Countably Infinite Action Spaces

Algorithms
In this article, we study semi-Markov decision processes (SMDPs) under the limiting ratio average (undiscounted) pay-off criterion, where the state space is finite and the action space of the decision maker is possibly countably infinite.
Kushal Guha Bakshi, Sagnik Sinha, Ramakant Bhardwaj, Purvee Bhardwaj, Satyendra Narayan   +4 more
doaj   +1 more source

Nonlinearly Perturbed Birth-Death-Type Semi-Markov Processes

, 2017
In Chapter 5, we present asymptotic expansions for stationary and conditional quasi-stationary distributions of nonlinearly perturbed birth-death-type semi-Markov processes, which play an important role in many applications.
Sergei Silvestrov, Silvestrov, Sergei,, Silvestrov, D.,, Dmitrii Silvestrov   +3 more
core   +1 more source

An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes

Applied Sciences
Coordinating multiple unmanned aerial vehicle (UAV) systems under strict energy and temporal constraints remains a complex scheduling problem. Existing reinforcement learning methods typically rely on fixed-time-step modeling, which struggles to ...
Feng Wang, Bingwei Ding, Fangchao Tian, Zhaohua Guo, Wenshuo Ma   +4 more
doaj   +1 more source

First passage risk probability optimality for continuous time Markov decision processes [PDF]

, 2019
summary:In this paper, we study continuous time Markov decision processes (CTMDPs) with a denumerable state space, a Borel action space, unbounded transition rates and nonnegative reward function.
Wen, Xian, Huo, Haifeng
core   +1 more source

Bridging the Synchrony Gap: A Deterministic GSMDP Approach for Integrating Deep Reinforcement Learning with Commercial Discrete Event Simulators

Proceedings of the Conference on Production Systems and Logistics
Although Deep Reinforcement Learning (DRL) offers adaptive control for manufacturing processes, training agents within high-fidelity commercial Discrete Event Simulation (DES) tools is hindered by the temporal mismatch between the continuous-time event ...
Varici, Merve Demir, Tercan, Hasan, Meisen, Tobias, Herberger, David, Hübner, Marco   +4 more
doaj   +1 more source

Method of Building a Model of Operational Changes for the Marine Combustion Engine Describing the Impact of the Damages of This Engine on the Characteristics of Its Operation Process

Polish Maritime Research, 2017
This article deals with the modeling of the processes of operating both marine main and auxiliary engines. The paper presents a model of changes in operating conditions of ship’s internal combustion engine.
Landowski Bogdan, Pająk Michał, Żółtowski Bogdan, Muślewski Łukasz   +3 more
doaj   +1 more source