Results 21 to 30 of about 38,584 (203)

Limiting Distribution of the Three-State Semi-Markov Model of Technical State Transitions of Ship Power Plant Machines and its Applicability in Operational Decision-Making

open access: yesPolish Maritime Research, 2020
The article presents the three-state semi-Markov model of the process {W(t): t ≥ 0} of state transitions of a ship power plant machine, with the following interpretation of these states: s1 – state of full serviceability, s2 – state of partial ...
Girtler Jerzy
doaj   +1 more source

Hierarchical dialogue optimization using semi-Markov decision processes [PDF]

open access: yesInterspeech 2007, 2007
This paper addresses the problem of dialogue optimization on large search spaces. For such a purpose, in this paper we propose to learn dialogue strategies using multiple Semi-Markov Decision Processes and hierarchical reinforcement learning. This approach factorizes state variables and actions in order to learn a hierarchy of policies. Our experiments
Cuayáhuitl, Heriberto   +3 more
openaire   +2 more sources

Research of reliability and efficiency of technological processes of mechanical assembly production on the basis of the common semi-Markov model

open access: yesMATEC Web of Conferences, 2018
In the article a common semi-Markov mathematical model is considered that allows one to investigate the productivity and reliability of various technological processes of mechanical assembly production.
Rapatskiy Yuri   +5 more
doaj   +1 more source

Some work and some play: microscopic and macroscopic approaches to labor and leisure. [PDF]

open access: yesPLoS Computational Biology, 2014
Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other.
Ritwik K Niyogi   +2 more
doaj   +1 more source

Optimal maintenance of deteriorating equipment using semi-Markov decision processes and linear programming [PDF]

open access: yesInternational Journal of Industrial Engineering and Management
This paper considers a mathematical model analysing the deterioration of system equipment and available maintenance options. Under specific conditions on costs and transition probabilities of the model, the issue of ideal maintenance of the equipment by ...
Giannis Kechagias   +3 more
doaj   +1 more source

Nonstationary Continuous Time Markov Decision Processes in a Semi-Markov Environment with Discounted Criterion [PDF]

open access: yes, 1995
This paper deals with the nonstationary continuous time Markov decision process in a semi-Markov environment with discounted criterion. The model can describe a system that itself can be modeled by a countable state nonstationary continuous time Markov ...
Hu, Q.Y.
core   +1 more source

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

open access: yesApplied Sciences, 2022
Recently, using unmanned aerial vehicles (UAVs) to collect information from distributed sensors has become one of the hotspots in the Internet of Things (IoT) research. However, previous studies on the UAV-assisted data acquisition systems focused mainly
Zhenquan Qin   +5 more
doaj   +1 more source

Non-Stationary Semi-Markov Decision Processes on a Finite Horizon [PDF]

open access: yes, 2012
We introduce and study a class of non-stationary semi-Markov decision processes on a finite horizon. By constructing an equivalent Markov decision process, we establish the existence of a piecewise open loop relaxed control which is optimal for the ...
Ghosh, Mrinal K, Saha, Subhamay
core   +1 more source

Post-earthquake performance recovery models for shield tunnels based on semi-Markov processes: development and application

open access: yesYantu gongcheng xuebao
To address the complexity and uncertainty inherent in the post-earthquake damage state recovery process of shield tunnels, a method for establishing performance recovery models based on semi-Markov processes is proposed, enabling quantitative assessment ...
ZENG Nianchen 1, HUANG Zhongkai 1, ZHANG Dongmei 1, 2, 3, GAN Binlin 1, 2
doaj   +1 more source

Mixed Markov Decision Processes in a Semi-Markov Environment with Discounted Criterion [PDF]

open access: yes, 1998
This paper presents a new model: the mixed Markov decision process (MDP) in a semi-Markov environment with discounted criterion. It describes a system which behaves like a MDP except that the system is influenced by its semi-Markov process environment ...
Hu, Qiying, Wang, Jinling
core   +1 more source

Home - About - Disclaimer - Privacy