Results 21 to 30 of about 14,317,493 (293)

Research of reliability and efficiency of technological processes of mechanical assembly production on the basis of the common semi-Markov model

MATEC Web of Conferences, 2018
In the article a common semi-Markov mathematical model is considered that allows one to investigate the productivity and reliability of various technological processes of mechanical assembly production.
Rapatskiy Yuri, Zamorenov Mikhail, Kopp Vadim, Obzherin Yuri, Gusev Vladimir, Lipka Victoria   +5 more
doaj   +1 more source

Hierarchical dialogue optimization using semi-Markov decision processes [PDF]

Interspeech 2007, 2007
This paper addresses the problem of dialogue optimization on large search spaces. For such a purpose, in this paper we propose to learn dialogue strategies using multiple Semi-Markov Decision Processes and hierarchical reinforcement learning. This approach factorizes state variables and actions in order to learn a hierarchy of policies. Our experiments
Cuayáhuitl, Heriberto, Renals, Steve, Lemon, Oliver, Shimodaira, Hiroshi   +3 more
openaire   +3 more sources

Some work and some play: microscopic and macroscopic approaches to labor and leisure. [PDF]

PLoS Computational Biology, 2014
Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other.
Ritwik K Niyogi, Peter Shizgal, Peter Dayan   +2 more
doaj   +1 more source

Optimal maintenance of deteriorating equipment using semi-Markov decision processes and linear programming [PDF]

International Journal of Industrial Engineering and Management
This paper considers a mathematical model analysing the deterioration of system equipment and available maintenance options. Under specific conditions on costs and transition probabilities of the model, the issue of ideal maintenance of the equipment by ...
Giannis Kechagias, Alexandros Diamantidis, Theodosis Dimitrakos, Mariza Tsakalerou   +3 more
doaj   +1 more source

Efficient qualitative analysis of classes of recursive markov decision processes and simple stochastic games [PDF]

, 2006
. Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs) are natural models for recursive systems involving both probabilistic and non-probabilistic actions.
Mihalis Yannakakis, Yannakakis, Mihalis, Etessami, Kousha; id_orcid, Kousha Etessami   +3 more
core   +1 more source

The UAV Trajectory Optimization for Data Collection from Time-Constrained IoT Devices: A Hierarchical Deep Q-Network Approach

Applied Sciences, 2022
Recently, using unmanned aerial vehicles (UAVs) to collect information from distributed sensors has become one of the hotspots in the Internet of Things (IoT) research. However, previous studies on the UAV-assisted data acquisition systems focused mainly
Zhenquan Qin, Xuan Zhang, Xinwei Zhang, Bingxian Lu, Zhonghao Liu, Linlin Guo   +5 more
doaj   +1 more source

Applied semi-Markov process

, 2005
Applied Semi-Markov Processes aims to give to the reader the tools necessary to apply semi-Markov processes in real-life problems. The book is self-contained and, starting from a low level of probability concepts, gradually brings the reader to a deep ...
Manca, Raimondo, Janssen, Jacques, JANSSEN J.   +2 more
core   +1 more source

Derivation of passage-time densities in PEPA models using ipc: the imperial PEPA compiler [PDF]

, 2003
We present a technique for defining and extracting passage-time densities from high-level stochastic process algebra models. Our high-level formalism is PEPA, a popular Markovian process algebra for expressing compositional performance models.
Knottenbelt,W.J., Bradley, J.T., Knottenbelt, W.J., Dingle,N.J., S.T. Gilmore, Gilmore,S.T., N.J. Dingle, Dingle, N.J., Gilmore, S.T.; id_orcid, W.J. Knottenbelt, Bradley,J.T., J.T. Bradley   +11 more
core   +1 more source

Post-earthquake performance recovery models for shield tunnels based on semi-Markov processes: development and application

Yantu gongcheng xuebao
To address the complexity and uncertainty inherent in the post-earthquake damage state recovery process of shield tunnels, a method for establishing performance recovery models based on semi-Markov processes is proposed, enabling quantitative assessment ...
ZENG Nianchen 1, HUANG Zhongkai 1, ZHANG Dongmei 1, 2, 3, GAN Binlin 1, 2
doaj   +1 more source

Maintenance strategy optimization using a continuous-state partially observable semi-Markov decision process

, 2011
Due to the limitation of current condition monitoring technologies, the estimates of asset health states may contain some uncertainties. A maintenance strategy ignoring this uncertainty of asset health state can cause additional costs or downtime.
Wolff, Rodney C., Yifan Zhou, Mathew, Joseph, Rodney Wolff, Sun, Yong, Yong Sun, Ma, Lin, Lin Ma, Joseph Mathew, Zhou, Yifan   +9 more
core   +1 more source