Results 31 to 40 of about 103,535 (312)
Recursive Markov Decision Processes and Recursive Stochastic Games [PDF]
, 2005 We introduce Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs), and study the decidability and complexity of algorithms for their analysis and verification.
Mihalis Yannakakis +3 more
core +1 more source
A Continuous-Time Semi-Markov System Governed by Stepwise Transitions
Mathematics, 2022 In this paper, we introduce a class of stochastic processes in continuous time, called step semi-Markov processes. The main idea comes from bringing an additional insight to a classical semi-Markov process: the transition between two states is ...
Vlad Stefan Barbu +2 more
doaj +1 more source
Markov processes follow from the principle of maximum caliber. [PDF]
J Chem Phys, 2012 Ge H, Pressé S, Ghosh K, Dill KA.
europepmc +2 more sources
Estimation and control using sampling-based Bayesian reinforcement learning
IET Cyber-Physical Systems, 2019 Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modelling errors.
Patrick Slade +3 more
doaj +1 more source
Implementing Markovian models for extendible Marshall–Olkin distributions
Dependence Modeling, 2022 We derive a novel stochastic representation of exchangeable Marshall–Olkin distributions based on their death-counting processes. We show that these processes are Markov.
Sloot Henrik
doaj +1 more source
Научный вестник МГТУ ГА, 2021 In civil aviation primary focus is on the quality of fuel filled in the aircraft fuel tanks, as one of the components of flight safety ensuring. The introduction of digital technologies and trends in automation, digitalization of modern civil aviation ...
V. M. Samoilenko +3 more
doaj +1 more source
Application of improved grey model residual modified fusion algorithm in dissolved gas forecasting
The Journal of Engineering, 2019 The power transformer directly affects whether the power system can operate safely and reliably, and the prediction of the dissolved gas content in the transformer oil is an effective means to discover transformer defects and latent faults, which helps ...
Wenjie Wu, Yigang He, Jiajun Duan
doaj +1 more source
Spatio-temporal Markov chain model for very-short-term wind power forecasting
The Journal of Engineering, 2019 Wind power forecasting (WPF) is crucial in helping schedule and trade wind power generation at various spatial and temporal scales. With increasing number of wind farms over a region, research focus of WPF methods has been recently moved onto exploring ...
Yongning Zhao +7 more
doaj +1 more source
Efficient qualitative analysis of classes of recursive markov decision processes and simple stochastic games [PDF]
, 2006 . Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs) are natural models for recursive systems involving both probabilistic and non-probabilistic actions.
Mihalis Yannakakis +3 more
core +1 more source
Nonlinear Markov processes in big networks
Special Matrices, 2016 Big networks express multiple classes of large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems.
Li Quan-Lin
doaj +1 more source