Results 31 to 40 of about 399,699 (283)
Rank-Driven Markov Processes [PDF]
Journal of Statistical Physics, 2011 32 pages, 2 colour ...
Grinfeld, Michael +2 more
openaire +5 more sources
Estimation and control using sampling-based Bayesian reinforcement learning
IET Cyber-Physical Systems, 2019 Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modelling errors.
Patrick Slade +3 more
doaj +1 more source
A Continuous-Time Semi-Markov System Governed by Stepwise Transitions
Mathematics, 2022 In this paper, we introduce a class of stochastic processes in continuous time, called step semi-Markov processes. The main idea comes from bringing an additional insight to a classical semi-Markov process: the transition between two states is ...
Vlad Stefan Barbu +2 more
doaj +1 more source
On a New Characterization of Harris Recurrence for Markov Chains and Processes
Mathematics, 2023 This paper shows that Harris recurrent Markov chains and processes can be characterized as the class of Markov chains and processes for which there exists a random time T at which the distribution of the chain or process does not depend on its initial ...
Peter Glynn, Yanlin Qu
doaj +1 more source
Application of improved grey model residual modified fusion algorithm in dissolved gas forecasting
The Journal of Engineering, 2019 The power transformer directly affects whether the power system can operate safely and reliably, and the prediction of the dissolved gas content in the transformer oil is an effective means to discover transformer defects and latent faults, which helps ...
Wenjie Wu, Yigang He, Jiajun Duan
doaj +1 more source
Implementing Markovian models for extendible Marshall–Olkin distributions
Dependence Modeling, 2022 We derive a novel stochastic representation of exchangeable Marshall–Olkin distributions based on their death-counting processes. We show that these processes are Markov.
Sloot Henrik
doaj +1 more source
Spatio-temporal Markov chain model for very-short-term wind power forecasting
The Journal of Engineering, 2019 Wind power forecasting (WPF) is crucial in helping schedule and trade wind power generation at various spatial and temporal scales. With increasing number of wind farms over a region, research focus of WPF methods has been recently moved onto exploring ...
Yongning Zhao +7 more
doaj +1 more source
Научный вестник МГТУ ГА, 2021 In civil aviation primary focus is on the quality of fuel filled in the aircraft fuel tanks, as one of the components of flight safety ensuring. The introduction of digital technologies and trends in automation, digitalization of modern civil aviation ...
V. M. Samoilenko +3 more
doaj +1 more source
Feature Markov Decision Processes [PDF]
, 2008 General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes (MDPs). So far it is
Hutter, Marcus
core +4 more sources
Operational Markov condition for quantum processes [PDF]
, 2018 We derive a necessary and sufficient condition for a quantum process to be Markovian which coincides with the classical one in the relevant limit. Our condition unifies all previously known definitions for quantum Markov processes by accounting for all ...
Frauenheim, Thomas +4 more
core +2 more sources