Results 11 to 20 of about 86,980 (313)
Line spectrum extraction method based on hidden Markov model
Electronics Letters, 2021 To solve the difficult problem of line spectrum detection with a low signal‐to‐noise ratio, a line spectrum extraction algorithm based on a hidden Markov model (HMM) is proposed.
Kai Ma +4 more
doaj +1 more source
Synchronizing Objectives for Markov Decision Processes [PDF]
Electronic Proceedings in Theoretical Computer Science, 2011 We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass.
Mahsa Shirmohammadi +2 more
doaj +1 more source
Abstraction-Based Planning for Uncertainty-Aware Legged Navigation
IEEE Open Journal of Control Systems, 2023 This article addresses the problem of temporal-logic-based planning for bipedal robots in uncertain environments. We first propose an Interval Markov Decision Process abstraction of bipedal locomotion (IMDP-BL). Motion perturbations from multiple sources
Jesse Jiang, Samuel Coogan, Ye Zhao
doaj +1 more source
Quantum Semi-Markov Processes [PDF]
Physical Review Letters, 2008 We construct a large class of non-Markovian master equations that describe the dynamics of open quantum systems featuring strong memory effects, which relies on a quantum generalization of the concept of classical semi-Markov processes. General conditions for the complete positivity of the corresponding quantum dynamical maps are formulated.
H. P. Breuer, B. Vacchini
openaire +5 more sources
Implementing Markovian models for extendible Marshall–Olkin distributions
Dependence Modeling, 2022 We derive a novel stochastic representation of exchangeable Marshall–Olkin distributions based on their death-counting processes. We show that these processes are Markov.
Sloot Henrik
doaj +1 more source
Controlled Discrete-Time Semi-Markov Random Evolutions and Their Applications
Mathematics, 2021 In this paper, we introduced controlled discrete-time semi-Markov random evolutions. These processes are random evolutions of discrete-time semi-Markov processes where we consider a control. applied to the values of random evolution.
Anatoliy Swishchuk, Nikolaos Limnios
doaj +1 more source
Rank-Driven Markov Processes [PDF]
Journal of Statistical Physics, 2011 32 pages, 2 colour ...
Grinfeld, Michael +2 more
openaire +5 more sources
Application of improved grey model residual modified fusion algorithm in dissolved gas forecasting
The Journal of Engineering, 2019 The power transformer directly affects whether the power system can operate safely and reliably, and the prediction of the dissolved gas content in the transformer oil is an effective means to discover transformer defects and latent faults, which helps ...
Wenjie Wu, Yigang He, Jiajun Duan
doaj +1 more source
Markov Processes in Data Center Networks
IEEE Access, 2021 A data center network is an important infrastructure in various applications of modern information technologies. Data centers store files with useful information, but the lifetime of these data centers is limited.
Fan-Qi Ma, Rui-Na Fan
doaj +1 more source
Estimation and control using sampling-based Bayesian reinforcement learning
IET Cyber-Physical Systems, 2019 Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modelling errors.
Patrick Slade +3 more
doaj +1 more source