Results 21 to 30 of about 399,699 (283)
Geometric branching reproduction Markov processes
Modern Stochastics: Theory and Applications, 2020 We present a model of a continuous-time Markov branching process with the infinitesimal generating function defined by the geometric probability distribution.
Assen Tchorbadjieff, Penka Mayster
doaj +1 more source
Markov-modulated affine processes
Stochastic Processes and their Applications, 2022 32 ...
Kevin Kurt, Rüdiger Frey
openaire +5 more sources
Надежность и качество сложных систем, 2022 Background. In the conditions of modern military conflicts, the problem of effective control of large groups of robots is actualized. The large amount of data associated with the operation of robotic systems (RC) determines the existence of ...
S.V. Ivanov +3 more
doaj +1 more source
Line spectrum extraction method based on hidden Markov model
Electronics Letters, 2021 To solve the difficult problem of line spectrum detection with a low signal‐to‐noise ratio, a line spectrum extraction algorithm based on a hidden Markov model (HMM) is proposed.
Kai Ma +4 more
doaj +1 more source
Controlled Discrete-Time Semi-Markov Random Evolutions and Their Applications
Mathematics, 2021 In this paper, we introduced controlled discrete-time semi-Markov random evolutions. These processes are random evolutions of discrete-time semi-Markov processes where we consider a control. applied to the values of random evolution.
Anatoliy Swishchuk, Nikolaos Limnios
doaj +1 more source
Markov Processes in Data Center Networks
IEEE Access, 2021 A data center network is an important infrastructure in various applications of modern information technologies. Data centers store files with useful information, but the lifetime of these data centers is limited.
Fan-Qi Ma, Rui-Na Fan
doaj +1 more source
Synchronizing Objectives for Markov Decision Processes [PDF]
Electronic Proceedings in Theoretical Computer Science, 2011 We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass.
Mahsa Shirmohammadi +2 more
doaj +1 more source
Timed Comparisons of Semi-Markov Processes [PDF]
, 2017 Semi-Markov processes are Markovian processes in which the firing time of the transitions is modelled by probabilistic distributions over positive reals interpreted as the probability of firing a transition at a certain moment in time.
Bacci, Giorgio +4 more
core +2 more sources
Consistency of Feature Markov Processes [PDF]
, 2010 We are studying long term sequence prediction (forecasting). We approach this by investigating criteria for choosing a compact useful state representation. The state is supposed to summarize useful information from the history.
Hutter, Marcus, Sunehag, Peter
core +2 more sources
Abstraction-Based Planning for Uncertainty-Aware Legged Navigation
IEEE Open Journal of Control Systems, 2023 This article addresses the problem of temporal-logic-based planning for bipedal robots in uncertain environments. We first propose an Interval Markov Decision Process abstraction of bipedal locomotion (IMDP-BL). Motion perturbations from multiple sources
Jesse Jiang, Samuel Coogan, Ye Zhao
doaj +1 more source