Results 21 to 30 of about 193,674 (278)
Plithogenic and Neutrosophic Markov Chains: Modeling Uncertainty and Ambiguity in Stochastic Processes [PDF]
Neutrosophic Sets and Systems, 2023 In this work we present for the first time the concept of literal neutrosophic markov chains and literal plithogenic markov chains. Also, we presented many theorems related to the properties of transition matrix.
Suhar Massassati +2 more
doaj
Electronic Journal of Probability, 2023 36 pages, 9 ...
Defant, Colin, Li, Rupert
openaire +3 more sources
Journal of Applied Mathematics, 2020 This paper deals with the computation of invariant measures and stationary expectations for discrete-time Markov chains governed by a block-structured one-step transition probability matrix.
Hendrik Baumann, Thomas Hanschke
doaj +1 more source
, 2018 This book covers the classical theory of Markov chains on general state-spaces as well as many recent developments. The theoretical results are illustrated by simple examples, many of which are taken from Markov Chain Monte Carlo methods. The book is self-contained, while all the results are carefully and concisely proven.
Douc, Randal +3 more
+6 more sources
Future Internet, 2023 In this paper we consider the research and development of classifiers that are trained to predict the task solved by source code. Possible applications of such task detection algorithms include method name prediction, hardware–software partitioning ...
Artyom V. Gorchakov +2 more
doaj +1 more source
Isotropy Properties of the Multi-Step Markov Symbolic Sequences [PDF]
, 2006 A new object of the probability theory, the two-sided chain of symbols (introduced in Ref. arXiv:physics/0306170) is used to study isotropy properties of binary multi-step Markov chains with the long-range correlations.
Balucani +24 more
core +2 more sources
Journal of Applied Probability, 2014 The extremes of a univariate Markov chain with regularly varying stationary marginal distribution and asymptotically linear behavior are known to exhibit a multiplicative random walk structure called the tail chain. In this paper we extend this fact to Markov chains with multivariate regularly varying marginal distributions in R
Janssen, A., Segers, J.
openaire +5 more sources
Parametric Markov Chains: PCTL Complexity and Fraction-free Gaussian Elimination [PDF]
Electronic Proceedings in Theoretical Computer Science, 2017 Parametric Markov chains have been introduced as a model for families of stochastic systems that rely on the same graph structure, but differ in the concrete transition probabilities. The latter are specified by polynomial constraints for the parameters.
Lisa Hutschenreiter +2 more
doaj +1 more source
Optimal control of multiple Markov-switching stochastic systems with numerical applications
Results in Control and Optimization, 2022 In this article the authors set up an optimal control framework for a hybrid stochastic system with dual or multiple Markov switching diffusion processes, while Markov chains governing these switching diffusions are not identical as assumed in the ...
Jianmin Shi
doaj +1 more source
The Annals of Probability, 1975 We propose a control problem in which we minimize the expected hitting time of a fixed state in an arbitrary Markov chains with countable state space. A Markovian optimal strategy exists in all cases, and the value of this strategy is the unique solution of a nonlinear equation involving the transition function of the Markov chain.
Kesten, Harry, Spitzer, Frank
openaire +3 more sources