Results 11 to 20 of about 29,628 (317)
Jarzyski’s Equality and Crooks’ Fluctuation Theorem for General Markov Chains with Application to Decision-Making Systems [PDF]
Entropy, 2022 We define common thermodynamic concepts purely within the framework of general Markov chains and derive Jarzynski’s equality and Crooks’ fluctuation theorem in this setup.
Pedro Hack +2 more
doaj +2 more sources
Invariant Finitely Additive Measures for General Markov Chains and the Doeblin Condition
Mathematics, 2023 In this paper, we consider general Markov chains with discrete time in an arbitrary measurable (phase) space. Markov chains are given by a classical transition function that generates a pair of conjugate linear Markov operators in a Banach space of ...
Alexander Zhdanok
doaj +1 more source
Decomposition of Finitely Additive Markov Chains in Discrete Space
Mathematics, 2022 In this study, we consider general Markov chains (MC) defined by a transition probability (kernel) that is finitely additive. These Markov chains were constructed by S. Ramakrishnan within the concepts and symbolism of game theory.
Alexander Zhdanok, Anna Khuruma
doaj +1 more source
Markov Chains for Computer Music Generation
Journal of Humanistic Mathematics, 2021 Random generation of music goes back at least to the 1700s with the introduction of Musical Dice Games. More recently, Markov chain models have been used as a way of extracting information from a piece of music and generating new music. We explain this approach and give Python code for using it to first draw out a model of the music and then create new
Shapiro, Ilana, Huber, Mark
openaire +3 more sources
A Definition Scheme for Quantitative Bisimulation [PDF]
Electronic Proceedings in Theoretical Computer Science, 2015 FuTS, state-to-function transition systems are generalizations of labeled transition systems and of familiar notions of quantitative semantical models as continuous-time Markov chains, interactive Markov chains, and Markov automata.
Diego Latella +2 more
doaj +1 more source
Trace Refinement in Labelled Markov Decision Processes [PDF]
Logical Methods in Computer Science, 2020 Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.
Nathanaël Fijalkow +2 more
doaj +1 more source
On the Comparison of Markov Chains-based Models in Process Mining for Healthcare: A Case Study
Proceedings of the International Florida Artificial Intelligence Research Society Conference, 2023 In the last decade, Process Mining has become a significant field to help healthcare process experts understand and gain relevant insights about the processes they execute.
Mauro Vallati +5 more
doaj +1 more source
Markov chains generated by convolutions of orthogonality measures
Journal of Physics A: Mathematical and Theoretical, 2022 Abstract About two dozens of exactly solvable Markov chains on one-dimensional finite and semi-infinite integer lattices are constructed in terms of convolutions of orthogonality measures of the Krawtchouk, Hahn, Meixner, Charlier, q -Hahn, q
Satoru Odake, Ryu Sasaki
openaire +3 more sources
Stability Estimates for Finite-Dimensional Distributions of Time-Inhomogeneous Markov Chains
Mathematics, 2020 This paper is devoted to the study of the stability of finite-dimensional distribution of time-inhomogeneous, discrete-time Markov chains on a general state space.
Vitaliy Golomoziy, Yuliya Mishura
doaj +1 more source