Results 1 to 10 of about 144,876 (334)
Jarzyski’s Equality and Crooks’ Fluctuation Theorem for General Markov Chains with Application to Decision-Making Systems [PDF]
Entropy, 2022 We define common thermodynamic concepts purely within the framework of general Markov chains and derive Jarzynski’s equality and Crooks’ fluctuation theorem in this setup.
Pedro Hack +2 more
doaj +6 more sources
Invariant Finitely Additive Measures for General Markov Chains and the Doeblin Condition [PDF]
Mathematics, 2023 In this paper, we consider general Markov chains with discrete time in an arbitrary measurable (phase) space. Markov chains are given by a classical transition function that generates a pair of conjugate linear Markov operators in a Banach space of ...
Alexander Zhdanok
doaj +4 more sources
A Definition Scheme for Quantitative Bisimulation [PDF]
Electronic Proceedings in Theoretical Computer Science, 2015 FuTS, state-to-function transition systems are generalizations of labeled transition systems and of familiar notions of quantitative semantical models as continuous-time Markov chains, interactive Markov chains, and Markov automata.
Diego Latella +2 more
doaj +4 more sources
General Markov Chains: Dimension of the Space of Invariant Finitely Additive Measures and Their Ergodicity—Problematic Examples [PDF]
MathematicsThis study considers general Markov chains (MCs) with discrete time in an arbitrary phase space. The transition function of the MC generates two operators: T, which acts on the space of measurable functions, and A, which acts on the space of bounded ...
Alexander Zhdanok
doaj +2 more sources
Quasi-Compactness of Operators for General Markov Chains and Finitely Additive Measures [PDF]
MathematicsWe study Markov operators T, A, and T* of general Markov chains on an arbitrary measurable space. The operator, T, is defined on the Banach space of all bounded measurable functions.
Alexander Zhdanok
doaj +2 more sources
General state space Markov chains and MCMC algorithms [PDF]
Probability Surveys, 2004 Gareth O. Roberts, Jeffrey S. Rosenthal
doaj +2 more sources
Markov Chains for Computer Music Generation
Journal of Humanistic Mathematics, 2021 Random generation of music goes back at least to the 1700s with the introduction of Musical Dice Games. More recently, Markov chain models have been used as a way of extracting information from a piece of music and generating new music. We explain this approach and give Python code for using it to first draw out a model of the music and then create new
Shapiro, Ilana, Huber, Mark
openaire +3 more sources
Decomposition of Finitely Additive Markov Chains in Discrete Space
Mathematics, 2022 In this study, we consider general Markov chains (MC) defined by a transition probability (kernel) that is finitely additive. These Markov chains were constructed by S. Ramakrishnan within the concepts and symbolism of game theory.
Alexander Zhdanok, Anna Khuruma
doaj +1 more source
Trace Refinement in Labelled Markov Decision Processes [PDF]
Logical Methods in Computer Science, 2020 Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.
Nathanaël Fijalkow +2 more
doaj +1 more source