Results 31 to 40 of about 1,572 (217)
The Annals of Probability, 1975 We propose a control problem in which we minimize the expected hitting time of a fixed state in an arbitrary Markov chains with countable state space. A Markovian optimal strategy exists in all cases, and the value of this strategy is the unique solution of a nonlinear equation involving the transition function of the Markov chain.
Kesten, Harry, Spitzer, Frank
openaire +3 more sources
Approximating Markov chains. [PDF]
Proceedings of the National Academy of Sciences, 1992 A common framework of finite state approximating Markov chains is developed for discrete time deterministic and stochastic processes. Two types of approximating chains are introduced: (i) those based on stationary conditional probabilities (time averaging) and (ii) transient, based on the percentage of the Lebesgue measure of the image of cells ...
openaire +2 more sources
Segregating Markov Chains [PDF]
Journal of Theoretical Probability, 2017 Dealing with finite Markov chains in discrete time, the focus often lies on convergence behavior and one tries to make different copies of the chain meet as fast as possible and then stick together. There is, however, a very peculiar kind of discrete finite Markov chain, for which two copies started in different states can be coupled to meet almost ...
Timo Hirscher, Anders Martinsson
openaire +2 more sources
Using Markov Chains in Medical Field [PDF]
المجلة العراقية للعلوم الاحصائية, 2018 تم فی ىذا البحث د ا رسة السمسمة الزمنیة لعدد الإصابات بمرض ذات الرئة کمتسمسمة مارکوف ، وذلک بوضع افت ا رضات عمى عدد الإصابات لصیاغة المسألة وفق نموذج متسمسمة مارکوف بالاعتماد عمى عدد الحالات التی تمثل الظاىر. وبعد إیجاد الصفات الإحصائیة لیذه السمسمة تبین
Abd Al-Gafoor G. Al-Obeady +1 more
doaj +1 more source
Markov and Semi-Markov Chains, Processes, Systems, and Emerging Related Fields
Mathematics, 2021 Probability resembles the ancient Roman God Janus since, like Janus, probability also has a face with two different sides, which correspond to the metaphorical gateways and transitions between the past and the future [...]
P.-C.G. Vassiliou, Andreas C. Georgiou
doaj +1 more source
Publications de l'Institut Mathematique, 2008 Let {Xi, i _? 1} denote a sequence of variables that take values in {0, 1} and suppose that the sequence forms a Markov chain with transition matrix P and with initial distribution (q, p) = (P(X1 = 0), P(X1 = 1)). Several authors have studied the quantities Sn, Y (r) and AR(n), where Sn = ?n i=1 Xi denotes the number of successes, where Y (r) denotes ...
Omey, Edward, Van Gulck, Stefan
openaire +4 more sources
Fostering Innovation: Streamlining Magnetocaloric Materials Research by Digitalization
Advanced Engineering Materials, EarlyView.Magnetocaloric cooling (MCE) is an environmentally friendly refrigeration method with great potential. Optimizing MCE materials involves the preparation and screening of large quantities of samples, which in turn generates a large amount of data. A digitalization approach is presented that uses ontologies, knowledge graphs, and digital workflows to ...
Simon Bekemeier +17 more
wiley +1 more source
An estimate for an expectation of the simultaneous renewal for time-inhomogeneous Markov chains
Modern Stochastics: Theory and Applications, 2016 In this paper, we consider two time-inhomogeneous Markov chains ${X_{t}^{(l)}}$, $l\in \{1,2\}$, with discrete time on a general state space. We assume the existence of some renewal set C and investigate the time of simultaneous renewal, that is, the ...
Vitaliy Golomoziy
doaj +1 more source
Stochastic Processes and their ApplicationsThe Importance Markov chain is a novel algorithm bridging the gap between rejection sampling and importance sampling, moving from one to the other through a tuning parameter. Based on a modified sample of an instrumental Markov chain targeting an instrumental distribution (typically via a MCMC kernel), the Importance Markov chain produces an extended ...
Andral, Charly +3 more
openaire +4 more sources
Plasmonic Enhancement of Fluorescence and Protein Dynamics in Living Mammalian Cells
Advanced Materials, EarlyView.This study demonstrates plasmonic enhancement of the function of fluorescent voltage sensing proteins (genetically encoded voltage indicators, (GEVIs), QuasAr6) in live mammalian cells. Coupling to plasmonic nanoparticles does not just increase fluorescence, but influences the protein photocycle, creating a hybrid sensor with its response speed to ...
Marco Locarno +16 more
wiley +1 more source