Optimal Control of Partially Observable Piecewise Deterministic Markov Processes
In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to control the ...
Bäuerle, Nicole, Lange, Dirk
core +3 more sources
Reinforcement Learning for Robust Dynamic Metabolic Control. [PDF]
ABSTRACT Dynamic metabolic control allows key metabolic fluxes to be modulated in real time, enhancing bioprocess flexibility and expanding available optimization degrees of freedom. This is achieved, for example, via targeted modulation of metabolic enzyme expression.
Espinel-Ríos S, Walser R, Zhang D.
europepmc +2 more sources
Hybrid Semantics of Stochastic Programs with Dynamic Reconfiguration [PDF]
We begin by reviewing a technique to approximate the dynamics of stochastic programs --written in a stochastic process algebra-- by a hybrid system, suitable to capture a mixed discrete/continuous evolution.
Alberto Policriti, Luca Bortolussi
doaj +1 more source
Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications [PDF]
We study the verification of a finite continuous-time Markov chain (CTMC) C against a linear real-time specification given as a deterministic timed automaton (DTA) A with finite or Muller acceptance conditions.
Taolue Chen +3 more
doaj +1 more source
Hypocoercivity of piecewise deterministic Markov process-Monte Carlo [PDF]
In this work, we establish $\mathrm{L}^2$-exponential convergence for a broad class of Piecewise Deterministic Markov Processes recently proposed in the context of Markov Process Monte Carlo methods and covering in particular the Randomized Hamiltonian Monte Carlo, the Zig-Zag process and the Bouncy Particle Sampler. The kernel of the symmetric part of
Andrieu, Christophe +3 more
openaire +6 more sources
A coordination model for ultra-large scale systems of systems [PDF]
The ultra large multi-agent systems are becoming increasingly popular due to quick decay of the individual production costs and the potential of speeding up the solving of complex problems.
Manuela L. Bujorianu +1 more
doaj +1 more source
Demographic noise and piecewise deterministic Markov processes [PDF]
11 pages, 5 figures, minor ...
Realpe-Gomez, John +2 more
openaire +4 more sources
Piecewise-Deterministic Markov Processes as Limits of Markov Jump Processes [PDF]
A classical result about Markov jump processes states that a certain class of dynamical systems given by ordinary differential equations are obtained as the limit of a sequence of scaled Markov jump processes. This approach fails if the scaling cannot be carried out equally across all entities.
Franz, Uwe +2 more
openaire +2 more sources
Effects of delayed immune-response in tumor immune-system interplay [PDF]
Tumors constitute a wide family of diseases kinetically characterized by the co-presence of multiple spatio-temporal scales. So, tumor cells ecologically interplay with other kind of cells, e.g. endothelial cells or immune system effectors, producing and
Alberto d'Onofrio +4 more
doaj +1 more source
On level crossings for a general class of piecewise-deterministic Markov processes [PDF]
We consider a piecewise-deterministic Markov process governed by a jump intensity function, a rate function that determines the behaviour between jumps, and a stochastic kernel describing the conditional distribution of jump sizes.
Borovkov, K. A., Last, G.
core +3 more sources

