Results 41 to 50 of about 103,535 (312)
Positivity-hardness results on Markov decision processes [PDF]
TheoretiCSThis paper investigates a series of optimization problems for one-counter Markov decision processes (MDPs) and integer-weighted MDPs with finite state space.
Jakob Piribauer, Christel Baier
doaj +1 more source
Symbolic Magnifying Lens Abstraction in Markov Decision Processes [PDF]
, 2008 In this paper, we combine abstraction-refinement and symbolic techniques to fight the state-space explosion problem when model checking Markov decision processes (MDPs).
Luca de Alfaro +7 more
core +1 more source
Trace Refinement in Labelled Markov Decision Processes [PDF]
Logical Methods in Computer Science, 2020 Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.
Nathanaël Fijalkow +2 more
doaj +1 more source
Small sets and Markov transition densities [PDF]
, 2002 The theory of general state-space Markov chains can be strongly related to the case of discrete state-space by use of the notion of small sets and associated minorization conditions. The general theory shows that small sets exist for all Markov chains on
Montana, Giovanni +2 more
core +1 more source
Asymptotic Expansions for Moments of Hitting Times for Nonlinearly Perturbed Semi-Markov Processes
, 2017 In Chapter 3, we introduce a model of perturbed semi-Markov processes, formulate basic perturbation conditions, describe a one-step time-space screening procedure of phase space reduction for perturbed semi-Markov processes, introduce hitting times, and ...
Sergei Silvestrov +3 more
core +1 more source
Entropic Regularization of Markov Decision Processes
Entropy, 2019 An optimal feedback controller for a given Markov decision process (MDP) can in principle be synthesized by value or policy iteration. However, if the system dynamics and the reward function are unknown, a learning agent must discover an optimal ...
Boris Belousov, Jan Peters
doaj +1 more source
Overall computing offloading strategy based on deep reinforcement learning in vehicle fog computing
The Journal of Engineering, 2020 In order to solve the problem of network congestion caused by a large number of data requests generated by intelligent vehicles in LTE-V network, a brand-new fog server with fog computing function is deployed on both the cellular base stations and ...
HaiZhong Tan, Limin Zhu
doaj +1 more source
On a New Characterization of Harris Recurrence for Markov Chains and Processes
Mathematics, 2023 This paper shows that Harris recurrent Markov chains and processes can be characterized as the class of Markov chains and processes for which there exists a random time T at which the distribution of the chain or process does not depend on its initial ...
Peter Glynn, Yanlin Qu
doaj +1 more source
Plasmonic Enhancement of Fluorescence and Protein Dynamics in Living Mammalian Cells
Advanced Materials, EarlyView.This study demonstrates plasmonic enhancement of the function of fluorescent voltage sensing proteins (genetically encoded voltage indicators, (GEVIs), QuasAr6) in live mammalian cells. Coupling to plasmonic nanoparticles does not just increase fluorescence, but influences the protein photocycle, creating a hybrid sensor with its response speed to ...
Marco Locarno +16 more
wiley +1 more source
Inverse Design of Amorphous Materials With Targeted Properties
Advanced Materials, EarlyView.AMDEN is a diffusion model framework for the inverse design of amorphous materials with targeted properties. By incorporating Hamiltonian Monte Carlo refinement into the denoising process, the framework overcomes the challenge of generating thermally relaxed disordered structures.
Jonas A. Finkler +4 more
wiley +1 more source