Results 31 to 40 of about 5,432,397 (302)

Mathematical modeling of objects functioning and technical means for airfield control ensuring process

Научный вестник МГТУ ГА, 2021
In civil aviation primary focus is on the quality of fuel filled in the aircraft fuel tanks, as one of the components of flight safety ensuring. The introduction of digital technologies and trends in automation, digitalization of modern civil aviation ...
V. M. Samoilenko, O. V. Gromov, G. I. Litinsky, V. K. Gromov   +3 more
doaj   +1 more source

Markov decision processes approximation with coupled dynamics via Markov deterministic control systems

Open Mathematics, 2023
This article presents an approximation of discrete Markov decision processes with small noise on Borel spaces with an infinite horizon and an expected total discounted cost by the corresponding deterministic Markov process.
Portillo-Ramírez Gustavo, Cruz-Suárez Hugo, López-Ríos Ruy, Blancas-Rivera Rubén   +3 more
doaj   +1 more source

Finite State Approximations for Countable State Infinite Horizon Discounted Markov Decision Processes [PDF]

Modeling, Identification and Control, 1987
It is proved that the optimal policy of a Markov decision process where the state space is truncated, will approximate the policy in case of no truncation.
Sjur D. Flåm
doaj   +1 more source

Asymptotic Expansions for Moments of Hitting Times for Nonlinearly Perturbed Semi-Markov Processes

, 2017
In Chapter 3, we introduce a model of perturbed semi-Markov processes, formulate basic perturbation conditions, describe a one-step time-space screening procedure of phase space reduction for perturbed semi-Markov processes, introduce hitting times, and ...
Sergei Silvestrov, Silvestrov, Sergei,, Silvestrov, D.,, Dmitrii Silvestrov   +3 more
core   +1 more source

CALCULATING THE PROBABILITY OF DISCRETE STATES OF A SYSTEM WITH FIVE UNITS HARVESTING MACHINERY

Вісник Національного технічного університету «ХПÌ». Серія: Стратегічне управління, управління портфелями, програмами та проектами, 2016
The given article is dedicated to the improvement of the determination method of the efficiency of functioning of the system with discrete states. It is offered the application of Markov processes for the determination of appropriate states probability ...
Юрій Іванович КОВАЛЬЧИК, Оксана Ігорівна ГОВДА   +1 more
doaj   +1 more source

Efficient qualitative analysis of classes of recursive markov decision processes and simple stochastic games [PDF]

, 2006
. Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs) are natural models for recursive systems involving both probabilistic and non-probabilistic actions.
Mihalis Yannakakis, Yannakakis, Mihalis, Etessami, Kousha; id_orcid, Kousha Etessami   +3 more
core   +1 more source

Symbolic Magnifying Lens Abstraction in Markov Decision Processes [PDF]

, 2008
In this paper, we combine abstraction-refinement and symbolic techniques to fight the state-space explosion problem when model checking Markov decision processes (MDPs).
Luca de Alfaro, Parker, D., David Parker, de Alfaro, L., Pritam Roy, Norman, G., Roy, P., Gethin Norman   +7 more
core   +1 more source

From junk to function — How weak selection in eukaryotes builds new parts and drives genomic complexity

FEBS Letters, EarlyView.
How do genomes gain new functional parts? In eukaryotes, which tend to evolve under weak selection, much of the genome is junk. Palazzo and Qiu borrow the logic of Markov chains to show how non‐functional DNA becomes functional through the appearance of intermediate states, which arise due to epistasis, buffering, and biochemical messiness, allowing ...
Alexander F. Palazzo, Yi Qiu
wiley   +1 more source

Nonlinear Markov processes in big networks

Special Matrices, 2016
Big networks express multiple classes of large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems.
Li Quan-Lin
doaj   +1 more source

Extracellular matrix remodeling and immune reprogramming drive residual tumor progression of liver cancer after incomplete microwave ablation

Molecular Oncology, EarlyView.
Incomplete microwave ablation (iMWA) of liver cancer triggers a biphasic progression in residual tumors. At Day 3, the microenvironment is characterized by acute inflammatory responses and extracellular matrix (ECM) remodeling. By Day 14, a profound shift occurs toward oncogenic signal transduction and immunosuppression, marked by macrophage ...
Yu Liu, Yubei He, Nikolaus Berndt, Michael Mülleder, Kathrin Textoris‐Taube, Jing Guo, Matthias Stechele, Justus Ramtke, Shraga Nahum Goldberg, Lynn Jeanette Savic   +9 more
wiley   +1 more source