Results 21 to 30 of about 86,980 (313)
A Continuous-Time Semi-Markov System Governed by Stepwise Transitions
Mathematics, 2022 In this paper, we introduce a class of stochastic processes in continuous time, called step semi-Markov processes. The main idea comes from bringing an additional insight to a classical semi-Markov process: the transition between two states is ...
Vlad Stefan Barbu +2 more
doaj +1 more source
New remarks on the Kolmogorov entropy of certain coarse-grained deterministic systems
AIMS Mathematics, 2023 Unless an appropriate dissipation mechanism is introduced in its evolution, a deterministic system generally does not tend to equilibrium. However, coarse-graining such a system implies a mesoscopic representation which is no longer deterministic.
Michel Moreau, Bernard Gaveau
doaj +1 more source
Spatio-temporal Markov chain model for very-short-term wind power forecasting
The Journal of Engineering, 2019 Wind power forecasting (WPF) is crucial in helping schedule and trade wind power generation at various spatial and temporal scales. With increasing number of wind farms over a region, research focus of WPF methods has been recently moved onto exploring ...
Yongning Zhao +7 more
doaj +1 more source
Научный вестник МГТУ ГА, 2021 In civil aviation primary focus is on the quality of fuel filled in the aircraft fuel tanks, as one of the components of flight safety ensuring. The introduction of digital technologies and trends in automation, digitalization of modern civil aviation ...
V. M. Samoilenko +3 more
doaj +1 more source
Entropic Regularization of Markov Decision Processes
Entropy, 2019 An optimal feedback controller for a given Markov decision process (MDP) can in principle be synthesized by value or policy iteration. However, if the system dynamics and the reward function are unknown, a learning agent must discover an optimal ...
Boris Belousov, Jan Peters
doaj +1 more source
Nonlinear Markov processes in big networks
Special Matrices, 2016 Big networks express multiple classes of large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems.
Li Quan-Lin
doaj +1 more source
Overall computing offloading strategy based on deep reinforcement learning in vehicle fog computing
The Journal of Engineering, 2020 In order to solve the problem of network congestion caused by a large number of data requests generated by intelligent vehicles in LTE-V network, a brand-new fog server with fog computing function is deployed on both the cellular base stations and ...
HaiZhong Tan, Limin Zhu
doaj +1 more source
On a New Characterization of Harris Recurrence for Markov Chains and Processes
Mathematics, 2023 This paper shows that Harris recurrent Markov chains and processes can be characterized as the class of Markov chains and processes for which there exists a random time T at which the distribution of the chain or process does not depend on its initial ...
Peter Glynn, Yanlin Qu
doaj +1 more source
Trace Refinement in Labelled Markov Decision Processes [PDF]
Logical Methods in Computer Science, 2020 Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.
Nathanaël Fijalkow +2 more
doaj +1 more source
Screening for lung cancer: A systematic review of overdiagnosis and its implications
Molecular Oncology, EarlyView.Low‐dose computed tomography (CT) screening for lung cancer may increase overdiagnosis compared to no screening, though the risk is likely low versus chest X‐ray. Our review of 8 trials (84 660 participants) shows added costs. Further research with strict adherence to modern nodule management strategies may help determine the extent to which ...
Fiorella Karina Fernández‐Sáenz +12 more
wiley +1 more source