Results 21 to 30 of about 401,816 (284)

A Continuous-Time Semi-Markov System Governed by Stepwise Transitions

open access: yesMathematics, 2022
In this paper, we introduce a class of stochastic processes in continuous time, called step semi-Markov processes. The main idea comes from bringing an additional insight to a classical semi-Markov process: the transition between two states is ...
Vlad Stefan Barbu   +2 more
doaj   +1 more source

Application of improved grey model residual modified fusion algorithm in dissolved gas forecasting

open access: yesThe Journal of Engineering, 2019
The power transformer directly affects whether the power system can operate safely and reliably, and the prediction of the dissolved gas content in the transformer oil is an effective means to discover transformer defects and latent faults, which helps ...
Wenjie Wu, Yigang He, Jiajun Duan
doaj   +1 more source

Spatio-temporal Markov chain model for very-short-term wind power forecasting

open access: yesThe Journal of Engineering, 2019
Wind power forecasting (WPF) is crucial in helping schedule and trade wind power generation at various spatial and temporal scales. With increasing number of wind farms over a region, research focus of WPF methods has been recently moved onto exploring ...
Yongning Zhao   +7 more
doaj   +1 more source

Implementing Markovian models for extendible Marshall–Olkin distributions

open access: yesDependence Modeling, 2022
We derive a novel stochastic representation of exchangeable Marshall–Olkin distributions based on their death-counting processes. We show that these processes are Markov.
Sloot Henrik
doaj   +1 more source

Mathematical modeling of objects functioning and technical means for airfield control ensuring process

open access: yesНаучный вестник МГТУ ГА, 2021
In civil aviation primary focus is on the quality of fuel filled in the aircraft fuel tanks, as one of the components of flight safety ensuring. The introduction of digital technologies and trends in automation, digitalization of modern civil aviation ...
V. M. Samoilenko   +3 more
doaj   +1 more source

Consistency of Feature Markov Processes [PDF]

open access: yes, 2010
We are studying long term sequence prediction (forecasting). We approach this by investigating criteria for choosing a compact useful state representation. The state is supposed to summarize useful information from the history.
Hutter, Marcus, Sunehag, Peter
core   +2 more sources

Positivity-hardness results on Markov decision processes [PDF]

open access: yesTheoretiCS
This paper investigates a series of optimization problems for one-counter Markov decision processes (MDPs) and integer-weighted MDPs with finite state space.
Jakob Piribauer, Christel Baier
doaj   +1 more source

Trace Refinement in Labelled Markov Decision Processes [PDF]

open access: yesLogical Methods in Computer Science, 2020
Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent.
Nathanaël Fijalkow   +2 more
doaj   +1 more source

Entropic Regularization of Markov Decision Processes

open access: yesEntropy, 2019
An optimal feedback controller for a given Markov decision process (MDP) can in principle be synthesized by value or policy iteration. However, if the system dynamics and the reward function are unknown, a learning agent must discover an optimal ...
Boris Belousov, Jan Peters
doaj   +1 more source

Overall computing offloading strategy based on deep reinforcement learning in vehicle fog computing

open access: yesThe Journal of Engineering, 2020
In order to solve the problem of network congestion caused by a large number of data requests generated by intelligent vehicles in LTE-V network, a brand-new fog server with fog computing function is deployed on both the cellular base stations and ...
HaiZhong Tan, Limin Zhu
doaj   +1 more source

Home - About - Disclaimer - Privacy