Results 1 to 10 of about 9,481,834 (176)
A Faster-Than Relation for Semi-Markov Decision Processes [PDF]
Electronic Proceedings in Theoretical Computer Science, 2020 When modeling concurrent or cyber-physical systems, non-functional requirements such as time are important to consider. In order to improve the timing aspects of a model, it is necessary to have some notion of what it means for a process to be faster ...
Mathias Ruggaard Pedersen +2 more
doaj +7 more sources
Learning to maximize reward rate: a model based on semi-Markov decision processes [PDF]
Frontiers in Neuroscience, 2014 When animals have to make a number of decisions during a limited time interval, they face a fundamental problem: how much time they should spend on each decision in order to achieve the maximum possible total outcome.
Arash eKhodadadi +2 more
doaj +2 more sources
Polish Maritime Research, 2021 The article presents the possibility to control the real operation process of an arbitrary device installed in the marine power plant based on the four-state semi-Markov process, being the model of the process, which describes the transition process of ...
Girtler Jerzy, Rudnicki Jacek
doaj +1 more source
A Hemimetric Extension of Simulation for Semi-Markov Decision Processes [PDF]
, 2018 Semi-Markov decision processes (SMDPs) are continuous-time Markov decision processes where the residence-time on states is governed by generic distributions on the positive real line. In this paper we consider the problem of comparing two SMDPs with respect to their time-dependent behaviour.
Mathias Ruggaard Pedersen +3 more
openaire +6 more sources
Some work and some play: microscopic and macroscopic approaches to labor and leisure. [PDF]
PLoS Computational Biology, 2014 Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other.
Ritwik K Niyogi +2 more
doaj +1 more source
Energies, 2022 Oil tanker disasters have been a cause of major environmental disasters, with multi-generational impacts. One of the greatest hazards is damage to the propulsion system that causes the ship to turn sideways to a wave and lose stability, which in storm ...
Zbigniew Łosiewicz +4 more
doaj +1 more source
Application of the Pareto front for risk control in the transport system [PDF]
MATEC Web of Conferences, 2019 The article describes the developed model of controlling the process of means of transport operation, in which the choice of control strategy is carried out using non-deterministic methods.
Sołtysiak Agnieszka, Migawa Klaudiusz
doaj +1 more source
A survey on semi-Markov decision processes [PDF]
SCIENTIA SINICA Mathematica, 2015 This paper is a survey on semi-Markov decision processes (SMDPs). We present the background, the signi cance, and the research actuality of the in nite horizon expected discounted reward criterion, the long-run expected average reward criterion, the nite horizon expected reward criterion, the expected rst passage reward criterion, the probability ...
YongHui HUANG, XianPing GUO
openaire +1 more source
Fast Two-Stage Computation of an Index Policy for Multi-Armed Bandits with Setup Delays
Mathematics, 2020 We consider the multi-armed bandit problem with penalties for switching that include setup delays and costs, extending the former results of the author for the special case with no switching delays.
José Niño-Mora
doaj +1 more source
Towards Analysis of Semi-Markov Decision Processes [PDF]
, 2010 We investigate Semi-Markov Decision Processes (SMDPs). Two problems are studied, namely, the time-bounded reachability problem and the long-run average fraction of time problem. The former aims to compute the maximal (or minimum) probability to reach a certain set of states within a given time bound.
Taolue Chen 0001, Jian Lu 0001
openaire +1 more source