Results 11 to 20 of about 71,442 (256)

A Faster-Than Relation for Semi-Markov Decision Processes [PDF]

Electronic Proceedings in Theoretical Computer Science, 2020
When modeling concurrent or cyber-physical systems, non-functional requirements such as time are important to consider. In order to improve the timing aspects of a model, it is necessary to have some notion of what it means for a process to be faster ...
Mathias Ruggaard Pedersen, Giorgio Bacci, Kim Guldstrand Larsen   +2 more
doaj   +8 more sources

Learning to maximize reward rate: a model based on semi-Markov decision processes [PDF]

Frontiers in Neuroscience, 2014
When animals have to make a number of decisions during a limited time interval, they face a fundamental problem: how much time they should spend on each decision in order to achieve the maximum possible total outcome.
Arash eKhodadadi, Pegah eFakhari, jerome eBusemeyer   +2 more
doaj   +2 more sources

Optimal maintenance of deteriorating equipment using semi-Markov decision processes and linear programming [PDF]

International Journal of Industrial Engineering and Management
This paper considers a mathematical model analysing the deterioration of system equipment and available maintenance options. Under specific conditions on costs and transition probabilities of the model, the issue of ideal maintenance of the equipment by ...
Giannis Kechagias, Alexandros Diamantidis, Theodosis Dimitrakos, Mariza Tsakalerou   +3 more
doaj   +2 more sources

Deterministic policy gradient algorithms for semi‐Markov decision processes

International Journal of Intelligent Systems, 2021
A large class of sequential decision‐making problems under uncertainty, with broad applications from preventive maintenance to event‐triggered control can be modeled in the framework of semi‐Markov decision processes (SMDPs).
A. H. Hosseinloo, M. Dahleh
semanticscholar   +2 more sources

The Matter of Decision-Making Control Over Operation Processes of Marine Power Plant Systems with the Use of their Models in the form of Semi-Markov Decision-Making Processes

Polish Maritime Research, 2021
The article presents the possibility to control the real operation process of an arbitrary device installed in the marine power plant based on the four-state semi-Markov process, being the model of the process, which describes the transition process of ...
Girtler Jerzy, Rudnicki Jacek
doaj   +2 more sources

A Hemimetric Extension of Simulation for Semi-Markov Decision Processes [PDF]

International Conference on Quantitative Evaluation of Systems, 2018
Semi-Markov decision processes (SMDPs) are continuous-time Markov decision processes where the residence-time on states is governed by generic distributions on the positive real line. In this paper we consider the problem of comparing two SMDPs with respect to their time-dependent behaviour.
M. R. Pedersen, G. Bacci, K. Larsen, R. Mardare   +3 more
semanticscholar   +6 more sources

Average cost semi-markov decision processes

Journal of Applied Probability, 1970
The semi-Markov decision model is considered under the criterion of long-run average cost. A new criterion, which for any policy considers the limit of the expected cost incurred during the first n transitions divided by the expected length of the first n transitions, is considered.
S. Ross
semanticscholar   +3 more sources

SEMI-MARKOV DECISION PROCESSES AND THEIR APPLICATIONS IN REPLACEMENT MODELS

Journal of the Operations Research Society of Japan, 1985
We consider the problem of minimizing the long-run average expected cost per unit time in a semi-Markov decision process with arbitrary state and action space. Using the idea of successive approximations, sufficient conditions for the existence of an optimal stationary policy are given.
M. Kurano
semanticscholar   +4 more sources

Adaptive Honeypot Engagement through Reinforcement Learning of Semi-Markov Decision Processes [PDF]

Decision and Game Theory for Security, 2019
A honeynet is a promising active cyber defense mechanism. It reveals the fundamental Indicators of Compromise (IoCs) by luring attackers to conduct adversarial behaviors in a controlled and monitored environment.
Linan Huang, Quanyan Zhu
semanticscholar   +1 more source

Some work and some play: microscopic and macroscopic approaches to labor and leisure. [PDF]

PLoS Computational Biology, 2014
Given the option, humans and other animals elect to distribute their time between work and leisure, rather than choosing all of one and none of the other.
Ritwik K Niyogi, Peter Shizgal, Peter Dayan   +2 more
doaj   +1 more source