Results 21 to 30 of about 26,957 (159)
Finite State Approximations for Countable State Infinite Horizon Discounted Markov Decision Processes [PDF]
Modeling, Identification and Control, 1987 It is proved that the optimal policy of a Markov decision process where the state space is truncated, will approximate the policy in case of no truncation.
Sjur D. Flåm
doaj +1 more source
Deterministic Discounted Markov Decision Processes with Fuzzy Rewards/Costs
Fuzzy Information and Engineering, 2023 The article concerns a study of infinite-horizon deterministic Markov decision processes (MDPs) for which the fuzzy environment will be presented through considering these MDPs with both fuzzy rewards and fuzzy costs.
Hugo Cruz-Suárez +2 more
doaj +1 more source
A Faster-Than Relation for Semi-Markov Decision Processes [PDF]
Electronic Proceedings in Theoretical Computer Science, 2020 When modeling concurrent or cyber-physical systems, non-functional requirements such as time are important to consider. In order to improve the timing aspects of a model, it is necessary to have some notion of what it means for a process to be faster ...
Mathias Ruggaard Pedersen +2 more
doaj +1 more source
Markov Decision Processes with Multiple Long-run Average Objectives [PDF]
Logical Methods in Computer Science, 2014 We study Markov decision processes (MDPs) with multiple limit-average (or mean-payoff) functions. We consider two different objectives, namely, expectation and satisfaction objectives.
Tomáš Brázdil +4 more
doaj +1 more source
An ϵ-Greedy Multiarmed Bandit Approach to Markov Decision Processes
Stats, 2023 We present REGA, a new adaptive-sampling-based algorithm for the control of finite-horizon Markov decision processes (MDPs) with very large state spaces and small action spaces. We apply a variant of the ϵ-greedy multiarmed bandit algorithm to each stage
Isa Muqattash, Jiaqiao Hu
doaj +1 more source
Positivity-hardness results on Markov decision processes [PDF]
TheoretiCSThis paper investigates a series of optimization problems for one-counter Markov decision processes (MDPs) and integer-weighted MDPs with finite state space.
Jakob Piribauer, Christel Baier
doaj +1 more source
UAV Formation Shape Control via Decentralized Markov Decision Processes
Algorithms, 2021 In this paper, we present a decentralized unmanned aerial vehicle (UAV) swarm formation control approach based on a decision theoretic approach. Specifically, we pose the UAV swarm motion control problem as a decentralized Markov decision process (Dec ...
Md Ali Azam +2 more
doaj +1 more source
Open Mathematics, 2023 This article presents an approximation of discrete Markov decision processes with small noise on Borel spaces with an infinite horizon and an expected total discounted cost by the corresponding deterministic Markov process.
Portillo-Ramírez Gustavo +3 more
doaj +1 more source
Quantile Markov Decision Process
CoRR, 2017 The goal of a traditional Markov decision process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly infinite). In many applications, however, a decision maker may be interested in optimizing a specific quantile of the cumulative reward instead of its expectation.
Li, X, Zhong, H, Brandeau, M
openaire +3 more sources
Logistic Markov Decision Processes [PDF]
Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017 User modeling in advertising and recommendation has typically focused on myopic predictors of user responses. In this work, we consider the long-term decision problem associated with user interaction. We propose a concise specification of long-term interaction dynamics by combining factored dynamic Bayesian networks with logistic predictors of user ...
Martin Mladenov +5 more
openaire +1 more source