Results 241 to 250 of about 937,585 (275)

Partially observed Markov decision processes with binomial observations

Operations Research Letters, 2013
Abstract We consider partially observed Markov decision processes with control limits. We analytically show how the finite-horizon control limits are non-monotonic in (a) the time remaining and (b) the probability of obtaining a conforming unit. We also prove that the infinite-horizon control limit can be calculated by solving a finite set of linear ...
Abraham Grosfeld-Nir, Tal Ben-Zvi
openaire   +2 more sources

UAV Path Planning in a Dynamic Environment via Partially Observable Markov Decision Process

IEEE Transactions on Aerospace and Electronic Systems, 2013
A path-planning algorithm to guide unmanned aerial vehicles (UAVs) for tracking multiple ground targets based on the theory of partially observable Markov decision processes (POMDPs) is presented. A variety of features of interest are shown to be easy to
Shankarachary Ragi, E. Chong
semanticscholar   +1 more source

Interaction as an Emergent Property of a Partially Observable Markov Decision Process

, 2018
In this chapter we explore the potential advantages of modeling the interaction between a human and a computer as a consequence of a Partially Observable Markov Decision Process (POMDP) that models human cognition.
Andrew Howes, Xiuli Chen, Aditya Acharya, Richard L. Lewis   +3 more
semanticscholar   +1 more source

Partially Observable Markov Decision Processes

2012
For reinforcement learning in environments in which an agent has access to a reliable state signal, methods based on the Markov decision process (MDP) have had many successes. In many problem domains, however, an agent suffers from limited sensing capabilities that preclude it from recovering a Markovian state signal from its perceptions. Extending the
Matthijs T. J. Spaan, Matthijs T. J. Spaan   +1 more
openaire   +2 more sources

Competitive Markov decision processes with partial observation

2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583), 2005
We study a class of Markov decision processes (MDPs) in the infinite time horizon where the number of controllers is two and the observation information is allowed to be imperfect. Suppose the system, space and action space are both finite, and the controllers, having conflicting interests with each other, make decisions independently to seek their own
Ari Arapostathis, Shun-Pin Hsu
openaire   +2 more sources

Data-Driven Management of Post-Transplant Medications: An Ambiguous Partially Observable Markov Decision Process Approach

, 2017
Organ-transplanted patients typically receive high amounts of immunosuppressive drugs (e.g., tacrolimus) as a mechanism to reduce their risk of organ rejection. However, due to the diabetogenic effect of these drugs, this practice exposes them to greater
Alireza Boloori, S. Saghafian, H. Chakkera, C. Cook   +3 more
semanticscholar   +1 more source

Path planning for unmanned aerial vehicle passive detection under the framework of partially observable markov decision process

Chinese Control and Decision Conference, 2018
In order to improve the UAV's autonomous target-tracking ability under the condition of passive detection, this paper established an unmanned aerial vehicle (UAV) path planning POMDP model in passive detection situation under the theoretical framework of
Qiming Yang, Jiandong Zhang, Guoqing Shi
semanticscholar   +1 more source

Partially Observable Markov Decision Processes

2020
This chapter covers Partially Observable Markov Decision Processes (POMDPs), that extend MDPs for when the state is not completely observable. After a general introduction to POMDPs, their formal representation and properties are described. The representation of the value function as a set of linear equations (\(\alpha -vectors\)) is presented via a ...
openaire   +2 more sources

Approximations for Partially Observed Markov Decision Processes

2018
This chapter studies the finite-model approximation of discrete-time partially observed Markov decision process. We will find that by performing the standard reduction method, where one transforms a partially observed model to a belief-based fully observed model, we can apply and properly generalize the results in the preceding chapters to obtain ...
Saldı, Naci, Linder, T., Yüksel, S.
openaire   +2 more sources

Assisting persons with dementia during handwashing using a partially observable Markov decision process.

International Conference on Virtual Storytelling, 2007
This paper presents a real-time system to assist a person with dementia wash their hands. Assistance is given in the form of verbal and/or visual prompts, or through the enlistment of a human caregiver's help.
J. Hoey, Axel von Bertoldi, P. Poupart, Alex Mihailidis   +3 more
semanticscholar   +1 more source