Decision Making under Uncertainty: A Neural Model based on Partially Observable Markov Decision Processes [PDF]
Frontiers in Computational Neuroscience, 2010 A fundamental problem faced by animals is learning to select actions based on noisy sensory information and incomplete knowledge of the world. It has been suggested that the brain engages in Bayesian inference during perception but how such probabilistic
Rajesh P N Rao
doaj +2 more sources
Quantum partially observable Markov decision processes [PDF]
Physical Review A, 2014 We present quantum observable Markov decision processes (QOMDPs), the quantum analogs of partially observable Markov decision processes (POMDPs). In a QOMDP, an agent is acting in a world where the state is represented as a quantum state and the agent ...
Aaronson, Scott +2 more
core +6 more sources
Nonapproximability Results for Partially Observable Markov Decision Processes
Journal of Artificial Intelligence Research, 2011 We show that for several variations of partially observable Markov decision processes, polynomial-time algorithms for finding control policies are unlikely to or simply don't have guarantees of finding policies within a constant factor or a constant ...
Goldsmith, J., Lusena, C., Mundhenk, M.
core +4 more sources
Qualitative Analysis of Partially-observable Markov Decision Processes [PDF]
, 2009 We study observation-based strategies for partially-observable Markov decision processes (POMDPs) with omega-regular objectives. An observation-based strategy relies on partial information about the history of a play, namely, on the past sequence of ...
A. Bianco +12 more
core +8 more sources
Partially Observable Risk-Sensitive Markov Decision Processes [PDF]
Mathematics of Operations Research, 2016 We consider the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite time horizon which is generated by a Partially Observable Markov Decision Process (POMDP).
Bäuerle, Nicole, Rieder, Ulrich
core +3 more sources
Decision-Making in Repeated Games: Insights from Active Inference [PDF]
Behavioral SciencesThis review systematically explores the potential of the active inference framework in illuminating the cognitive mechanisms of decision-making in repeated games.
Hui Yuan +4 more
doaj +2 more sources
Homeostasis after injury: How intertwined inference and control underpin post-injury pain and behaviour. [PDF]
PLoS Computational BiologyInjuries are an unfortunate but inevitable fact of life, leading to an evolutionary mandate for powerful homeostatic processes of recovery and recuperation.
Pranav Mahajan, Peter Dayan, Ben Seymour
doaj +2 more sources
Continuous-observation partially observable semi-Markov decision processes for machine maintenance [PDF]
IEEE Transactions on Reliability, 2016 Partially observable semi-Markov decision processes (POSMDPs) provide a rich framework for planning under both state transition uncertainty and observation uncertainty. In this paper, we widen the literature on POSMDP by studying discrete-state, discrete-
Revie, Matthew, Zhang, Mimi
core +5 more sources
Value-Function Approximations for Partially Observable Markov Decision Processes
Journal of Artificial Intelligence Research, 2011 Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a set of ...
Hauskrecht, M.
core +4 more sources
Recursively-Constrained Partially Observable Markov Decision Processes
, 2023 Many sequential decision problems involve optimizing one objective function while imposing constraints on other objectives. Constrained Partially Observable Markov Decision Processes (C-POMDP) model this case with transition uncertainty and partial ...
Becker, Tyler +7 more
core +2 more sources