Results 1 to 10 of about 8,992 (78)

Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process [PDF]

2019 American Control Conference (ACC), 2019
The objective is to study an on-line Hidden Markov model (HMM) estimation-based Q-learning algorithm for partially observable Markov decision process (POMDP) on finite state and action sets. When the full state observation is available, Q-learning finds the optimal action-value function given the current action (Q function).
Hyung-Jin Yoon, Donghwan Lee, Naira Hovakimyan   +2 more
openaire   +2 more sources

Estimating Hidden Markov Models (HMMs) of the cognitive process in strategic thinking using eye-tracking

Frontiers in Behavioral Economics, 2023
Hidden Markov Models (HMMs) are used to study language, sleep, macroeconomic states, and other processes that reflect probabilistic transitions between states that can't be observed directly. This paper applies HMMs to data from location-based game theory experiments. In these location games, players choose a pixel location from an image. These players
Xiaomin Li, Thomas Henning, Colin Camerer   +2 more
openaire   +1 more source

Time-delay estimation for compound point-processes using hidden Markov models [PDF]

1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, 2002
A new time-delay estimation algorithm for compound point-processes is presented. Compound point-processes, a generalization of temporal point-processes, describe processes with discrete events, where each occurrence time is associated with certain features.
Wohlers, Jens, Mertins, Alfred, Fliege, Norbert   +2 more
openaire   +2 more sources

The occurrence of a particular state is a predictor of successful travel consultation. [PDF]

PLoS One
Honda H, Kubo T, Hisamatsu R, Ohmoto Y, Ikeda K, Ueda K.   +5 more
europepmc   +1 more source

A Comparison of Methods for Modeling Multistate Cancer Progression Using Screening Data with Censoring after Intervention. [PDF]

Med Decis Making
Akwiwu EU, Coupé VMH, Berkhof J, Klausch T.   +3 more
europepmc   +1 more source

An Evolving View of Character Macroevolution. [PDF]

Syst Biol
Tribble CM, Martínez-Gómez J, Rothfels CJ, May MR.   +3 more
europepmc   +1 more source

Inferring Hidden Attentional States in Driving: A Bayesian Approach to Modeling Distraction and Secondary Task Engagement. [PDF]

Hum Factors
Dheeraj Kashyap L, Wang Z, Chang Y, Zahabi M, Garcia A.   +4 more
europepmc   +1 more source

Sleep and Activity Patterns in Depression From Wearable Data: Unsupervised Clustering Study. [PDF]

J Med Internet Res
Oetzmann C, Zhang Y, Cummins N, Carr E, Matcham F, Siddi S, Lamers F, Leightley D, White KM, Folarin AA, Annas P, Haro JM, Penninx BW, Vairavan S, Wykes T, Dobson RJ, Narayan VA, Hotopf M.   +17 more
europepmc   +1 more source

Estimating Ancestral States of Complex Characters: A Case Study on the Evolution of Feathers. [PDF]

Syst Biol
Cockx P, Benton MJ, Keating JN.
europepmc   +1 more source

A minimal chemo-mechanical Markov model for rotary catalysis of F₁-ATPase. [PDF]

Nat Commun
Chen Y, Grubmüller H.
europepmc   +1 more source