Markov processes: estimation hidden markov models

Results 1 to 10 of about 8,718 (60)

Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process [PDF]

2019 American Control Conference (ACC), 2019
The objective is to study an on-line Hidden Markov model (HMM) estimation-based Q-learning algorithm for partially observable Markov decision process (POMDP) on finite state and action sets. When the full state observation is available, Q-learning finds the optimal action-value function given the current action (Q function).
Yoon, Hyung-Jin, Lee, Donghwan, Hovakimyan, Naira +2 more
+6 more sources

Time-delay estimation for compound point-processes using hidden Markov models [PDF]

1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, 2002
A new time-delay estimation algorithm for compound point-processes is presented. Compound point-processes, a generalization of temporal point-processes, describe processes with discrete events, where each occurrence time is associated with certain features.
Wohlers, Jens, Mertins, Alfred, Fliege, Norbert +2 more
openaire +3 more sources

Estimating Hidden Markov Models (HMMs) of the cognitive process in strategic thinking using eye-tracking

Frontiers in Behavioral Economics, 2023
Hidden Markov Models (HMMs) are used to study language, sleep, macroeconomic states, and other processes that reflect probabilistic transitions between states that can't be observed directly. This paper applies HMMs to data from location-based game theory experiments. In these location games, players choose a pixel location from an image. These players
Xiaomin Li, Thomas Henning, Colin Camerer +2 more
openaire +1 more source

Estimating Ancestral States of Complex Characters: A Case Study on the Evolution of Feathers. [PDF]

Syst Biol
Cockx P, Benton MJ, Keating JN.
europepmc +1 more source

Linking brain and behavior states in Zebrafish Larvae locomotion using hidden Markov models. [PDF]