Results 1 to 10 of about 9,374 (79)

Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process [PDF]

2019 American Control Conference (ACC), 2019
The objective is to study an on-line Hidden Markov model (HMM) estimation-based Q-learning algorithm for partially observable Markov decision process (POMDP) on finite state and action sets. When the full state observation is available, Q-learning finds the optimal action-value function given the current action (Q function).
Hyung-Jin Yoon, Donghwan Lee, Naira Hovakimyan   +2 more
openaire   +2 more sources

Time-delay estimation for compound point-processes using hidden Markov models [PDF]

1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, 2002
A new time-delay estimation algorithm for compound point-processes is presented. Compound point-processes, a generalization of temporal point-processes, describe processes with discrete events, where each occurrence time is associated with certain features.
Wohlers, Jens, Mertins, Alfred, Fliege, Norbert   +2 more
openaire   +2 more sources

Estimating Hidden Markov Models (HMMs) of the cognitive process in strategic thinking using eye-tracking

Frontiers in Behavioral Economics, 2023
Hidden Markov Models (HMMs) are used to study language, sleep, macroeconomic states, and other processes that reflect probabilistic transitions between states that can't be observed directly. This paper applies HMMs to data from location-based game theory experiments. In these location games, players choose a pixel location from an image. These players
Xiaomin Li, Thomas Henning, Colin Camerer   +2 more
openaire   +1 more source

Inferring the causes of noise from binary outcomes: A normative theory of learning under uncertainty. [PDF]

Psychol Rev
Fang X, Piray P.
europepmc   +1 more source

Harnessing biological variability for mechanistic inference: A stochastic framework applied to neural stem cell dynamics. [PDF]

iScience
Wang RY, Danciu DP, Klawe FZ, Marciniak-Czochra A.   +3 more
europepmc   +1 more source

Quantum computing in finance: a literature review and future directions for trustworthy financial AI. [PDF]

Front Artif Intell
Muzzioli S, Raheem F, Ferrara M, Giudici P, Siciliano R.   +4 more
europepmc   +1 more source

Estimating Chronic Kidney Disease Stage Transitions from Irregular Electronic Health Record Data Using an Expectation-Maximization Framework. [PDF]

MDM Policy Pract
Qi W, Lobo JM, Yan G, Ghenbot R, Sands KG, Krupski TL, Culp SH, Otero-León DF.   +7 more
europepmc   +1 more source

The occurrence of a particular state is a predictor of successful travel consultation. [PDF]

PLoS One
Honda H, Kubo T, Hisamatsu R, Ohmoto Y, Ikeda K, Ueda K.   +5 more
europepmc   +1 more source

Modeling chronic kidney disease progression using a continuous-time multistate Markov model: Transition dynamics and covariate effects. [PDF]

J Int Med Res
Futasa Begna T, Tereda AB, Abdisa Fufa J, Diriba TA, Debusho LK.   +4 more
europepmc   +1 more source

Hidden multistate models to study multimorbidity trajectories. [PDF]

Sci Rep
Manzoni V, Ieva F, Calderón-Larrañaga A, Vetrano DL, Gregorio C.   +4 more
europepmc   +1 more source