Markov or not Markov - this should be a question [PDF]
Although it is well known that Markov process theory, frequently applied in the literature on income convergence, imposes some very restrictive assumptions upon the data generating process, these assumptions have generally been taken for granted so far ...
Bickenbach, Frank, Bode, Eckhardt
core
A hidden Markov model and reinforcement learning‐based strategy for fault‐tolerant control
The Canadian Journal of Chemical Engineering, EarlyView.Abstract This study introduces a data‐driven control strategy integrating hidden Markov models (HMM) and reinforcement learning (RL) to achieve resilient, fault‐tolerant operation against persistent disturbances in nonlinear chemical processes. Called hidden Markov model and reinforcement learning (HMMRL), this strategy is evaluated in two case studies
Tamera Leitao +2 more
wiley +1 more source
Markov chains as a proxy for the predictive memory representations underlying mismatch negativity. [PDF]
Front Hum Neurosci, 2023 Schröger E, Roeber U, Coy N.
europepmc +1 more source
Restricted Tweedie stochastic block models
Canadian Journal of Statistics, EarlyView.Abstract The stochastic block model (SBM) is a widely used framework for community detection in networks, where the network structure is typically represented by an adjacency matrix. However, conventional SBMs are not directly applicable to an adjacency matrix that consists of nonnegative zero‐inflated continuous edge weights.
Jie Jian, Mu Zhu, Peijun Sang
wiley +1 more source
Improving models for student retention and graduation using Markov chains. [PDF]
PLoS One, 2023 Tedeschi MN +4 more
europepmc +1 more source
Hidden Markov graphical models with state‐dependent generalized hyperbolic distributions
Canadian Journal of Statistics, EarlyView.Abstract In this article, we develop a novel hidden Markov graphical model to investigate time‐varying interconnectedness between different financial markets. To identify conditional correlation structures under varying market conditions and accommodate shape features embedded in financial time series, we rely upon the generalized hyperbolic family of ...
Beatrice Foroni +2 more
wiley +1 more source
A parallel block projection method of the Cimmino type for finite Markov chains
, 1995 A parallel block projection method is used to approximate the stationary vector of a finite Markov chain. Block projection methods are very attractive for solving large chains thanks to their potential for parallel computation and robustness.
Sgallari F, Spaletta Giulia, Benzi M
core
A goodness‐of‐fit test for regression models with discrete outcomes
Canadian Journal of Statistics, EarlyView.Abstract Regression models are often used to analyze discrete outcomes, but classical goodness‐of‐fit tests such as those based on the deviance or Pearson's statistic can be misleading or have little power in this context. To address this issue, we propose a new test, inspired by the work of Czado et al.
Lu Yang +2 more
wiley +1 more source
A new hybrid model of convolutional neural networks and hidden Markov chains for image classification. [PDF]
Neural Comput Appl, 2023 Goumiri S, Benboudjema D, Pieczynski W.
europepmc +1 more source
The Reconstructability of Markov Chains
The Annals of Probability, 1976 As an extension of the work of Denzel, Kemeny, and Snell on the excessive functions of a continuous time Markov chain, this paper introduces the concept of reconstructability in two forms. First, there is reconstructability from the class of excessive functions, where it is seen that the transition matrix for a transient chain with a finite atomic exit
openaire +3 more sources