Results 61 to 70 of about 9,481,834 (176)

PReMo: an analyzer for Probabilistic Recursive Models [PDF]

, 2007
This paper describes PReMo, a tool for analyzing Recursive Markov Chains, and their controlled/game extensions: (1-exit) Recursive Markov Decision Processes and Recursive Simple Stochastic ...
Dominik Wojtczak, Etessami, Kousha; id_orcid, Kousha Etessami, Wojtczak, Dominik   +3 more
core  

Continuous Semi-Markov Processes

, 2007
This title considers the special of random processes known as semi-Markov processes. These possess the Markov property with respect to any intrinsic Markov time such as the first exit time from an open set or a finite iteration of these times.
Harlamov, Boris
core  

Semi-Markov decision-making processes with randomized discount [PDF]

, 2013
У роботі розглянуто керовані напівмарковські процеси з випадковим дисконтуючим фактором. Знаходяться достатні умови існування та єдиності оптимальної стаціонарної нерандомізованої стратегії керування зазначеними процесами на скінченному та нескінченному ...
Чорней, Руслан, Ковальчук, Наталія   +1 more
core  

Semi-markov conditional random fields for information extraction

We describe semi-Markov conditional random fields (semi-CRFs), a con- ditionally trained version of semi-Markov chains. Intuitively, a semi- CRF on an input sequence x outputs a “segmentation” of x, in which labels are assigned to segments (i.e ...
Sarawagi, Sunita, W, William, Semi-markov, Cohen   +2 more
core   +1 more source

Multi-State Models for Panel Data: The msm Package for R [PDF]

Panel data are observations of a continuous-time process at arbitrary times, for example, visits to a hospital to diagnose disease status. Multi-state models for such data are generally based on the Markov assumption.
Christopher Jackson
core  

Methods for analyzing recurrent and terminal events considering composite and competing endpoints in clinical trials: a practical overview. [PDF]

BMC Med Res Methodol
Duoerkongjiang A, Zapf A, Kirchhof P, Ozga AK.   +3 more
europepmc   +1 more source

A policy gradient method for semi-Markov decision processes

, 2002
Solving a semi-Markov decision process (SMDP) using value or policy iteration requires precise knowledge of the probabilistic model and suffers from the curse of dimensionality.
Sumeetpal S. Singh, Vladislav B. Tadić, Arnaud Doucet   +2 more
core  

A Semi-Markov framework for modeling football possessions and temporal expected threat. [PDF]

Sci Rep
Coz SL, Boustila F, Imbach F.
europepmc   +1 more source

SEMI-MARKOV DECISION PROCESSES WITH COUNTABLE STATE SPACE AND COMPACT ACTION SPACE

, 1978
We shall be concerned with the optimization problem of semi-Markov decision processes with countable state space and compact action space. Defined is the generalized reward function associated with the semi-Markov decision processes which include the ...
安田, 正實, Yasuda, Masami
core  

Automatic therapy planning based on concept drift. [PDF]

Front Rehabil Sci
Ramírez-Cruz M, Sucar LE, Morales EF, Rivas JJ.   +3 more
europepmc   +1 more source