SMDP-based sleep policy for base stations in heterogeneous cellular networks
Digital Communications and Networks, 2021 A dense heterogeneous cellular network can effectively increase the system capacity and enhance the network coverage. It is a key technology for the new generation of the mobile communication system.
Jing Wu +5 more
doaj +1 more source
Cognitive Modeling of Automation Adaptation in a Time Critical Task
Frontiers in Psychology, 2020 This paper presents a cognitive model that simulates an adaptation process to automation in a time-critical task. The paper uses a simple tracking task (which represents vehicle operation) to reveal how the reliance on automation changes as the success ...
Junya Morita +5 more
doaj +1 more source
American Option Pricing Under a Varying Economic Situation Using Semi-Markov Decision Process [PDF]
, 2022 In this chapter, we consider the problem of American option pricing when the asset price dynamics follow a binomial model dominated by a varying economic situation. We assume that the economic situation transits based on a semi-Markov chain.
Dimitrov, Marko, +3 more
core +1 more source
Application of the Pareto front for risk control in the transport system [PDF]
MATEC Web of Conferences, 2019 The article describes the developed model of controlling the process of means of transport operation, in which the choice of control strategy is carried out using non-deterministic methods.
Sołtysiak Agnieszka, Migawa Klaudiusz
doaj +1 more source
Towards Analysis of Semi-Markov Decision Processes [PDF]
, 2010 We investigate Semi-Markov Decision Processes (SMDPs). Two problems are studied, namely, the time-bounded reachability problem and the long-run average fraction of time problem. The former aims to compute the maximal (or minimum) probability to reach a certain set of states within a given time bound.
Taolue Chen 0001, Jian Lu 0001
openaire +1 more source
A survey on semi-Markov decision processes [PDF]
SCIENTIA SINICA Mathematica, 2015 This paper is a survey on semi-Markov decision processes (SMDPs). We present the background, the signi cance, and the research actuality of the in nite horizon expected discounted reward criterion, the long-run expected average reward criterion, the nite horizon expected reward criterion, the expected rst passage reward criterion, the probability ...
YongHui HUANG, XianPing GUO
openaire +1 more source
Maintenance strategy optimization using a continuous-state partially observable semi-Markov decision process [PDF]
, 2011 Due to the limitation of current condition monitoring technologies, the estimates of asset health states may contain some uncertainties. A maintenance strategy ignoring this uncertainty of asset health state can cause additional costs or downtime.
Wolff, Rodney C. +9 more
core +1 more source
Approximations in Performance Analysis of a Controllable Queueing System with Heterogeneous Servers
Mathematics, 2020 The paper studies a controllable multi-server heterogeneous queueing system where servers operate at different service rates without preemption, i.e., the service times are uninterrupted.
Dmitry Efrosinin +3 more
doaj +1 more source
Semi-Markov Model of MASS Voyage [PDF]
TransNavThe paper presents the readiness/safety model for the sea voyage of Maritime Autonomous Surface Ship (MASS), based on Semi-Markov process. The states of MASS during the voyage were defined as triplets of intentional type of MASS operations, reliability ...
Teresa Abramowicz-Gerigk +3 more
doaj +1 more source
Efficient qualitative analysis of classes of recursive markov decision processes and simple stochastic games [PDF]
, 2006 . Recursive Markov Decision Processes (RMDPs) and Recursive Simple Stochastic Games (RSSGs) are natural models for recursive systems involving both probabilistic and non-probabilistic actions.
Mihalis Yannakakis +3 more
core +1 more source