Results 71 to 80 of about 14,317,493 (293)

An Adaptive Scheduling Algorithm Integrating Hierarchical Reinforcement Learning and Semi-Markov Decision Processes

open access: yesApplied Sciences
Coordinating multiple unmanned aerial vehicle (UAV) systems under strict energy and temporal constraints remains a complex scheduling problem. Existing reinforcement learning methods typically rely on fixed-time-step modeling, which struggles to ...
Feng Wang   +4 more
doaj   +1 more source

Software Vulnerability Patch Management with Semi-Markov Decision Process [PDF]

open access: yes, 2013
Information security incidents frequency has been increasing dramatically, the aim of this study is to analyze the state-space reachability problems through the transition of vulnerable status after the informative system vulnerability exposure.
Farn, Kwo-Jean   +3 more
core  

A New Implementation of Network GARCH Model for Stock Volatility and Co‐Volatility Forecasting

open access: yesJournal of Forecasting, EarlyView.
ABSTRACT Volatility clustering and spillovers are key features of financial time series with many cross‐sectional assets. While network analysis links similar or correlated stocks and helps trace volatility spillovers, contemporary multivariate ARCH‐GARCH formulations struggle to represent structured network dependence and remain parsimonious.
Peiyi Zhou
wiley   +1 more source

Solving Hidden-Semi-Markov-Mode Markov Decision Problems

open access: yes, 2014
International audienceHidden-Mode Markov Decision Processes (HM-MDPs) were proposed to represent sequential decision-making problems in non-stationary environments that evolve according to a Markov chain.
Hadoux, Emmanuel   +2 more
core   +2 more sources

To Code or Not to Code: When and How to Use Network Coding in Energy Harvesting Wireless Multi-Hop Networks

open access: yesIEEE Access
The broadcast nature of communication in transmission media has driven the rise of network coding’s popularity in wireless networks. Numerous benefits arise from employing network coding in multi-hop wireless networks, including enhanced ...
Nastooh Taheri Javan, Zahra Yaghoubi
doaj   +1 more source

SEMI-MARKOV DECISION PROCESSES AND THEIR APPLICATIONS IN REPLACEMENT MODELS

open access: yesJournal of the Operations Research Society of Japan, 1985
We consider the problem of minimizing the long-run average expected cost per unit time in a semi-Markov decision process with arbitrary state and action space. Using the idea of successive approximations, sufficient conditions for the existence of an optimal stationary policy are given.
openaire   +3 more sources

Symbolic Magnifying Lens Abstraction in Markov Decision Processes [PDF]

open access: yes, 2008
In this paper, we combine abstraction-refinement and symbolic techniques to fight the state-space explosion problem when model checking Markov decision processes (MDPs).
Luca de Alfaro   +7 more
core   +1 more source

Sex‐Specific Proteomic Profiling Identifies Pregnancy Zone Protein as a Complement‐Linked Marker of Adverse Prognosis in Esophageal Adenocarcinoma

open access: yesInternational Journal of Cancer, EarlyView.
ABSTRACT Esophageal adenocarcinoma (EAC) exhibits marked male predominance with male‐to‐female ratios reaching 8.5:1, yet the molecular basis underlying this sex disparity remains poorly characterized. We analyzed 92 EAC specimens using mass spectrometry–based proteomics, comprising 47 female and 45 male tumors from treatment‐naïve patients ...
Alexander Quaas   +8 more
wiley   +1 more source

Nonstationary Continuous Time Markov Decision Processes in a Semi-Markov Environment with Discounted Criterion [PDF]

open access: yes, 1995
This paper deals with the nonstationary continuous time Markov decision process in a semi-Markov environment with discounted criterion. The model can describe a system that itself can be modeled by a countable state nonstationary continuous time Markov ...
Hu, Q.Y.
core   +1 more source

Estimation of Subtype‐Specific Tumour Growth Rate Distributions and Interval Cancer Proportions in Breast Cancer Using Biology‐Inspired Natural History Models

open access: yesInternational Journal of Cancer, EarlyView.
ABSTRACT Breast cancer progression varies across molecular subtypes, influencing detection rates and prognosis. Differences in the proportion of interval cancers (PIC)—cancers detected symptomatically between scheduled screening rounds—have been observed across subtypes, likely reflecting heterogeneity in tumour growth dynamics. We applied a continuous‐
Letizia Orsini   +3 more
wiley   +1 more source

Home - About - Disclaimer - Privacy