Results 61 to 70 of about 45,379 (157)

Semi-Markov decision process based congestion control algorithm for video transmission

Tongxin xuebao, 2014
Due to the problem that the congestion control algorithm of transmission control protocol (TCP) cannot meet the requirements of quality of experience for Internet video transmission, a semi-Markov decision process based conges-tion control algorithm for ...
Bo TIAN, Yi-min YANG, Shu-ting CAI
doaj   +2 more sources

Emergency Load-Shedding Decision for Frequency Stability of New Energy Power System Based on Constrained Markov Decision Process

Energies
Renewable energy systems dominated by powered electronic devices generally exhibit weak disturbance tolerance and limited grid-support capability. Following the blocking of a flexible DC transmission system, emergency load shedding in renewable-rich grid
Qiushi Fang, Zhentao Han, Wenhui He, Yufei Jin, Zewei Li, Mingxuan Lu, Weihan Chen, Jiawen Gao, Rui Zhang   +8 more
doaj   +1 more source

The value functions of Markov decision processes

Operations Research Letters, 2016
We provide a full characterization of the set of value functions of Markov decision processes.
Ehud Lehrer, Eilon Solan, Omri N. Solan
openaire   +2 more sources

Using Markov Decision Process Model for Sustainability Assessment in Industry 4.0

IEEE Access
The manufacturing industry is facing increasing challenges to improve sustainability performance by using Industry 4.0 technologies like big data analytics, the internet of things, and digital twins, considering their potentials.
Majid Sodachi, Amir Pirayesh, Omid Fatahi Valilai   +2 more
doaj   +1 more source

Markov-Decision-Process-Assisted Consumer Scheduling in a Networked Smart Grid

IEEE Access, 2017
Many recently built residential houses and factories are equipped with facilities for converting energy from green sources, such as solar energy, into electricity.
Zhi Liu, Cheng Zhang, Mianxiong Dong, Bo Gu, Yusheng Ji, Yoshiaki Tanaka   +5 more
doaj   +1 more source

Multiple-Environment Markov Decision Processes

CoRR, 2014
info:eu-repo/semantics ...
Raskin, Jean-François, Sankur, Ocan
openaire   +5 more sources

Analysis of Construction Risk Using Markov Decision Process and Reinforcement Learning

Management Analysis Journal
Recognizing the critical need for advanced risk management in the rapidly expanding construction sector, this study aims to analyze and optimize construction risk mitigation strategies at a prominent Indonesian housing developer, enhancing project time ...
Restu Wijang Prasetyo, Wiwik Handayani
doaj   +1 more source

Novel Data Transmission Schemes for Inter-WBAN Networks Using Markov Decision Process. [PDF]

Wirel Pers Commun, 2023
Roy S, Roy M, Chowdhury C.
europepmc   +1 more source

Stochastic energy management of DC photovoltaic microgrids using Markov decision process

Results in Engineering
The increasing reliance on renewable energy sources, particularly photovoltaic (PV) systems, in off-grid applications presents a critical challenge: managing energy supply under random load behavior and intermittent resource availability.
Mohamed Aatabe, Rachid Latif, Mohamed I. Mosaad, Shimaa A. Hussien   +3 more
doaj   +1 more source

On the Practical Art of State Definitions for Markov Decision Process Construction

IEEE Access, 2018
Many problems faced by decision makers today involve the management of large scale, complex systems that can be modeled as state-based control problems, specifically discrete Markov decision process (MDP). Typical examples include transportation systems,
William T. Scherer, Stephen Adams, Peter A. Beling   +2 more
doaj   +1 more source