Results 51 to 60 of about 255,462 (259)

Workload-Aware Scheduling Using Markov Decision Process for Infrastructure-Assisted Learning-Based Multi-UAV Surveillance Networks

IEEE Access, 2023
In modern networking research, infrastructure-assisted unmanned autonomous vehicles (UAVs) are actively considered for real-time learning-based surveillance and aerial data-delivery under unexpected 3D free mobility and coordination. In this system model,
Soohyun Park, Chanyoung Park, Soyi Jung, Jae-Hyun Kim, Joongheon Kim   +4 more
doaj   +1 more source

Optimizing Performance of Continuous-Time Stochastic Systems using Timeout Synthesis

, 2016
We consider parametric version of fixed-delay continuous-time Markov chains (or equivalently deterministic and stochastic Petri nets, DSPN) where fixed-delay transitions are specified by parameters, rather than concrete values.
C Baier, C Haase, C Lindemann, CC Guet, EM Hahn, H Choi, JR Norris, K Etessami, K Ramamritham, L Carnevali, M Kwiatkowska, MA Marsan, MF Neuts, ML Puterman, NC Audsley, P Buchholz, R Alur, R Obermaisser, SK Jha, T Brázdil, T Brázdil, T Brázdil, W Feller, Ĺ Korenčiak   +23 more
core   +1 more source

Robotic Control for Human–Robot Collaborative Assembly Based on Digital Human Model and Reinforcement Learning

Advanced Robotics Research, EarlyView.
This work presents a robotic control method for human–robot collaborative assembly based on a biomechanics‐constrained digital human model. Reinforcement learning is used to generate physiologically plausible human motion trajectories, which are integrated into a virtual environment for robot control learning.
Bitao Yao, Hongzhou Ai, Wenjun Xu, Zude Zhou, Lihui Wang   +4 more
wiley   +1 more source

Data-Driven Volt/VAR Optimization for Modern Distribution Networks: A Review

IEEE Access
The Volt/Var optimization (VVO) enables advanced control strategy development for voltage regulation. With the recent advancement of data-driven approaches and communication infrastructure, realtime decision-making through VVO can effectively address ...
Sarah Allahmoradi, Shahabodin Afrasiabi, Xiaodong Liang, Junbo Zhao, Mohammad Shahidehpour   +4 more
doaj   +1 more source

Multi-model Markov decision processes

IISE Transactions, 2021
Markov decision processes (MDPs) have found success in many application areas that involve sequential decision making under uncertainty, including the evaluation and design of treatment and screening protocols for medical decision making. However, the data used to parameterize the model can influence what policies are recommended, and multiple ...
Lauren N. Steimle, David L. Kaufman, Brian T. Denton   +2 more
openaire   +1 more source

Diversity Patterns of Domestic Herbivore Viruses in China Reveal Transmission Dynamics with Disease Management Implications

Advanced Science, EarlyView.
This study performs pan‐viromic profiling of 14,529 samples from 5,710 domestic herbivores across five Chinese provinces, establishing the DhCN‐Virome (1,085,360 viral metagenomes). It reveals species/sample‐specific viromic signatures and cross‐species transmission dynamics, aiding unified disease control.
Yue Sun, Yong Li, Bagen Temur, Yuanqing Lin, Yuhang Liu, Le Yi, Zheng Sun, Gang Zhang, Jun Li, Yu Guo, Linchuan Li, Jinshan Cai, Wenliang Tian, Gen Meng, Lingling Jiang, Min Fang, Fuying Ding, Xuezhang Zhou, Changchun Tu, Biao He   +19 more
wiley   +1 more source

Identifying Cytokine Motif‐Containing, Immunomodulatory Bacterial Proteins in Human Gut Microbiome

Advanced Science, EarlyView.
By building and constructing HMM (Upper left, blue), the authors identify CMCPs in bacteria genomes and CRC related metagenomes and enriched CRC‐related CMCPs (Upper right, blue). They analyze sequence and structural similarity of hits (Lower left, green), test function with engineered EcN delivered to tumors in a mouse tumor model (Lower right, pink ...
Ziyu Wang, Siqi Guo, Jing Li, Qianqian Huang, Jing Ning, Binbin Xia, Xun Lv, Xiang Liu, Zeyu Gao, Jine Li, Longchao Liu, Moshi Song, Jun Wang   +12 more
wiley   +1 more source

Structured Prediction of Sequences and Trees using Infinite Contexts

, 2015
Linguistic structures exhibit a rich array of global phenomena, however commonly used Markov models are unable to adequately describe these phenomena due to their strong locality assumptions.
C Zhu, F Wood, M Johnson, MP Marcus, T Cohn   +4 more
core   +1 more source

SpatialESD: Spatial Ensemble Domain Detection in Spatial Transcriptomics

Advanced Science, EarlyView.
ABSTRACT Spatial transcriptomics (ST) measures gene expression while preserving spatial context within tissues. One of the key tasks in ST analysis is spatial domain detection, which remains challenging due to the complex structure of ST data and the varying performance of individual clustering methods. To address this, we propose SpatialESD, a Spatial
Hongyan Cao, Gaiqin Liu, Jingyi Xia, Runle Chen, Tong Wang, Xiaoling Yang, Ruiling Fang, Yanhong Luo, Ping Zeng, Hongmei Yu, Yanbo Zhang, Yuehua Cui   +11 more
wiley   +1 more source

Partially Observable Risk-Sensitive Markov Decision Processes

, 2016
We consider the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite time horizon which is generated by a Partially Observable Markov Decision Process (POMDP).
Bäuerle, Nicole, Rieder, Ulrich
core   +1 more source