Results 51 to 60 of about 57,303 (303)

Maintenance strategy optimization using a continuous-state partially observable semi-Markov decision process

, 2011
Due to the limitation of current condition monitoring technologies, the estimates of asset health states may contain some uncertainties. A maintenance strategy ignoring this uncertainty of asset health state can cause additional costs or downtime.
Wolff, Rodney C., Yifan Zhou, Mathew, Joseph, Rodney Wolff, Sun, Yong, Yong Sun, Ma, Lin, Lin Ma, Joseph Mathew, Zhou, Yifan   +9 more
core   +1 more source

Weaving Intelligence: Thermally Drawn Multimaterial Fibers Toward AI‐Enabled Smart Textiles

Advanced Materials, EarlyView.
Thermally drawn multimaterial fibers are rapidly advancing as intelligent structural units for next‐generation smart textiles. Integrating multimaterial architectures with neuromorphic and spiking‐neural‐network principles enables fabrics that can sense, compute, and adapt autonomously.
Vuong Dinh Trung, Jiaxiang Yi, Hieu Nguyen‐Duc, Tien Nu Hoang Lo, Weili Zhao, Chaoqun Dong, Fabien Sorin, Baris Caglar, Lei Wei, Tung Nguyen‐Dang   +9 more
wiley   +1 more source

Characterizing Markov Decision Processes [PDF]

, 2002
Problem characteristics often have a significant influence on the difficulty of solving optimization problems. In this paper, we propose attributes for characterizing Markov Decision Processes (MDPs), and discuss how they affect the performance of reinforcement learning algorithms that use function approximation.
Bohdana Ratitch, Doina Precup
openaire   +1 more source

Risk-sensitive average optimality in Markov decision processes [PDF]

, 2018
summary:In this note attention is focused on finding policies optimizing risk-sensitive optimality criteria in Markov decision chains. To this end we assume that the total reward generated by the Markov process is evaluated by an exponential utility ...
Sladký, Karel
core   +3 more sources

Super‐Resolution Ultrasound Based Cell Tracking With Polymeric Nanobubbles

Advanced Materials, EarlyView.
This study presents a super‐resolution ultrasound platform for tracking cells in vivo. Biocompatible polymeric nanobubbles are used as highly echogenic intracellular labels. Following the injection of cells and microbubbles, ultrasound localization microscopy (ULM) can dynamically match the microvascular architecture and individual cell trajectories ...
Junlin Chen, Xiaoyu Wang, Jilin Fan, Bi Wang, Hanghang Fang, Yurui Wang, Hao Cui, Mohammad Roufarshbaf, Ekaterina Savina, Alexandra Valeske, Quim Peña, Yang Shi, Andreas Herrmann, Twan Lammers, Mathias Hornef, Roman Barmin, Thomas Lisson, Georg Schmitz, Anne Rix, Fabian Kiessling   +19 more
wiley   +1 more source

Contextual Markov Decision Processes

CoRR, 2015
We consider a planning problem where the dynamics and rewards of the environment depend on a hidden static parameter referred to as the context. The objective is to learn a strategy that maximizes the accumulated reward across all contexts. The new model, called Contextual Markov Decision Process (CMDP), can model a customer's behavior when interacting
Assaf Hallak, Dotan Di Castro, Shie Mannor   +2 more
openaire   +2 more sources

A New Decision Support Framework for Managing Foot-and-mouth Disease Epidemics

, 2014
Animal disease epidemics such as the foot-and-mouth disease (FMD) pose recurrent threat to countries with intensive livestock production. Efficient FMD control is crucial in limiting the damage of FMD epidemics and securing food production.
Mourits, Monique C., Huirne, Ruud B., Kristensen, Anders Ringgaard, Kristensen, A.R., Ge, Lan, Mourits, M.C.M., Huirne, R.B.M., Ge, L.   +7 more
core   +1 more source

Recent Advances of Slip Sensors for Smart Robotics

Advanced Materials Technologies, EarlyView.
This review summarizes recent progress in robotic slip sensors across mechanical, electrical, thermal, optical, magnetic, and acoustic mechanisms, offering a comprehensive reference for the selection of slip sensors in robotic applications. In addition, current challenges and emerging trends are identified to advance the development of robust, adaptive,
Xingyu Zhang, Liao Wu, Shuai He, Zhao Sha, Yuwan Huang, Shuying Wu, Dewei Chu, Chun H. Wang, Shuhua Peng   +8 more
wiley   +1 more source

Creativity and Markov Decision Processes [PDF]

CoRR
Creativity is already regularly attributed to AI systems outside specialised computational creativity (CC) communities. However, the evaluation of creativity in AI at large typically lacks grounding in creativity theory, which can promote inappropriate attributions and limit the analysis of creative behaviour.
Guckelsberger Christian, Ady Nadia, Lahikainen Joonas   +2 more
openaire   +4 more sources

Learning Highly Dynamic Skills Transition for Quadruped Jumping Through Constrained Space

Advanced Robotics Research, EarlyView.
A quadruped robot masters dynamic jumps through constrained spaces with animal‐inspired moves and intelligent vision control. This hierarchical learning approach combines imitation of biological agility with real‐time trajectory planning. Although legged animals are capable of performing explosive motions while traversing confined spaces, replicating ...
Zeren Luo, Jiahui Zhang, Yimin Han, Ji Ma, Minghao Lu, Ioannis Havoutis, Peng Lu   +6 more
wiley   +1 more source