This paper introduces the POMA-C (Partial Observable Model for Anesthesia Control) framework, developed to address the challenge of anesthesia management in environments with incomplete physiological monitoring, such as low-resource settings where ...
Yide Yu+6 more
doaj +1 more source
Improving Training Result of Partially Observable Markov Decision Process by Filtering Beliefs [PDF]
In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My method search and compare every similar belief pair.
arxiv
Joint Situational Assessment‐Hierarchical Decision‐Making Framework for Maneuver Intent Decisions
This study introduces a new framework for decision‐making in unmanned combat aerial vehicles (UCAVs), integrating graph convolutional networks and hierarchical reinforcement learning (HRL). The method tackles adopts a curriculum‐based training approach guided by cross‐entropy rewards.
Ruihai Chen+4 more
wiley +1 more source
A Mixed Observability Markov Decision Process Model for Musical Pitch [PDF]
Partially observable Markov decision processes have been widely used to provide models for real-world decision making problems. In this paper, we will provide a method in which a slightly different version of them called Mixed observability Markov decision process, MOMDP, is going to join with our problem.
arxiv
Advancements in Machine Learning for Microrobotics in Biomedicine
Microrobotics is an innovative technology with great potential for noninvasive medical interventions. However, controlling and imaging microrobots pose significant challenges in complex environments and in living organisms. This review explores how machine learning algorithms can address these issues, offering solutions for adaptive motion control and ...
Amar Salehi+6 more
wiley +1 more source
Massively parallel computation of globally optimal shortest paths with curvature penalization
Abstract We address the computation of paths globally minimizing an energy involving their curvature, with given endpoints and tangents at these endpoints, according to models known as the Reeds‐Shepp car (reversible and forward variants), the Euler‐Mumford elasticae, and the Dubins car. For that purpose, we numerically solve degenerate variants of the
Jean‐Marie Mirebeau+4 more
wiley +1 more source
Trajectory Aware Deep Reinforcement Learning Navigation Using Multichannel Cost Maps
Deep reinforcement learning (DRL)-based navigation in an environment with dynamic obstacles is a challenging task due to the partially observable nature of the problem.
Tareq A. Fahmy+2 more
doaj +1 more source
Partially Observable Markov Decision Processes with Behavioral Norms
This extended abstract discusses various approaches to the constraining of Partially Observable Markov Decision Processes (POMDPs) using social norms and logical assertions in a dynamic logic framework. Whereas the exploitation of synergies among formal logic on the one hand and stochastic approaches and machine learning on the other is gaining ...
Nickles, Matthias, Rettinger, Achim
openaire +3 more sources
Deep Learning Methods in Soft Robotics: Architectures and Applications
Soft robotics has seen intense research over the past two decades and offers a promising approach for future robotic applications. However, standard industrial methods may be challenging to apply to soft robots. Recent advances in deep learning provide powerful tools to analyze and design complex soft machines that can operate in unstructured ...
Tomáš Čakurda+3 more
wiley +1 more source
Synthesis and Characterization of Photoswitchable Covalent Ligands for the β2‐Adrenoceptor
A structure‐based design of a covalent photoswitchable ligand for the β2‐adrenergic receptor, a therapeutically relevant GPCR, is described. This tool facilitates the modification of the intrinsic activity of the protein by light. Computational analysis of its mechanism of action suggests that the photoswitch takes place within the binding pocket ...
Ulrike Wirth+9 more
wiley +2 more sources