Results 121 to 130 of about 212,805 (267)

Strategically Conservative Q-Learning

CoRR
Offline reinforcement learning (RL) is a compelling paradigm to extend RL's practical utility by leveraging pre-collected, static datasets, thereby avoiding the limitations associated with collecting online interactions. The major difficulty in offline RL is mitigating the impact of approximation errors when encountering out-of-distribution (OOD ...
Yutaka Shimizu, Joey Hong, Sergey Levine, Masayoshi Tomizuka   +3 more
openaire   +2 more sources

Weak In‐Plane Ferromagnetism and Electronic Nematicity in the Distorted Triple‐Q Magnetic Phase of Co1/3TaS2

Advanced Materials, EarlyView.
Co1/3TaS2${\rm Co}_{1/3}{\rm TaS}_{2}$ hosts a triple‐Q noncoplanar antiferromagnetic state with coexisting Z3${\rm Z}_3$ electronic nematicity. We report rotational hysteresis observed in both magnetoresistance and magnetic torque, revealing strongly pinned in‐plane weak ferromagnetic moments in the triple‐Q phase and the magnetism‐driven nature of ...
Joonyoung Choi, Woonghee Cho, Pyeongjae Park, Woun Kang, Je‐Geun Park, Younjung Jo   +5 more
wiley   +1 more source

AHT-QCN: Adaptive Hunt Tuner Algorithm Optimized Q-learning Based Deep Convolutional Neural Network for the Penetration Testing

Cybernetics and Information Technologies
Penetration Testing (PT), which mimics actual cyber attacks, has become an essential procedure for assessing the security posture of network infrastructures in recent years.
Railkar Dipali, Joshi Shubhalaxmi
doaj   +1 more source

Phase Engineering of Nanomaterials (PEN): Evolution, Current Challenges, and Future Opportunities

Advanced Materials, EarlyView.
This review summarizes the synthesis, phase transition, advanced characterization spanning ex situ to in situ and operando techniques, and diverse applications of phase engineering of nanomaterials (PEN). It further outlines key challenges and future opportunities, such as phase stability, architecture control, and artificial intelligence (AI)‐driven ...
Ye Chen, Zhanxi Fan, Jingjie Ge, Qiyuan He, Zhuangchai Lai, Jiawei Liu, Chaoliang Tan, Hua Zhang   +7 more
wiley   +1 more source

Space‐Time Coding Conformal Metasurfaces for Multifrequency Beam Steering and Shaping

Advanced Materials, EarlyView.
Space‐time coding conformal metasurfaces enable dynamic wave control on curved surfaces by combining programmable spatial patterns with temporal modulation. This study shows that a single conformal aperture can independently manipulate multiple frequency components, achieving multifunctional beam shaping and steering, with implications for ...
Filippo Pepe, Lei Zhang, Yi Ning Zheng, Xiao Qing Chen, Ivan Iudice, Giuseppe Castaldi, Marco Di Renzo, Tie Jun Cui, Vincenzo Galdi   +8 more
wiley   +1 more source

Double Q-learning.

, 2010
In some stochastic environments the well-known reinforcement learning algorithm Q-learning performs very poorly. This poor performance is caused by large overestimations of action values. These overestimations result from a positive bias that is introduced because Q-learning uses the maximum action value as an approximation for the maximum expected ...
openaire   +3 more sources

Combination of 3D and 2D Small and Wide Angle X‐Ray Scattering Imaging Reveals Diminished Bone Quality in the Superior Human Femoral Neck Cortex

Advanced Materials, EarlyView.
Combined 2D and 3D X‐ray scattering imaging is used to analyse nanostructural properties in the inferior and superior cortex of 78 human femoral necks from 44 donors. The methodology allows for increased interpretation of nanostructure in a statistically relevant dataset, revealing nanostructural differences in anatomical locations critical to clinical
Torne Tänzer, Tatiana Kochetkova, Arthur Baroni, Mathieu Simon, Mads Carlsen, Santiago Fernandez Bordin, Manuel Guizar‐Sicairos, Philippe Zysset, Marianne Liebi   +8 more
wiley   +1 more source

From Behavior to Dynamics: Decoding Carrier Roles in Cu‐based Photocathodes for Solar‐Driven CO2 Reduction

Advanced Materials, EarlyView.
The performance of Cu‐based photocathodes in photoelectrochemical CO2 reduction is not governed by catalytic sites alone, but by the dynamic journey of photogenerated carriers. This review decodes how carrier generation, recombination, transport, accumulation, extraction, and electrolyte coupling shape catalytic activity, selectivity, and stability ...
Yi‐Cheng Wang, Chenyu Xu, Peng‐Fei Sui, Yi Liu, Xiaolei Wang, Jing‐Li Luo   +5 more
wiley   +1 more source

Mechanism‐Driven Nanoformulations for Cognitive Impairment Induced by Intermittent Hypoxia and Periodontitis

Advanced Materials, EarlyView.
Clinically, intermittent hypoxia (IH) is often accompanied by periodontitis, which accelerates cognitive impairment induced by IH. Novel Janus mesoporous gold‐silica nanoformulations (RVG‐Au&mSiO2‐TPP‐VB) enable intranasal delivery, achieve hierarchical targeting to neuronal mitochondria, effectively scavenge reactive oxygen species, inhibit the HIF‐1α/
Kai‐Run Zhang, Tianbao Zhu, An‐Qi Liu, Jia‐Jia Deng, Ya‐Li Han, Sheng‐Cai Qi, Xue Liu, Tian‐Yi Jiang, Ming‐Rui Zhai, Yu‐Ying He, Xiu‐Juan Li, Hong‐Ting Da, Rui Xu, Xiaomin Li, Jun Gao, Yue‐Hua Liu   +15 more
wiley   +1 more source

Resolving Heterogeneity of Targeted Lipid Nanoparticles Through Solution‐Based Biophysical Analyses

Advanced Materials, EarlyView.
AF4‐UV‐DLS‐MALS‐SAXS resolves previously inaccessible targeted lipid nanoparticle (tLNP) subpopulations that differ in size, shape, and composition. Correlation of subpopulation‐resolved biophysical properties with in vivo RNA delivery reveals that targeted placental transfection is associated with distinct tLNP subpopulations rather than ensemble ...
Hannah C. Geisler, Hannah C. Safford, Ajay S. Thatte, Marshall S. Padilla, Elisa Battistini, Hannah M. Yamagata, Violet M. Ullman, Alex Chan, Benjamin E. Nachod, Anushka Agrawal, Maxwell B. Watkins, Jesse B. Hopkins, Andrew Tsourkas, Kushol Gupta, Michael J. Mitchell   +14 more
wiley   +1 more source