Results 291 to 300 of about 23,126,500 (355)

τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

arXiv.org
Existing benchmarks do not test language agents on their interaction with human users or ability to follow domain-specific rules, both of which are vital for deploying them in real world applications.
Shun-Yu Yao, Noah Shinn, Pedram Razavi, Karthik Narasimhan   +3 more
semanticscholar   +1 more source

ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills

Robotics
Humanoid robots hold the potential for unparalleled versatility in performing human-like, whole-body skills. However, achieving agile and coordinated whole-body motions remains a significant challenge due to the dynamics mismatch between simulation and ...
Tairan He, Jia-Wei Gao, Wenli Xiao, Yuanhang Zhang, Zi Wang, Jiashun Wang, Zhengyi Luo, Guanqi He, Nikhil Sobanbab, Chaoyi Pan, Zeji Yi, Guannan Qu, Kris Kitani, Jessica K. Hodgins, “Jim” Fan, Yuke Zhu, Changliu Liu, Guanya Shi   +17 more
semanticscholar   +1 more source

DeepSeek-VL: Towards Real-World Vision-Language Understanding

arXiv.org
We present DeepSeek-VL, an open-source Vision-Language (VL) Model designed for real-world vision and language understanding applications. Our approach is structured around three key dimensions: We strive to ensure our data is diverse, scalable, and ...
Haoyu Lu, Wen Liu, Bo Zhang, Bing-Li Wang, Kai Dong, Bo Liu, Jingxiang Sun, Tongzheng Ren, Zhuoshu Li, Hao Yang, Yaofeng Sun, C. Deng, Hanwei Xu, Zhenda Xie, C. Ruan   +14 more
semanticscholar   +1 more source

Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

International Conference on Learning Representations
Real-world enterprise text-to-SQL workflows often involve complex cloud or local data across various database systems, multiple SQL queries in various dialects, and diverse operations from data transformation to analytics.
Fangyu Lei, Fangyu Lei, Jixuan Chen, Yuxiao Ye, Ruisheng Cao, Dongchan Shin, Hongjin Su, Zhaoqing Suo, Hongcheng Gao, Hongcheng Gao, Pengcheng Yin, Victor Zhong, Caiming Xiong, Ruoxi Sun, Qian Liu, Sida Wang, Tao Yu   +16 more
semanticscholar   +1 more source

DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments

Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) equipped with web search capabilities have demonstrated impressive potential for deep research tasks. However, current approaches predominantly rely on either manually engineered prompts (prompt engineering-based) with ...
Yu-Xiang Zheng, Dayuan Fu, Xiangkun Hu, Xiaojie Cai, Lyumanshan Ye, Peng-Rui Lu, Peng-Fei Liu   +6 more
semanticscholar   +1 more source

Evaluating Real-World Robot Manipulation Policies in Simulation

Conference on Robot Learning
The field of robotics has made significant advances towards generalist robot manipulation policies. However, real-world evaluation of such policies is not scalable and faces reproducibility challenges, which are likely to worsen as policies broaden the ...
Xuanlin Li, Kyle Hsu, Jiayuan Gu, Karl Pertsch, Oier Mees, H. Walke, Chuyuan Fu, Ishikaa Lunawat, Isabel Sieh, Sean Kirmani, Sergey Levine, Jiajun Wu, Chelsea Finn, Hao Su, Q. Vuong, Ted Xiao   +15 more
semanticscholar   +1 more source

MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection

Computer Vision and Pattern Recognition, 2019
The detection of anomalous structures in natural image data is of utmost importance for numerous tasks in the field of computer vision. The development of methods for unsupervised anomaly detection requires data on which to train and evaluate new ...
Paul Bergmann, Michael Fauser, David Sattlegger, C. Steger   +3 more
semanticscholar   +1 more source

TravelPlanner: A Benchmark for Real-World Planning with Language Agents

International Conference on Machine Learning
Planning has been part of the core pursuit for artificial intelligence since its conception, but earlier AI agents mostly focused on constrained settings because many of the cognitive substrates necessary for human-level planning have been lacking ...
Jian Xie, Kai Zhang, Jiangjie Chen, Tinghui Zhu, Renze Lou, Yuandong Tian, Yanghua Xiao, Yu Su   +7 more
semanticscholar   +1 more source

One-Step Effective Diffusion Network for Real-World Image Super-Resolution

Neural Information Processing Systems
The pre-trained text-to-image diffusion models have been increasingly employed to tackle the real-world image super-resolution (Real-ISR) problem due to their powerful generative image priors.
Rong-Yuan Wu, Lingchen Sun, Zhiyuan Ma, Lei Zhang   +3 more
semanticscholar   +1 more source

STAR: A Benchmark for Situated Reasoning in Real-World Videos

NeurIPS Datasets and Benchmarks
Reasoning in the real world is not divorced from situations. How to capture the present knowledge from surrounding situations and perform reasoning accordingly is crucial and challenging for machine intelligence.
Bo Wu, Shoubin Yu
semanticscholar   +1 more source