Results 311 to 320 of about 769,446 (361)

Large Language Model-Brained GUI Agents: A Survey

arXiv.org
GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI automation.
Chaoyun Zhang, Shilin He, Jiaxu Qian, Bowen Li, Liqun Li, Si Qin, Yu Kang, Ming-Jie Ma, Qingwei Lin, S. Rajmohan, Dongmei Zhang, Qi Zhang   +11 more
semanticscholar   +1 more source

GUI Odyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices

arXiv.org
Autonomous Graphical User Interface (GUI) navigation agents can enhance user experience in communication, entertainment, and productivity by streamlining workflows and reducing manual intervention.
Quanfeng Lu, Wenqi Shao, Zitao Liu, Fanqing Meng, Boxuan Li, Botong Chen, Siyuan Huang, Kaipeng Zhang, Yu Qiao, Ping Luo   +9 more
semanticscholar   +1 more source

Aria-UI: Visual Grounding for GUI Instructions

Annual Meeting of the Association for Computational Linguistics
Digital agents for automating tasks across different platforms by directly manipulating the GUIs are increasingly important. For these agents, grounding from language instructions to target elements remains a significant challenge due to reliance on HTML
Yuhao Yang, Yue Wang, Dongxu Li, Ziyang Luo, Bei Chen, Chao Huang, Junnan Li   +6 more
semanticscholar   +1 more source

GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent

Annual Meeting of the Association for Computational Linguistics
GUI automation faces critical challenges in dynamic environments. MLLMs suffer from two key issues: misinterpreting UI components and outdated knowledge. Traditional fine-tuning methods are costly for app-specific knowledge updates.
Bin Xie, Rui Shao, Gongwei Chen, Kaiwen Zhou, Yinchuan Li, Jie Liu, Min Zhang, Liqiang Nie   +7 more
semanticscholar   +1 more source

ScaleTrack: Scaling and back-tracking Automated GUI Agents

arXiv.org
Automated GUI agents aims to facilitate user interaction by automatically performing complex tasks in digital environments, such as web, mobile, desktop devices.
Jing Huang, Zhixiong Zeng, Wenkang Han, Yufeng Zhong, Liming Zheng, Shuai Fu, Jingyuan Chen, Lin Ma   +7 more
semanticscholar   +1 more source

Towards Trustworthy GUI Agents: A Survey

arXiv.org
GUI agents, powered by large foundation models, can interact with digital interfaces, enabling various applications in web automation, mobile navigation, and software testing.
Yucheng Shi, Wenhao Yu, Wenlin Yao, Wenhu Chen, Ninghao Liu   +4 more
semanticscholar   +1 more source

MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents

arXiv.org
We introduce MMBench-GUI, a hierarchical benchmark for evaluating GUI automation agents across Windows, macOS, Linux, iOS, Android, and Web platforms.
Xuehui Wang, Zhenyu Wu, Jingjing Xie, Zichen Ding, Bowen Yang, Zehao Li, Zhaoyang Liu, Qingyun Li, Xuan Dong, Zhe Chen, Weiyun Wang, Xiangyu Zhao, Jixuan Chen, Haodong Duan, Tianbao Xie, Chenyu Yang, Shiqian Su, Yue Yu, Yuan Huang, Yiqian Liu, Xiao Zhang, Yanting Zhang, Xiangyu Yue, Weijie Su, Xizhou Zhu, Wei Shen, Jifeng Dai, Wenhai Wang   +27 more
semanticscholar   +1 more source

Succinylcholine: "good guy, bad guy".

Journal of post anesthesia nursing, 1992
Based on the content of this article, the reader should be able to (1) identify the action of succinylcholine; (2) list drugs that potentiate the effects of succinylcholine; (3) identify the conditions that potentiate the effects of succinylcholine; (4) name conditions in which succinylcholine is contraindicated; (5) state the laboratory test for ...
R, Schweinefus, L, Schick
openaire   +1 more source

GUICourse: From General Vision Language Models to Versatile GUI Agents

Annual Meeting of the Association for Computational Linguistics
Utilizing Graphic User Interface (GUI) for human-computer interaction is essential for accessing a wide range of digital tools. Recent advancements in Vision Language Models (VLMs) highlight the compelling potential to develop versatile agents to help ...
Wentong Chen, Junbo Cui, Jinyi Hu, Yujia Qin, Junjie Fang, Yue Zhao, Chongyi Wang, Jun Liu, Gui-Fang Chen, Yupeng Huo, Yuan Yao, Yankai Lin, Zhiyuan Liu, Maosong Sun   +13 more
semanticscholar   +1 more source

Good Guy vs. Good Guy

2009
<b>Conservation Refugees: The Hundred-Year-Conflict Between Global Conservation and Native Peoples</b> by Mark ...
openaire   +1 more source