Results 321 to 330 of about 10,675,039 (377)

SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training

International Conference on Machine Learning
Supervised fine-tuning (SFT) and reinforcement learning (RL) are widely used post-training techniques for foundation models. However, their roles in enhancing model generalization capabilities remain unclear. This paper studies the difference between SFT
Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V. Le, Sergey Levine, Yi Ma   +8 more
semanticscholar   +1 more source

Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models

arXiv.org
In this work, we introduce the Qwen3 Embedding series, a significant advancement over its predecessor, the GTE-Qwen series, in text embedding and reranking capabilities, built upon the Qwen3 foundation models.
Yanzhao Zhang, Mingxin Li, Dingkun Long, Xin Zhang, Huan Lin, Baosong Yang, Pengjun Xie, An Yang, Dayiheng Liu, Junyang Lin, Fei Huang, Jingren Zhou   +11 more
semanticscholar   +1 more source

A foundation model for the Earth system

Nature
Reliable forecasting of the Earth system is essential for mitigating natural disasters and supporting human progress. Traditional numerical models, although powerful, are extremely computationally expensive1.
Cristian Bodnar, W. Bruinsma, Ana Lucic, Megan Stanley, Anna Allen, Johannes Brandstetter, Patrick Garvan, Maik Riechert, Jonathan A. Weyn, Haiyu Dong, Jayesh K. Gupta, Kit Thambiratnam, Alexander T. Archibald, Chun-Chieh Wu, E. Heider, Max Welling, Richard E. Turner, P. Perdikaris   +17 more
semanticscholar   +1 more source

Foundation Models Defining a New Era in Vision: A Survey and Outlook

IEEE Transactions on Pattern Analysis and Machine Intelligence
Vision systems that see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The complex relations between objects and their locations, ambiguities, and variations in the real-world environment can be ...
Muhammad Awais, Muzammal Naseer, Salman Khan, R. Anwer, Hisham Cholakkal, Mubarak Shah, Ming-Hsuan Yang, F. Khan   +7 more
semanticscholar   +1 more source

A Survey of Reasoning with Foundation Models: Concepts, Methodologies, and Outlook

ACM Computing Surveys
Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation.
Jiankai Sun, Chuanyang Zheng, E. Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, Hongyang Li, Mengzhe Geng, Yue Wu, Wenhai Wang, Junsong Chen, Zhangyue Yin, Xiaozhe Ren, Jie Fu, Junxian He, Wu Yuan, Qi Liu, Xihui Liu, Yu Li, Hao Dong, Yu Cheng, Ming Zhang, P. Heng, Jifeng Dai, Ping Luo, Jingdong Wang, Jingwei Wen, Xipeng Qiu, Yi-Chen Guo, Hui Xiong, Qun Liu, Zhenguo Li   +33 more
semanticscholar   +1 more source

Yi: Open Foundation Models by 01.AI

arXiv.org
We introduce the Yi model family, a series of language and multimodal models that demonstrate strong multi-dimensional capabilities. The Yi model family is based on 6B and 34B pretrained language models, then we extend them to chat models, 200K long ...
01.AI Alex Young, Bei Chen, Chao Li, Chengen Huang, Ge Zhang, Guanwei Zhang, Heng Li, Jiangcheng Zhu, Jianqun Chen, Jing Chang, Kaidong Yu, Peng Liu, Qiang Liu, Shawn Yue, Senbin Yang, Shiming Yang, Tao Yu, Wen Xie, Wenhao Huang, Xiaohui Hu, Xiaoyi Ren, Xinyao Niu, Pengcheng Nie, Yuchi Xu, Yudong Liu, Yue Wang, Yuxuan Cai, Zhenyu Gu, Zhiyuan Liu, Zonghong Dai   +29 more
semanticscholar   +1 more source

Chameleon: Mixed-Modal Early-Fusion Foundation Models

arXiv.org
We present Chameleon, a family of early-fusion token-based mixed-modal models capable of understanding and generating images and text in any arbitrary sequence.
Chameleon Team, Mingda Chen, Jacob Kahn, Shang-Wen Li   +3 more
semanticscholar   +1 more source

Moshi: a speech-text foundation model for real-time dialogue

arXiv.org
We introduce Moshi, a speech-text foundation model and full-duplex spoken dialogue framework. Current systems for spoken dialogue rely on pipelines of independent components, namely voice activity detection, speech recognition, textual dialogue and text ...
Alexandre D'efossez, Laurent Mazar'e, Manu Orsini, Amélie Royer, Patrick P'erez, Herv'e J'egou, Edouard Grave, Neil Zeghidour   +7 more
semanticscholar   +1 more source

MOMENT: A Family of Open Time-series Foundation Models

International Conference on Machine Learning
We introduce MOMENT, a family of open-source foundation models for general-purpose time series analysis. Pre-training large models on time series data is challenging due to (1) the absence of a large and cohesive public time series repository, and (2 ...
Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, Artur Dubrawski   +5 more
semanticscholar   +1 more source

Foundation Fieldbus

2017
Foundation Fieldbus is an all-digital, serial, two-way communication system for industrial applications; its specification has been developed by the not-for-profit Fieldbus Foundation association established in 1994 [1]. Please note that in the following, Fieldbus Foundation will refer to the name of the association while Foundation Fieldbus (FF) will ...
openaire   +1 more source