Results 21 to 30 of about 2,225,636 (373)

Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering [PDF]

Conference on Empirical Methods in Natural Language Processing, 2023
Large Language Model (LLM) has gained popularity and achieved remarkable results in open-domain tasks, but its performance in real industrial domain-specific scenarios is average due to its lack of specific domain knowledge.
Zezhong Wang, Fan Yang, Pu Zhao, Lu Wang, Jue Zhang, Mohit Garg, Qingwei Lin, Dongmei Zhang   +7 more
semanticscholar   +1 more source

Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health [PDF]

arXiv.org, 2023
Pretrained language models have been used in various natural language processing applications. In the mental health domain, domain-specific language models are pretrained and released, which facilitates the early detection of mental health conditions ...
Shaoxiong Ji, Tianlin Zhang, Kailai Yang, S. Ananiadou, E. Cambria, J. Tiedemann   +5 more
semanticscholar   +1 more source

IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization [PDF]

Conference on Empirical Methods in Natural Language Processing, 2021
We present IndoBERTweet, the first large-scale pretrained model for Indonesian Twitter that is trained by extending a monolingually-trained Indonesian BERT model with additive domain-specific vocabulary.
Fajri Koto, Jey Han Lau, Timothy Baldwin
openalex   +3 more sources

Devito: an embedded domain-specific language for finite differences and geophysical exploration [PDF]

Geoscientific Model Development, 2018
. We introduce Devito, a new domain-specific language for implementing high-performance finite-difference partial differential equation solvers. The motivating application is exploration seismology for which methods such as full-waveform inversion and ...
M. Louboutin, Michael Lange, F. Luporini, Navjot Kukreja, Philipp A. Witte, F. Herrmann, Paulius Velesko, G. Gorman   +7 more
semanticscholar   +1 more source

Efficient Continual Pre-training for Building Domain Specific Large Language Models [PDF]

Annual Meeting of the Association for Computational Linguistics, 2023
Large language models (LLMs) have demonstrated remarkable open-domain capabilities. LLMs tailored for a domain are typically trained entirely on domain corpus to excel at handling domain-specific tasks. In this work, we explore an alternative strategy of
Yong Xie, Karan Aggarwal, Aitzaz Ahmad
semanticscholar   +1 more source

DARWIN Series: Domain Specific Large Language Models for Natural Science [PDF]

arXiv.org, 2023
Emerging tools bring forth fresh approaches to work, and the field of natural science is no different. In natural science, traditional manual, serial, and labour-intensive work is being augmented by automated, parallel, and iterative processes driven by ...
Tong Xie, Yuwei Wan, Wei Huang, Zhenyu Yin, Yixuan Liu, Shaozhou Wang, Qingyuan Linghu, Chunyu Kit, Clara Grazian, Wenjie Zhang, Imran Razzak, B. Hoex   +11 more
semanticscholar   +1 more source

Domain Specific Languages [PDF]

Proceedings of the 16th International Conference on Information Integration and Web-based Applications & Services, 2014
The engineering of systems involves many different stake-holders, each with their own domain of expertise. Hence more and more organizations are developing an ever grow-ing number of Domain Specific Languages (DSLs) to allow domain experts to express solutions directly in terms of rel-evant domain concepts.
openaire   +3 more sources

A Domain Specific Language for Smart Cities

Proceedings, 2017
In Smart Cities Systems, one of the main problems of its development is the integration of different devices and sensors. Many of them are incompatible with each other (different platforms, communication protocols, etc.).
Francisca Rosique, Fernando Losilla, Juan Ángel Pastor   +2 more
doaj   +1 more source

SCLang: Graphical Domain-Specific Modeling Language for Stream Cipher

Cybernetics and Information Technologies, 2023
A Stream Cipher (SC) is a symmetric-key encryption type that scrambles each piece of data in clear text to conceal it from hackers. Despite its advantages, it has a substantial challenge.
Qassir Samar Amil, Gaata Methaq Talib, Sadiq Ahmed T.   +2 more
doaj   +1 more source

ASRS-CMFS vs. RoBERTa: Comparing Two Pre-Trained Language Models to Predict Anomalies in Aviation Occurrence Reports with a Low Volume of In-Domain Data Available

Aerospace, 2022
We consider the problem of solving Natural Language Understanding (NLU) tasks characterized by domain-specific data. An effective approach consists of pre-training Transformer-based language models from scratch using domain-specific data before fine ...
Samuel Kierszbaum, Thierry Klein, Laurent Lapasset   +2 more
doaj   +1 more source