Results 151 to 160 of about 5,471 (199)
Some of the next articles are maybe not open access.
Construction of Domain-Specific DistilBERT Model by Using Fine-Tuning
2020 International Conference on Technologies and Applications of Artificial Intelligence (TAAI), 2020In this paper, we point out the problem that BERT is domain dependent, and propose to construct the domain specific pre-training DistilBERT model by using fine-tuning. In particular, parameters of a DistilBERT model are initialized using a trained BERT model, and then these parameters are tuned from the specific domain corpus.
Hiroyuki Shinnou
exaly +2 more sources
Efficient Multilingual Service Classification with DistilBERT
2025 International Conference on Innovations in Intelligent Systems: Advancements in Computing, Communication, and Cybersecurity (ISAC3)Sujata Swain, Anjan Bandyopadhyay
exaly +2 more sources
LegalDB: Long DistilBERT for Legal Document Classification
2021 International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), 2021Transformers have caused a paradigm shift in tasks related to natural language. From text summarization to classification, these models have established new state-of-the-art results on various general and closed domain tasks. Having said that, most of the popular transformer based models (BERT - Bidirectional Encoder Representations from Transformers ...
Purbid Bambroo, Aditi Awasthi
openaire +1 more source
Performance Comparison of BERT and DistilBERT Models on SQuAD Dataset
2025 33rd Signal Processing and Communications Applications Conference (SIU)Oğuzhan Kırlar, Mehmet Ali Altuncu
exaly +2 more sources
Audio DistilBERT: A Distilled Audio BERT for Speech Representation Learning
2021 International Joint Conference on Neural Networks (IJCNN), 2021Self-supervised speech representation learning has been considered as an outstanding manner to improve the performance of downstream tasks. However, those models are often too cumbersome, which sets a barrier to deploy them on the edge and improves the threshold of the pre-training process.
Fan Yu +5 more
openaire +1 more source
A Method For Answer Selection Using DistilBERT And Important Words
2020 6th International Conference on Web Research (ICWR), 2020Question Answering is a hot topic in artificial intelligence and has many real-world applications. This field aims at generating an answer to the user's question by analyzing a massive volume of text documents. Answer Selection is a significant part of a question answering system and attempts to extract the most relevant answers to the user's question ...
Jamshid Mozafari +2 more
openaire +1 more source
Sentiment Analysis using DistilBERT
2023 IEEE 11th Conference on Systems, Process & Control (ICSPC), 2023Song Yi Ng +3 more
openaire +1 more source
DistilBERT and RoBERTa Models for Identification of Fake News
2023 46th MIPRO ICT and Electronics Convention (MIPRO), 2023Aleksandar Kitanovski +2 more
openaire +1 more source
Detection of Web-Attack using DistilBERT, RNN, and LSTM
2023 11th International Symposium on Digital Forensics and Security (ISDFS), 2023Biodoumoye George Bokolo +2 more
openaire +1 more source
Email Spam Classification using DistilBERT
2023 IEEE 15th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment, and Management (HNICEM), 2023Vance I. Del Rosario +2 more
openaire +1 more source