Results 61 to 70 of about 1,103 (177)

Evaluation of GRU with Attention and DistilBERT in Text Classification Tasks

International Journal of Combinatorial Optimization Problems and Informatics
In this paper compares two deep learning models for multiclass text classification in the cyberbullying domain. The corpus is written in English and includes six classes representing different types of harassment. The trained models are a GRU network with an attention mechanism and the DistilBERT transformer.
Ana Laura Lezama Sánchez, Mireya Tovar Vidal   +1 more
openaire   +2 more sources

Fractal Self-Similarity in Semantic Convergence: Gradient of Embedding Similarity across Transformer Layers

Fractal and Fractional
This paper presents a mathematical analysis of semantic convergence in transformer-based language models, drawing inspiration from the concept of fractal self-similarity.
Minhyeok Lee
doaj   +1 more source

Large Language Models for Detecting Cyberattacks on Smart Grid Protective Relays

IEEE Open Access Journal of Power and Energy
This paper presents a large language model (LLM)–based framework that adapts and fine-tunes compact LLMs for detecting cyberattacks on transformer current differential relays (TCDRs), which can otherwise cause false tripping of critical power ...
Ahmad Mohammad Saber, Saeed Jafari, Zhengmao Ouyang, Paul Budnarain, Amr Youssef, Deepa Kundur   +5 more
doaj   +1 more source

Evaluating sentiment analysis models: A comparative analysis of vaccination tweets during the COVID-19 phase leveraging DistilBERT for enhanced insights

MethodsX
This study investigates public sentiment toward COVID-19 vaccinations by analyzing Twitter data using advanced machine learning (ML) and natural language processing (NLP) techniques.
Renuka Agrawal, Mehuli Majumder, Ishita Yadav, Nandini Taneja, Safa Hamdare, Preeti Hemnani   +5 more
doaj   +1 more source

Managerial decision analysis using small language models

Журнал Белорусского государственного университета: Математика, информатика
This paper proposes a method for the automatic assessment of managerial decision quality based on free-form textual responses to Russian-language business cases using a fine-tuned DistilBERT model.
Ksenia V. Andrenko, Aliaksandr A. Kroshchanka, Vladimir A. Golovko, Yury B. Krapivin   +3 more
doaj  

Strategic Energy Project Investment Decisions Using RoBERTa: A Framework for Efficient Infrastructure Evaluation

Buildings
The task of identifying high-value projects from vast investment portfolios presents a major challenge in the construction industry, particularly within the energy sector, where decision-making carries high financial and operational stakes.
Recep Özkan, Fatemeh Mostofi, Fethi Kadıoğlu, Vedat Toğan, Onur Behzat Tokdemir   +4 more
doaj   +1 more source

Distilbert-gnn: a Powerful Approach to Social Media Event Detection

International Journal of Data Science and Analytics
Abstract Finding events actively discussed locally or globally is a significant problem when mining social media data streams. Identifying such events can serve as an early warning system in an event such as an accident, a protest, an election, or other breaking news.
Asres Temam Abagissa, Shruti Saxena, Joydeep Chandra   +2 more
openaire   +1 more source

From text to code – Leveraging machine learning for neurology outpatient clinical codingBox 1. Prompt engineering template used in calls to Mistral 7B. was replaced with each processed clinic letter body (the complete prompt is available in Appendix 4).Box 2. Example of hallucination using Mistral 7b model

Neuroscience Informatics
Background: Most neurological care is delivered in outpatient settings without mandated clinical coding. The clinical records remain stored as unstructured text with inconsistent formatting.
Elena Purcaru, Michael George, Matthew Stammers, Christopher Kipps   +3 more
doaj   +1 more source

Comparative analysis of transformer models for sentiment classification of UK CBDC discourse on X

Discover Analytics
Sentiment analysis is critical in understanding public perceptions of evolving currencies such as central bank digital currencies (CBDCs). This study compares three transformer-based models—DistilBERT, RoBERTa, and XLM-RoBERTa—for sentiment ...
Guneet Kaur, Saemundur Haraldsson, Andrea Bracciali   +2 more
doaj   +1 more source

Multilingual AI-Generated Text Detection in Arabic, English, and Turkish Using a Hybrid Transformer–Graph Convolutional Network

Applied Sciences
Detecting AI-generated text has become a critical task as artificial intelligence systems are increasingly used in content creation. Current detection methods often suffer from limited accuracy and weak multilingual performance.
Ayca Bostancioglu, Bihter Das, Muzeyyen Bulut Ozek   +2 more
doaj   +1 more source