Results 21 to 30 of about 15,951 (231)
SemEval-2021 Task 12: Learning with Disagreements [PDF]
Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), 2021 Disagreement between coders is ubiquitous in virtually all datasets annotated with human judgements in both natural language processing and computer vision. However, most supervised machine learning methods assume that a single preferred interpretation exists for each item, which is at best an idealization.
Uma, Alexandra +7 more
openaire +1 more source
The SemEval-2007 WePS evaluation [PDF]
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 This paper presents the task definition, resources, participation, and comparative results for the Web People Search task, which was organized as part of the SemEval-2007 evaluation exercise. This task consists of clustering a set of documents that mention an ambiguous person name according to the actual entities referred to using that name.
Javier Artiles +2 more
openaire +1 more source
Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions - DEW '09, 2009 In this paper we describe the SemEval-2010 Cross-Lingual Lexical Substitution task, which is based on the English Lexical Substitution task run at SemEval-2007. In the English version of the task, annotators and systems had to find an alternative substitute word or phrase for a target word in context.
Ravi Sinha +2 more
openaire +1 more source
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 The TempEval task proposes a simple way to evaluate automatic extraction of temporal relations. It avoids the pitfalls of evaluating a graph of inter-related labels by defining three sub tasks that allow pairwise evaluation of temporal relations. The task not only allows straightforward evaluation, it also avoids the complexities of full temporal ...
Marc Verhagen +5 more
openaire +1 more source
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 This paper presents the task definition, resources, and the single participant system for Task 12: Turkish Lexical Sample Task (TLST), which was organized in the SemEval-2007 evaluation exercise. The methodology followed for developing the specific linguistic resources necessary for the task has been described in this context.
Zeynep Orhan +2 more
openaire +1 more source
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 This paper describes our experience in preparing the data and evaluating the results for three subtasks of SemEval-2007 Task-17 - Lexical Sample, Semantic Role Labeling (SRL) and All-Words respectively. We tabulate and analyze the results of participating systems.
Sameer S. Pradhan +3 more
openaire +1 more source
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 The goal of this task is to allow for comparison across sense-induction and discrimination systems, and also to compare these systems to other supervised and knowledge-based systems. In total there were 6 participating systems. We reused the SemEval-2007 English lexical sample subtask of task 17, and set up both clustering-style unsupervised evaluation
Eneko Agirre, Aitor Soroa
openaire +1 more source
A Method of Word Sense Disambiguation with Recurrent Netural Networks
Journal of Harbin University of Science and Technology, 2020 Word sense disambiguation is an important research problem in natural language processing field. For the phenomenon that a Chinese word has many senses, recurrent neural network (RNN) is used to determine true meaning of ambiguous word with its context ...
ZHANG Chunxiang +2 more
doaj +1 more source
Improving Semantic Dependency Parsing with Higher-Order Information Encoded by Graph Neural Networks
Applied Sciences, 2022 Higher-order information brings significant accuracy gains in semantic dependency parsing. However, modeling higher-order information is non-trivial. Graph neural networks (GNNs) have been demonstrated to be an effective tool for encoding higher-order ...
Bin Li +4 more
doaj +1 more source
Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07, 2007 In this paper we describe SemEval-2007 task number 9 (Multilevel Semantic Annotation of Catalan and Spanish). In this task, we aim at evaluating and comparing automatic systems for the annotation of several semantic linguistic levels for Catalan and Spanish.
Lluís Màrquez +3 more
openaire +1 more source