Results 11 to 20 of about 11,306 (258)
Dynamic Contextualized Word Embeddings [PDF]
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2021 Static word embeddings that represent words by a single vector cannot capture the variability of word meaning in different linguistic and extralinguistic contexts. Building on prior work on contextualized and dynamic word embeddings, we introduce dynamic contextualized word embeddings that represent words as a function of both linguistic and ...
Hofmann, V +2 more
openaire +2 more sources
Morphological Word-Embeddings [PDF]
Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2015 Published at NAACL ...
Ryan Cotterell, Hinrich Schütze
openaire +2 more sources
Attention Word Embedding [PDF]
Proceedings of the 28th International Conference on Computational Linguistics, 2020 Word embedding models learn semantically rich vector representations of words and are widely used to initialize natural processing language (NLP) models. The popular continuous bag-of-words (CBOW) model of word2vec learns a vector embedding by masking a given word in a sentence and then using the other words as a context to predict it.
Shashank Sonkar +2 more
openaire +2 more sources
Improving Word Embedding Using Variational Dropout
Proceedings of the International Florida Artificial Intelligence Research Society Conference, 2023 Pre-trained word embeddings are essential in natural language processing (NLP). In recent years, many post-processing algorithms have been proposed to improve the pre-trained word embeddings.
Zainab Albujasim +3 more
doaj +1 more source
Relational Word Embeddings [PDF]
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019 While word embeddings have been shown to implicitly encode various forms of attributional knowledge, the extent to which they capture relational information is far more limited. In previous work, this limitation has been addressed by incorporating relational knowledge from external knowledge bases when learning the word embedding.
José Camacho-Collados +2 more
openaire +3 more sources
Neuro-Symbolic Word Embedding Using Textual and Knowledge Graph Information
Applied Sciences, 2022 The construction of high-quality word embeddings is essential in natural language processing. In existing approaches using a large text corpus, the word embeddings learn only sequential patterns in the context; thus, accurate learning of the syntax and ...
Dongsuk Oh, Jungwoo Lim, Heuiseok Lim
doaj +1 more source
Benefiting from Structured Resources to Present a Computationally Efficient Word Embedding Method [PDF]
Journal of Artificial Intelligence and Data Mining, 2022 In recent years, new word embedding methods have clearly improved the accuracy of NLP tasks. A review of the progress of these methods shows that the complexity of these models and the number of their training parameters grows increasingly.
F. Jafarinejad
doaj +1 more source
Learned Text Representation for Amharic Information Retrieval and Natural Language Processing
Information, 2023 Over the past few years, word embeddings and bidirectional encoder representations from transformers (BERT) models have brought better solutions to learning text representations for natural language processing (NLP) and other tasks. Many NLP applications
Tilahun Yeshambel +2 more
doaj +1 more source
Socialized Word Embeddings [PDF]
Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017 Word embeddings have attracted a lot of attention. On social media, each user’s language use can be significantly affected by the user’s friends. In this paper, we propose a socialized word embedding algorithm which can consider both user’s personal characteristics of language use and the user’s social relationship on social media.
Ziqian Zeng +3 more
openaire +1 more source
CoRR, 2021 This work presents a novel methodology for calculating the phonetic similarity between words taking motivation from the human perception of sounds. This metric is employed to learn a continuous vector embedding space that groups similar sounding words together and can be used for various downstream computational phonology tasks.
Rahul Sharma +2 more
openaire +2 more sources