Results 11 to 20 of about 319,970 (293)
How Multilingual is Multilingual BERT? [PDF]
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019 In this paper, we show that Multilingual BERT (M-BERT), released by Devlin et al. (2018) as a single language model pre-trained from monolingual corpora in 104 languages, is surprisingly good at zero-shot cross-lingual model transfer, in which task-specific annotations in one language are used to fine-tune the model for evaluation in another language ...
Telmo Pires, Eva Schlinger, Dan Garrette
openaire +2 more sources
Multilingual Agreement for Multilingual Neural Machine Translation [PDF]
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), 2021 Although multilingual neural machine translation (MNMT) enables multiple language translations, the training process is based on independent multilingual objectives. Most multilingual models can not explicitly exploit different language pairs to assist each other, ignoring the relationships among them.
Jian Yang 0030 +6 more
openaire +1 more source
A Study of Speech Recognition for Kazakh Based on Unsupervised Pre-Training
Sensors, 2023 Building a good speech recognition system usually requires a lot of pairing data, which poses a big challenge for low-resource languages, such as Kazakh.
Weijing Meng, Nurmemet Yolwas
doaj +1 more source
Massively Multilingual Lexical Specialization of Multilingual Transformers
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023 Accepted in ACL ...
Green, Tommaso +2 more
openaire +3 more sources
JSUM: A Multitask Learning Speech Recognition Model for Jointly Supervised and Unsupervised Learning
Applied Sciences, 2023 In recent years, the end-to-end speech recognition model has emerged as a popular alternative to the traditional Deep Neural Network—Hidden Markov Model (DNN-HMM).
Nurmemet Yolwas, Weijing Meng
doaj +1 more source
Pairwise networks for feature ranking of a geomagnetic storm model
South African Computer Journal, 2020 Feedforward neural networks provide the basis for complex regression models that produce accurate predictions in a variety of applications. However, they generally do not explicitly provide any information about the utility of each of the input ...
Jacques Beukes +2 more
doaj +1 more source
Enduring musician advantage among former musicians in prosodic pitch perception
Scientific Reports, 2023 Musical training has been associated with various cognitive benefits, one of which is enhanced speech perception. However, most findings have been based on musicians taking part in ongoing music lessons and practice.
Xin Ru Toh +4 more
doaj +1 more source
IEEE Access, 2023 In recent years, with the development of deep learning, research on end-to-end mispronunciation detection and diagnosis(MDD) methods has been further promoted.
Shen Guo +4 more
doaj +1 more source
Ethnicity and Tone Production on Singlish Particles
Languages, 2022 Recent research on Singlish, also known as Colloquial Singapore English, suggests that it is subject to ethnic variation across the three major ethnic groups in Singapore, namely Chinese, Malay, and Indian. Discourse particles, said to be one of the most
Ying Qi Soh, Junwen Lee, Ying-Ying Tan
doaj +1 more source
Benign interpolation of noise in deep learning
South African Computer Journal, 2020 The understanding of generalisation in machine learning is in a state of flux, in part due to the ability of deep learning models to interpolate noisy training data and still perform appropriately on out-of-sample data, thereby contradicting long-held ...
Marthinus Wilhelmus Theunissen +2 more
doaj +1 more source