Results 251 to 260 of about 2,559,382 (283)
Some of the next articles are maybe not open access.
On the segmentation of Chinese incremental words.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 2021In the present article, we report two eye-tracking experiments on how Chinese readers segment incremental words while reading Chinese. Incremental words are multicharacter words containing a subset of characters that constitute another word (referred to as the embedded word).
Junyi Zhou, Xingshan Li
openaire +2 more sources
Self-Supervised Chinese Word Segmentation
2001We propose a new unsupervised training method for acquiring probability models that accurately segment Chinese character sequences into words. By constructing a core lexicon to guide unsupervised word learning, self-supervised segmentation overcomes the local maxima problems that hamper standard EM training.
Fuchun Peng, Dale Schuurmans
openaire +2 more sources
Chinese Word Segmentation with Character Abstraction
2013Chinese word segmentation is an important and necessary problem to analyze Chinese texts. In this paper, we focus on the primary challenges in Chinese word segmentation: low accuracy of out-of-vocabulary word. To resolve this difficult problems, we group the “similar” characters to generate more abstract representation.
Le Tian 0003 +2 more
openaire +1 more source
Survey on Chinese Word Segmentation
2023 4th International Conference on Machine Learning and Computer Application, 2023Ying Liu 0060 +3 more
openaire +1 more source
A Study of Chinese Word Segmentation Based on the Characteristics of Chinese
2013This paper introduces the research on Chinese word segmentation (CWS). The word segmentation of Chinese expressions is difficult due to the fact that there is no word boundary in Chinese expressions and that there are some kinds of ambiguities that could result in different segmentations.
Aaron Li-Feng Han +5 more
openaire +2 more sources
Study on the Influencing Factors of Chinese Word Segmentation
2012 International Conference on Asian Language Processing, 2012Out-of-vocabulary words (OOV) and ambiguity are two important issues for Chinese word segmentation (CWS). In previous studies, the measurement of OOV has been clearly stated, while the measurement of ambiguity requires further clarification. This paper puts forward the concept and calculation method of latent ambiguity (LA), analyzes the relation and ...
Chi Xiu, Rou Song
openaire +2 more sources
Bigram Chinese Word Segmentation by Viterbi Algorithm
2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery, 2009Chinese word segmentation is an important foundation for Chinese information processing. This paper proposes a new Chinese word segmentation model based on Bayesian network. In this model, Character alignment Viterbi algorithm, which treats the preceding word of each Chinese character as its state, and the N-gram probability as its state transition ...
Dan Liu, Weiguo Fang, Hong Zhou, Yan Li
openaire +1 more source
Chinese Word Segmentation Based on Deep Learning
Proceedings of the 2018 10th International Conference on Machine Learning and Computing, 2018Chinese word segmentation is a fundamental task in the field of Chinese Natural Language Processing. In this paper, we propose a series of neural network architectures by combining Long Short-Term Memory Neural Network (LSTM) with Conditional Random Field (CRF).
Mengge Wang +4 more
openaire +2 more sources
Comparisons of Features for Chinese Word Segmentation
2018Machine learning based approach is the most important one among Chinese word segmentation, and feature selection is very crucial to it. This paper overviews feature sets used in a few machine learning based approaches for Chinese word segmentation closed task.
openaire +1 more source
A Word Segmentation Method of Ancient Chinese Based on Word Alignment
2019Since there are no public tagged corpora available for ancient Chinese word segmentation (CWS), the state-of-the-art CWS methods cannot be used for ancient Chinese. To address this problem, this paper proposes a word segmentation method based on word alignment (WSWA).
Chao Che +4 more
openaire +1 more source