A hybrid Chinese word segmentation model for quality management-related texts based on transfer learning. [PDF]
Text information mining is a key step to data-driven automatic/semi-automatic quality management (QM). For Chinese texts, a word segmentation algorithm is necessary for pre-processing since there are no explicit marks to define word boundaries.
Peihan Wen, Linhan Feng, Tian Zhang
doaj +3 more sources
CWSXLNet: A Sentiment Analysis Model Based on Chinese Word Segmentation Information Enhancement
This paper proposed a method for improving the XLNet model to address the shortcomings of segmentation algorithm for processing Chinese language, such as long sub-word lengths, long word lists and incomplete word list coverage.
Shiqian Guo +4 more
doaj +4 more sources
A corpus of Chinese word segmentation agreement. [PDF]
Abstract The absence of explicit word boundaries is a distinctive characteristic of Chinese script, setting it apart from most alphabetic scripts, leading to word boundary disagreement among readers. Previous studies have examined how this feature may influence reading performance. However, further investigations are required to generate more
Tsang YK, Yan M, Pan J, Chan MYK.
europepmc +4 more sources
Unlike alphabet-based languages such as English, the Chinese language has no specifying word boundaries. Segmentation, particularly for the Chinese language, is a fundamental step towards Chinese text processing, information retrieval, and knowledge ...
Qinjun Qiu, Zhong Xie, Kai Ma, Miao Tian
doaj +2 more sources
The Influence of Contextual Predictability on Word Segmentation in Chinese Reading: An Eye-Tracking Study [PDF]
Word segmentation is a fundamental component of lexical processing, and Chinese reading—lacking inter-word spacing—requires readers to identify word boundaries based on prior experience.
Mengchuan Song +3 more
doaj +2 more sources
A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing [PDF]
Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined at the word-level.
Yan, Hang, Qiu, Xipeng, Huang, Xuanjing
doaj +2 more sources
Capsules Based Chinese Word Segmentation for Ancient Chinese Medical Books
Neural network models are popularly used in Chinese word segmentation task. The capsule architecture is proposed recently which has solved some defects of convolutional neural network. In this paper, we first introduce the capsule architecture to Chinese
Si Li +5 more
doaj +3 more sources
Punctuation as Implicit Annotations for Chinese Word Segmentation [PDF]
We present a Chinese word segmentation model learned from punctuation marks which are perfect word delimiters. The learning is aided by a manually segmented corpus. Our method is considerably more effective than previous methods in unknown word recognition. This is a step toward addressing one of the toughest problems in Chinese word segmentation.
Zhongguo Li, Maosong Sun
doaj +2 more sources
Multi-Task Joint Learning Model for Chinese Word Segmentation and Syndrome Differentiation in Traditional Chinese Medicine. [PDF]
Evidence-based treatment is the basis of traditional Chinese medicine (TCM), and the accurate differentiation of syndromes is important for treatment in this context. The automatic differentiation of syndromes of unstructured medical records requires two
Hu C, Zhang S, Gu T, Yan Z, Jiang J.
europepmc +2 more sources
A Data-Driven Model for Automated Chinese Word Segmentation and POS Tagging. [PDF]
Chinese natural language processing tasks often require the solution of Chinese word segmentation and POS tagging problems. Traditional Chinese word segmentation and POS tagging methods mainly use simple matching algorithms based on lexicons and rules ...
Xu Q, Wang Z.
europepmc +2 more sources

