A hybrid Chinese word segmentation model for quality management-related texts based on transfer learning. [PDF]
PLoS ONE, 2022 Text information mining is a key step to data-driven automatic/semi-automatic quality management (QM). For Chinese texts, a word segmentation algorithm is necessary for pre-processing since there are no explicit marks to define word boundaries.
Peihan Wen, Linhan Feng, Tian Zhang
doaj +2 more sources
CWSXLNet: A Sentiment Analysis Model Based on Chinese Word Segmentation Information Enhancement
Applied Sciences, 2023 This paper proposed a method for improving the XLNet model to address the shortcomings of segmentation algorithm for processing Chinese language, such as long sub-word lengths, long word lists and incomplete word list coverage.
Shiqian Guo +4 more
doaj +3 more sources
A corpus of Chinese word segmentation agreement. [PDF]
Behav Res MethodsAbstract The absence of explicit word boundaries is a distinctive characteristic of Chinese script, setting it apart from most alphabetic scripts, leading to word boundary disagreement among readers. Previous studies have examined how this feature may influence reading performance. However, further investigations are required to generate more
Tsang YK, Yan M, Pan J, Chan MYK.
europepmc +3 more sources
The Influence of Contextual Predictability on Word Segmentation in Chinese Reading: An Eye-Tracking Study [PDF]
Behavioral SciencesWord segmentation is a fundamental component of lexical processing, and Chinese reading—lacking inter-word spacing—requires readers to identify word boundaries based on prior experience.
Mengchuan Song +3 more
doaj +2 more sources
The Impact of Color Cues on Word Segmentation by L2 Chinese Readers: Evidence from Eye Movements [PDF]
Behavioral SciencesChinese lacks explicit word boundary markers, creating frequent temporary segmental ambiguities where character sequences permit multiple plausible lexical analyses. Skilled native (L1) Chinese readers resolve these ambiguities efficiently.
Lin Li +3 more
doaj +2 more sources
The role of format familiarity and semantic transparency in Chinese reading: evidence from eye movements [PDF]
BMC PsychologyUnlike alphabetic language, Chinese is an ideographic language that does not contain spaces between words. Chinese readers must develop unique segmentation strategies for word recognition and reading comprehension.
Mingjing Chen +3 more
doaj +2 more sources
Hybrid Feature Fusion Learning Towards Chinese Chemical Literature Word Segmentation
IEEE Access, 2021 The rapid increase in the number of chemical science literature has brought challenges to researchers in search and data analysis. For many chemical scientific literature, extracting information from text and using knowledge is the focus of research ...
Xiang Li +4 more
doaj +1 more source
Do Chinese readers follow the national standard rules for word segmentation during reading? [PDF]
PLoS ONE, 2013 We conducted a preliminary study to examine whether Chinese readers' spontaneous word segmentation processing is consistent with the national standard rules of word segmentation based on the Contemporary Chinese language word segmentation specification ...
Ping-Ping Liu +3 more
doaj +1 more source
Systran's Chinese word segmentation [PDF]
Proceedings of the second SIGHAN workshop on Chinese language processing -, 2003 SYSTRAN's Chinese word segmentation is one important component of its Chinese-English machine translation system. The Chinese word segmentation module uses a rule-based approach, based on a large dictionary and fine-grained linguistic rules. It works on general-purpose texts from different Chinese-speaking regions, with comparable performance.
Jin Yang, Jean Senellart, Remi Zajac
openaire +1 more source
Short Text Matching Model Combined with Multi-Granularity Information and External Knowledge [PDF]
Jisuanji gongcheng, 2022 Chinese short text semantic matching generally uses word sequences, rather than character sequences, to achieve higher semantic-matching performance.However, Chinese word segmentation may be inaccurate or ambiguous, and word segmentation errors can ...
LIANG Dengyu, LIU Daming
doaj +1 more source