Results 31 to 40 of about 27,036 (297)
A Japanese Word Segmentation Proposal [PDF]
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, 2019 Current Japanese word segmentation methods, that use a morpheme-based approach, may produce different segmentations for the same strings. This occurs when these strings appear in different sentences. The cause is the influence of different contexts around these strings affecting the probabilistic models used in segmentation algorithms.
Stalin Aguirre, Josafá Aguiar
openaire +1 more source
Bilingually motivated domain-adapted word segmentation for statistical machine translation [PDF]
, 2009 We introduce a word segmentation approach to languages where word boundaries are not orthographically marked, with application to Phrase-Based Statistical Machine Translation (PB-SMT).
Andy Way +3 more
core +1 more source
Word Segmentation for Burmese (Myanmar) [PDF]
ACM Transactions on Asian and Low-Resource Language Information Processing, 2016 Experiments on various word segmentation approaches for the Burmese language are conducted and discussed in this note. Specifically, dictionary-based, statistical, and machine learning approaches are tested. Experimental results demonstrate that statistical and machine learning approaches perform significantly better than dictionary-based approaches ...
Chenchen Ding +3 more
openaire +1 more source
Domain-Specific Chinese Word Segmentation Based on Bi-Directional Long-Short Term Memory Model
IEEE Access, 2019 Most of the current word segmentation methods are rule-based and traditional machine learning methods. Universal word segmentation tools do not work well in the field such as metallurgy. Domain-specific Chinese word segmentation is rarely studied.
Dangguo Shao +6 more
doaj +1 more source
Feature Extraction and Analysis of Natural Language Processing for Deep Learning English Language
IEEE Access, 2020 NLP (Natural Language Processing) is a technology that enables computers to understand human languages. Deep-level grammatical and semantic analysis usually uses words as the basic unit, and word segmentation is usually the primary task of NLP.
Dongyang Wang, Junli Su, Hongbin Yu
doaj +1 more source
An efficient, font independent word and character segmentation algorithm for printed Arabic text
Journal of King Saud University: Computer and Information Sciences, 2022 Characters segmentation is a necessity and the most critical stage in Arabic OCR system. It has attracted the interest of a wide range of researchers. However, the nature of the Arabic cursive script poses extra challenges that need further investigation.
Aziz Qaroush +5 more
doaj +1 more source
Segmenting Chinese Texts into Words for Semantic Network Analysis [PDF]
Journal of Contemporary Eastern Asia, 2017 Unlike most languages, written Chinese has no spaces between words. Word segmentation must be performed before semantic network analysis can be conducted.
James A. Danowski
doaj +1 more source
A Domain Feature Word Vector Description Method for Military Texts [PDF]
Jisuanji gongcheng, 2016 According to the large number of named entities and deep domain of feature words in military text information,this paper proposes a vector description method for domain feature words.It compresses the vector space through the optimization of word ...
QIN Jie,CAO Lei,PENG Hui,LAI Jun
doaj +1 more source
Systran's Chinese word segmentation [PDF]
Proceedings of the second SIGHAN workshop on Chinese language processing -, 2003 SYSTRAN's Chinese word segmentation is one important component of its Chinese-English machine translation system. The Chinese word segmentation module uses a rule-based approach, based on a large dictionary and fine-grained linguistic rules. It works on general-purpose texts from different Chinese-speaking regions, with comparable performance.
Jin Yang, Jean Senellart, Rémi Zajac
openaire +1 more source
A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing
Transactions of the Association for Computational Linguistics, 2020 Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined at the word-level.
Yan, Hang, Qiu, Xipeng, Huang, Xuanjing
doaj +1 more source