[PDF][PDF] Segmenting Sentences into Linky Strings using D-bigram statistics

S Nobesawa, J Tsutsumi, S Da Jiang…�- …�1996 Volume 2: The�…, 1996 - aclanthology.org
S Nobesawa, J Tsutsumi, S Da Jiang, T Sano, K Sato, M Nakanishi
COLING 1996 Volume 2: The 16th International Conference on�…, 1996aclanthology.org
It is obvious that segmentation takes an important role in natural language processing
(NLP), especially for the languages whose sentences are not easily separated into
morphemes. In this study we propose a method of segmenting a sentence. The system
described in this paper does not use any grammatical information or knowledge in
processing. Instead, it uses statistical information drawn from non-tagged corpus of the
target language. Most of the segmenting systems are to pick out conventional morphemes�…
Abstract
It is obvious that segmentation takes an important role in natural language processing (NLP), especially for the languages whose sentences are not easily separated into morphemes. In this study we propose a method of segmenting a sentence. The system described in this paper does not use any grammatical information or knowledge in processing. Instead, it uses statistical information drawn from non-tagged corpus of the target language. Most of the segmenting systems are to pick out conventional morphemes which is defined for human use. However, we still do not know whether those conventional morphemes are good units for computational processing.
aclanthology.org
Showing the best result for this search. See all results