每天早上一封邮件,把昨天的 AI 梳理好订阅邮件

METAL LAB

Tangut Word Segmentation under Extreme Resource Scarcity: Integrating Traditional Lexicons and Unlabeled Text

arXiv:2608.184372026-08-20

Tangut is an extinct language whose script does not explicitly mark word boundaries. We present the first systematic study of Tangut word segmentation using 2,750 expert-annotated segments(31,893 tokens), traditional lexicons, and unlabeled text. Our framework combines a reliability-calibrated lexicon-lattice representation, explicit distributional statistics, and a lightweight character encoder pretrained with MLM. Segment-level five-fold cross-va

作者 · Lifan Deng, Yongwei Zhang, Sen Sun, Bojun Sun, Jingsong Yu

在 arXiv 阅读

最新论文

全部论文 →

METAL LAB 最新报道