arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

期刊&会议

Annual Meeting of the Association for Computational Linguistics · 会议 · Natural Language Processing

2026-03-24 至 2026-03-24 共收录 2
2512.03989 2026-03-24 cs.CL

Teaching Old Tokenizers New Words: Efficient Tokenizer Adaptation for Pre-trained Models

为预训练模型教学旧分词器新词汇:高效的分词器适应方法

Taido Purason, Pavel Chizhov, Ivan P. Yamshchikov, Mark Fishel

机构 * Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所) CAIRO, Technical University of Applied Sciences Würzburg-Schweinfurt(魏玛-施维林应用技术大学)

AI总结 本文提出通过继续BPE训练扩展分词器词汇并引入基于叶节点的词汇剪枝,提升分词效率和词汇利用率,提供开放源代码工具。

Comments Accepted to Findings of EACL 2026

Journal ref Findings of the Association for Computational Linguistics: EACL 2026, pages 6492-6516

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.19217 2026-03-24 cs.CL

Modality Matching Matters: Calibrating Language Distances for Cross-Lingual Transfer in URIEL+

模态匹配至关重要:在URIEL+中校准语言距离以实现跨语言迁移

York Hay Ng, Aditya Khan, Xiang Lu, Matteo Salloum, Michael Zhou, Phuong H. Hoang, A. Seza Doğruöz, En-Shiun Annie Lee

机构 * University of Toronto, Canada(多伦多大学) University of Michigan, USA(密歇根大学) Harvard University, USA(哈佛大学) Carnegie Mellon University, USA(卡内基梅隆大学) LT3, IDLab, Universiteit Gent, Belgium(IDLab,根特大学) Ontario Tech University, Canada(安大略技术大学)

AI总结 本文提出一种类型匹配的语言距离框架,通过结构感知的表示方法提升跨语言迁移性能,特别是在任务相关距离类型下表现更优。

Comments Accepted to EACL 2026 SRW

Journal ref In Proceedings of EACL 2026 (Volume 4: Student Research Workshop), pages 110 to 130. ACL

详情

展开后加载摘要…

URL PDF HTML 收藏