arXivDaily arXiv每日学术速递 周一至周五更新

期刊&会议

International Conference on Machine Learning · 会议 · Machine Learning

共收录 11797
2602.21204 2026-05-14 cs.LG cs.AI cs.CV

Test-Time Training with KV Binding Is Secretly Linear Attention

测试时训练与KV绑定实际上是秘密的线性注意力

Junchen Liu, Sven Elflein, Or Litany, Zan Gojcic, Ruilong Li

机构 * NVIDIA, Toronto, Ontario, Canada(NVIDIA,多伦多,安大略省,加拿大) University of Toronto, Toronto, Ontario, Canada(多伦多大学,多伦多,安大略省,加拿大) Vector Institute, Toronto, Ontario, Canada(向量研究所,多伦多,安大略省,加拿大) Technion -- Israel Institute of Technology, Haifa, Israel(技术ion -- 以色列理工学院,海法,以色列)

AI总结 本文揭示测试时训练与KV绑定实际上是学习的线性注意力,而非记忆,提出简化架构、并行计算和统一模型形式的改进方法。

Comments ICML 2026, Webpage: https://research.nvidia.com/labs/sil/projects/tttla/

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.13155 2026-05-14 cs.LG cs.DS cs.NE stat.ML

Learning to Approximate Uniform Facility Location via Graph Neural Networks

通过图神经网络学习近似统一设施选址

Chendi Qian, Christopher Morris, Stefanie Jegelka, Christian Sohler

机构 * RWTH Aachen University, Germany(亚琛工业大学,德国) Technical University of Munich, Germany(慕尼黑技术大学,德国) Massachusetts Institute of Technology, USA(麻省理工学院,美国) University of Cologne, Germany(科隆大学,德国)

AI总结 本文提出一种可微的图神经网络,结合近似算法原理,在无需求解器监督或离散松弛的情况下,提供可证明的近似保证,并在实践中优于传统近似算法,缩小与整数线性规划的差距。

Comments ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.12026 2026-05-14 cs.LG q-bio.QM

Protein Circuit Tracing via Cross-layer Transcoders

通过跨层转编码器进行蛋白质电路追踪

Darin Tsui, Kunal Talreja, Daniel Saeedi, Amirali Aghazadeh

机构 * School of Electrical Computer Engineering, Georgia Institute of Technology, Atltanta, GA

AI总结 本文提出ProtoMech框架,利用跨层转编码器发现蛋白质语言模型中的计算电路,实现高精度蛋白质设计。

Comments Accepted into ICML 2026. 32 pages, 17 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.02001 2026-05-14 cs.LG cs.AI

Preserve-Then-Quantize: Balancing Rank Budgets for Quantization Error Reconstruction in LLMs

在量化误差重建中平衡秩预算:用于大语言模型的秩预算平衡

Yoonjun Cho, Dongjae Jeon, Soeun Kim, Moongyu Jeon, Albert No

机构 * Department of Computer Science, Yonsei University(延世大学计算机科学系) Department of Artificial Intelligence, Yonsei University(延世大学人工智能系)

AI总结 本文提出SRR框架,通过在量化前保留激活缩放权重的前k个奇异子空间,仅量化残差,并利用剩余秩r-k进行误差重建,从而在秩约束下平衡量化暴露能量和不可恢复误差,提升PTQ精度。

Comments Accepted at ICML 2026. Project page: https://ai-isl.github.io/srr

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.22816 2026-05-14 cs.LG stat.ML

Cascaded Flow Matching for Heterogeneous Tabular Data with Mixed-Type Features

级联流匹配用于异质表格数据的混合类型特征

Markus Mueller, Kathrin Gruber, Dennis Fok

机构 * Econometric Institute, Erasmus University Rotterdam, Rotterdam, The Netherlands(荷兰埃因霍温鲁特兰大学经济研究所)

AI总结 本文提出级联流匹配方法,用于生成混合类型特征的表格数据,通过低分辨率和高分辨率的结合,提升生成质量与分布细节的准确性。

Comments published at ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2601.22409 2026-05-14 cs.LG cs.AI stat.ML

Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks

优化、泛化与梯度下降在科莫戈洛夫-阿诺尔德网络中的差分隐私界限

Puyu Wang, Junyu Zhou, Philipp Liznerski, Marius Kloft

机构 * RPTU Kaiserslautern-Landau(凯斯布鲁克-兰道大学)

AI总结 本文研究了梯度下降在两层科莫戈洛夫-阿诺尔德网络中的优化、泛化及差分隐私性质,推导出泛化界限,并在逻辑损失下证明了多项对数宽度足以实现优化和泛化速率,同时揭示了差分隐私下宽度的必要性。

Comments 42 pages, 3 figures

Journal ref ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.10642 2026-05-14 cs.RO cs.AI

UniJEPA: Enhancing Robot Policy via Unified Continuous and Discrete Representation Learning

UniJEPA:通过统一的连续和离散表示学习增强机器人策略

Jianke Zhang, Yucheng Hu, Yanjiang Guo, Xiaoyu Chen, Yichen Liu, Wenna Chen, Chaochao Lu, Jianyu Chen

机构 * Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China.(清华大学交叉信息研究院) Shanghai Qi Zhi Institute, Shanghai, China(上海启智研究院) Peking University, Beijing, China(北京大学) Shanghai AI Lab, Shanghai, China(上海人工智能实验室)

AI总结 本文提出UniJEPA,通过大规模预训练学习高维视觉特征,结合理解、规划和连续未来表示学习,提升机器人在开放环境中的任务执行能力。

Journal ref ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.03167 2026-05-14 cs.CL cs.AI cs.LG

Where Do Reasoning Models Refuse?

推理模型拒绝发生在何处?

Kureha Yamaguchi, Benjamin Etheridge, Andy Arditi

机构 * The Alan Turing Institute(艾伦·图灵研究所) University of Oxford(牛津大学) Northeastern University(东北大学)

AI总结 研究探讨推理模型在生成响应前拒绝决策的位置,发现推理链中的初始句子对拒绝决定有显著影响,并通过激活方向分析揭示了拒绝机制。

Comments v1 accepted to the ICML 2025 Workshop on Reliable and Responsible Foundation Models (R2FM). 20 pages, 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.11556 2026-05-14 cs.CL cs.AI cs.MA

Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs

多智能体大语言模型中分布式信息下的集体推理系统性失效

Yuxuan Li, Aoi Naito, Hirokazu Shirado

机构 * School of Computer Science, Carnegie Mellon University, Pittsburgh, USA(计算机科学学院,卡内基梅隆大学,匹兹堡,美国) School of Environment and Society, Institute of Science Tokyo, Tokyo, Japan(环境与社会学院,东京科学研究所,东京,日本)

AI总结 研究发现多智能体大语言模型在分布式信息下仅能获得30.1%的准确率,而单智能体在完整信息下可达80.7%。系统性失效源于智能体无法识别和应对潜在的信息不对称,导致关键分布式事实未被探索。通过轻量级结构化通信协议可显著提升集体推理能力。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.14375 2026-05-14 cs.LG cs.CL

Causal Fine-Tuning under Latent Confounded Shift

潜在混杂偏移下的因果微调

Jialin Yu, Yuxiang Zhou, Haoxuan Li, Junchi Yu, Mengyue Yang, Yulan He, Nevin L. Zhang, Philip Torr, Ricardo Silva

机构 * University of Oxford, United Kingdom(牛津大学) Queen Mary University of London, United Kingdom(伦敦玛丽女王大学) Peking University, China(北京大学) University of Bristol, United Kingdom(布里斯托大学) King's College London, United Kingdom(伦敦国王学院) Hong Kong University of Science(香港科学大学) University College London, United Kingdom(伦敦大学学院)

AI总结 本文提出Causal Fine-Tuning方法,通过结构因果模型分解表示为稳定高层和敏感低层成分,提升模型在存在潜在混杂偏移时的鲁棒性,实验显示优于其他基线方法。

Comments ICML 2026 Camera Ready Version

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12571 2026-05-14 cs.CV cs.AI

VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority

VideoSEAL: 通过解耦答案权威性来缓解代理长视频理解中的证据错位

Chenhao Qiu, Yechao Zhang, Xin Luo, Shien Song, Xusheng Liu

机构 * Nanyang Technological University, Singapore(南洋理工大学,新加坡)

AI总结 本文提出VideoSEAL框架,通过解耦规划与答案权威性,解决长视频理解中证据错位问题,提升回答准确性和证据对齐度,实验结果显示在多个基准上表现优异。

Comments Accepted to ICML 2026. 33 pages, 13 figures. Code and models are available at https://github.com/Echochef/VideoSEAL

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12494 2026-05-13 cs.CV

Revisiting Photometric Ambiguity for Accurate Gaussian-Splatting Surface Reconstruction

重新审视光度歧义以实现高精度高斯-散射表面重建

Jiahe Li, Jiawei Zhang, Xiao Bai, Jin Zheng, Xiaohan Yu, Lin Gu, Gim Hee Lee

机构 * School of Computer Science Engineering, State Key Laboratory of Complex Critical \& Software Environment, Jiangxi Research Institute, Beihang University State Key Laboratory of Virtual Reality Technology Macquarie University Tohoku University School of Computing, National University of Singapore

AI总结 本文提出AmbiSuR框架,通过高斯散射内在解决方案解决光度歧义问题,提升3D表面重建性能,实验显示在多种挑战场景中表现优异。

Comments Accepted at ICML 2026. Project page: https://fictionarry.github.io/AmbiSuR-Proj/

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12389 2026-05-13 cs.CV cs.AI cs.LG

SEMIR: Semantic Minor-Induced Representation Learning on Graphs for Visual Segmentation

SEMIR: 图上语义少数诱导表示学习用于视觉分割

Luke James Miller, Yugyung Lee

机构 * Department of Computing, Analytics(计算、分析与数学系) University of Missouri-Kansas City, Kansas City, United States(密苏里大学-堪萨斯城分校)

AI总结 SEMIR通过学习拓扑保持的潜在图表示,解决大规模图像中小结构分割中的计算限制和类别不平衡问题,提升边界证据的准确性。

Comments 20 pages, 3 figures. Accepted at ICML 2026. Includes appendices

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12258 2026-05-13 cs.LG

Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models

指令透镜分数:您的指令为多模态大语言模型提供了一个强大的对象幻觉检测器

Runhe Lai, Xinhua Lu, Yanqi Wu, Jinlun Ye, Weijiang Yu, Ruixuan Wang

机构 * School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China(中山大学计算机科学与工程学院,广州,中国) Peng Cheng Laboratory, Shenzhen, China(鹏城实验室,深圳,中国) Key Laboratory of Machine Intelligence and Advanced Computing, MOE, Guangzhou, China(机器智能与高级计算关键实验室,教育部,广州,中国)

AI总结 本文提出InsLen,通过结合校准局部分数和上下文一致性分数,有效检测多模态大语言模型中的对象幻觉,无需额外训练或辅助模型。

Comments Accepted by ICML-2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12167 2026-05-13 cs.RO cs.CV

From Imagined Futures to Executable Actions: Mixture of Latent Actions for Robot Manipulation

从想象的未来到可执行的动作:用于机器人操作的潜在动作混合

Yajie Li, Bozhou Zhang, Chun Gu, Zipei Ma, Jiahui Zhang, Jiankang Deng, Xiatian Zhu, Li Zhang

机构 * School of Data Science, Fudan University(复旦大学数据科学学院) Shanghai Innovation Institute(上海创新研究院) Imperial College London(伦敦帝国理工学院) University of Surrey(萨里大学)

AI总结 本文提出MoLA,一种面向控制的接口,将想象的未来视频转化为可执行的表示,通过混合预训练的逆动力学模型,提升机器人操作的稳定性和通用性。

Comments ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.12046 2026-05-13 quant-ph cs.AI cs.LG

Rethink the Role of Neural Decoders in Quantum Error Correction

重新审视神经解码器在量子错误校正中的作用

Ge Yan, Shanchuan Li, Yuxuan Du

机构 * College of Computing Data Science, Nanyang Technological University, Singapore 639798, Singapore Department of Electrical Engineering Computer Science, Tokyo University of Agriculture \& Technology, Koganei, Tokyo, 184-8588, Japan School of Physical Mathematical Sciences, Nanyang Technological University, Singapore 639798, Singapore

AI总结 本文研究了神经解码器在表面码解码中的应用,探讨了在准确性与延迟约束下,通过架构重设计和压缩管道提升FPGA部署性能的方法,揭示了数据规模、归纳偏置和INT4量化对解码性能的影响。

Comments Accepted to ICML 2026; 33 Pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.11931 2026-05-13 cs.CV

Learn to Think: Improving Multimodal Reasoning through Vision-Aware Self-Improvement Training

学会思考:通过视觉感知的自我改进训练提升多模态推理

Qihuang Zhong, Liang Ding, Wenjie Xuan, Juhua Liu, Bo Du, Dacheng Tao

机构 * School of Computer Science, National Engineering Research Center for Multimedia Software, Institute of Artificial Intelligence(计算机学院、多媒体软件国家工程研究中心、人工智能研究院) Hubei Key Laboratory of Multimedia(湖北多媒体重点实验室) Network Communication Engineering, Wuhan University, China(网络通信工程、武汉大学,中国) The University of Sydney, Australia(悉尼大学,澳大利亚) Nanyang Technological University, Singapore(南洋理工大学,新加坡)

AI总结 本文提出VISTA框架,通过视觉感知的自我改进训练提升多模态推理能力,解决数据不平衡和语言先验偏差问题,实验显示在多种训练场景下提升性能。

Comments Accepted by ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.11889 2026-05-13 cs.LG cs.AI

Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning

在贝叶斯学习中激励诚实与协作公平性

Rachael Hwee Ling Sim, Jue Fan, Xiao Tian, Xinyi Xu, Patrick Jaillet, Bryan Kian Hsiang Low

机构 * Department of Computer Science, National University of Singapore, Singapore(新加坡国立大学计算机科学系) Research (A STAR), Singapore(新加坡A*STAR研究) Department of Electrical Engineering(电气工程系) Computer Science, Massachusetts Institute of Technology, USA(美国麻省理工学院计算机科学系)

AI总结 本文提出首个确保协作公平与激励诚实的机制,结合公平性保障的半值和基于验证集的诚实数据估值函数,通过理论分析和实验证实其有效性。

Comments Accepted to the 43rd International Conference on Machine Learning (ICML-26) as a Spotlight paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.11864 2026-05-13 cs.IR cs.AI cs.CV cs.MM

Very Efficient Listwise Multimodal Reranking for Long Documents

非常高效的长文档多模态重排序方法

Yiqun Sun, Pengfei Wei, Lawrence B. Hsieh

机构 * Magellan Technology Research Institute (MTRI)(马杰拉技术研究院(MTRI))

AI总结 本文提出ZipRerank,通过轻量级查询-图像早期交互机制和单次前向传递消除自回归解码,实现高效多模态重排序,实验表明其在MMDocIR基准上性能优异且显著降低LLM推理延迟。

Comments To appear in ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.10684 2026-05-13 cs.LG cs.AI

Is Data Shapley Not Better than Random in Data Selection? Ask NASH

数据Shapley在数据选择中不如随机?请问NASH

Xiao Tian, Jue Fan, Rachael Hwee Ling Sim, Zixuan Wang, Nancy F. Chen, Bryan Kian Hsiang Low

机构 * Department of Computer Science, National University of Singapore, Singapore(新加坡国立大学计算机科学系) Research (A STAR), Singapore(新加坡科技研究局)

AI总结 本文提出NASH框架,通过分解目标函数并非线性聚合Shapley信息组件,提升数据选择效果,同时保持低运行成本。

Comments Accepted to the 43rd International Conference on Machine Learning (ICML-26) as a Spotlight paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.05680 2026-05-13 cs.CV

MotionGRPO: Overcoming Low Intra-Group Diversity in GRPO-Based Egocentric Motion Recovery

MotionGRPO: 克服基于GRPO的自主运动恢复中组内多样性低的问题

Nanjie Yao, Junlong Ren, Wenhao Shen, Hao Wang

机构 * The Hong Kong University of Science(香港科学与技术大学) Nanyang Technological University, Singapore(南洋理工大学)

AI总结 本文提出MotionGRPO框架,通过强化学习后训练注入细粒度指导,解决自主运动恢复中组内多样性低的问题,提升局部关节精度和全局视觉合理性。

Comments Accepted by ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2605.02973 2026-05-13 cs.LG cs.AI

Structured Diffusion Bridges: Inductive Bias for Denoising Diffusion Bridges

结构化扩散桥:去噪扩散桥的归纳偏置

Eitan Kosman, Gabriele Serussi, Chaim Baskin

机构 * Ben-Gurion University of the Negev(贝纳亚克大学)

AI总结 本文提出了一种扩散桥框架,通过对可行解空间的刻画和对齐约束限制,实现模态翻译任务,展示了在无配对、半配对和配对场景下的稳定性能,尤其在降低配对要求的同时保持高质量。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2604.14322 2026-05-13 stat.ML cs.LG

Doubly Outlier-Robust Online Infinite Hidden Markov Model

双重异常鲁棒在线无限隐马尔可夫模型

Horace Yiu, Leandro Sánchez-Betancourt, Álvaro Cartea, Gerardo Duran-Martin

机构 * Oxford-Man Institute of Quantitative Finance(牛津量化金融研究所) Mathematical Institute, University of Oxford(牛津大学数学研究所)

AI总结 本文提出BR-iHMM,通过引入两个可调参数平衡适应性与鲁棒性,在限价订单数据、小时电力需求和高维线性系统中,将一阶预测误差降低67%,并提供有界后验影响函数的理论保证。

Comments 43rd International Conference on Machine Learning (ICML 2026)

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.04476 2026-05-13 cs.CV

Vision-aligned Latent Reasoning for Multi-modal Large Language Model

多模态大语言模型中的视觉对齐潜在推理

Byungwoo Jeon, Yoonwoo Jeong, Hyunseok Lee, Minsu Cho, Jinwoo Shin

机构 * Byungwoo Jeon Yoonwoo Jeong Hyunseok Lee Minsu Cho Jinwoo Shin

AI总结 本文提出视觉对齐潜在推理框架,通过动态生成视觉对齐的潜在标记,提升多模态大语言模型在长上下文理解和精确视觉感知任务中的表现。

Comments Published as conference proceeding for ICML 2026. Last two authors advised equally

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.02406 2026-05-13 stat.ML cs.LG

Provably Data-driven Multiple Hyper-parameter Tuning with Structured Loss Function

可证明的数据驱动多超参数调优与结构化损失函数

Tung Quoc Le, Anh Tuan Nguyen, Viet Anh Nguyen

机构 * Université Grenoble Alpes, LJK, CNRS, Grenoble INP(格拉诺布尔大学,LJK,CNRS,格拉诺布尔INP) Carnegie Mellon University, Machine Learning Department(卡内基梅隆大学,机器学习系) Chinese University of Hong Kong, Department of Systems Engineering and Engineering Management(香港中文大学,系统工程与工程管理系)

AI总结 本文提出首个通用框架,为数据驱动环境下多维超参数调优提供泛化保证,结合实代数几何工具,改进了半代数函数类的泛化保证,并扩展至验证损失下的超参数调优,推导出更优的界。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.02282 2026-05-13 cs.LG

MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histology

MoLF:基于组织学的跨癌症空间基因表达预测的潜在流混合

Susu Hu, Stefanie Speidel

机构 * Translational Surgical Oncology, National Center for Tumor Diseases (NCT/UCC) Dresden, Germany Faculty of Medicine University Hospital Carl Gustav Carus, Dresden University of Technology German Cancer Research Center (DKFZ), Heidelberg, Germany

AI总结 MoLF通过条件流匹配目标,利用混合专家架构实现跨癌症组织基因表达预测,优于现有方法并在跨物种数据中表现出零样本泛化能力。

Comments Accepted at Proceedings 43rd International Conference on Machine Learning, Seoul, South Korea

Journal ref Proceedings 43rd International Conference on Machine Learning 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.00767 2026-05-13 cs.LG cs.AI

BLOCK-EM: Preventing Emergent Misalignment via Latent Blocking

BLOCK-EM:通过潜在阻塞防止对齐问题

Muhammed Ustaomeroglu, Guannan Qu

AI总结 本文提出BLOCK-EM方法,通过阻塞内部特征减少语言模型在微调中出现的对齐问题,实验显示在六个领域中阻塞固定特征可使对齐问题减少95%,且不影响模型质量与任务表现。

Comments Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2602.00297 2026-05-13 cs.LG

From Observations to States: Latent Time Series Forecasting

从观测到状态:潜在时间序列预测

Jie Yang, Yifan Hu, Yuante Li, Kexin Zhang, Kaize Ding, Philip S. Yu

机构 * University of Illinois Chicago(伊利诺伊大学芝加哥分校) Tsinghua University(清华大学) Carnegie Mellon University(卡内基梅隆大学) Northwestern University(西北大学)

AI总结 本文提出LatentTSF方法,通过将时间序列预测从观测回归转向潜在状态预测,解决潜在混沌问题,提升预测准确性和表示质量。

Comments Accepted at ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.03853 2026-05-13 cs.CV

UGround: Towards Unified Visual Grounding with Unrolled Transformers

UGround: 向统一视觉接地迈进的展开变换

Rui Qian, Xin Yin, Chuanhang Deng, Zhiyuan Peng, Jian Xiong, Wei Zhai, Dejing Dou

机构 * College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院) Zhejiang University(浙江大学)

AI总结 UGround通过引入Policy-Prompted Masking机制,动态选择展开变换层作为掩码提示,解决传统方法依赖固定最后一层和隐式投影的问题,统一了从传统参照表达分割到新提出的推理分割等多种视觉接地任务。

Comments This work has been accepted to ICML 2026, please refer to https://github.com/rui-qian/UGround

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.03206 2026-05-13 cs.AI cs.CL

Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner

连续离散扩散:使你的扩散语言模型成为潜在推理器

Cai Zhou, Chenxiao Yang, Yi Hu, Chenyu Wang, Chubin Zhang, Muhan Zhang, Lester Mackey, Tommi Jaakkola, Stephen Bates, Dinghuai Zhang

机构 * Massachusetts Institute of Technology(麻省理工学院) Microsoft Research(微软研究院) Toyota Technological Institute at Chicago(丰田技术研究所(芝加哥)) Peking University(北京大学) Tsinghua University(清华大学)

AI总结 本文提出CCDD模型,结合连续和离散空间,提升扩散语言模型的表达能力和训练效果,通过联合多模态扩散过程实现高质量的生成与推理。

Comments 29 pages. Accepted to ICML 2026

详情

展开后加载摘要…

URL PDF HTML 收藏