ESPnet3: Infrastructure for Scalable Speech and Audio Research in the Foundation Model Era
ESPnet3:基础模型时代可扩展语音与音频研究的基础设施
Masao Someki, Alexander Polok, Carlos Carvalho, Chyi-Jiunn Lin, Da-Hee Yang, Jiatong Shi, Jinchuan Tian, Nelson Enrique Yalta Soplin, Samuele Cornell, Siddhant Arora, Francisco Teixeira, Wei Wang, William Chen, Alberto Abad, Chenda Li, Shinji Watanabe, Wangyou Zhang
机构
*
Carnegie Mellon University(卡内基梅隆大学)
;
Brno University of Technology(布拉格技术大学)
;
Instituto Superior Técnico(技术高等研究院)
;
Hanyang University(翰阳大学)
;
Hitachi Astemo(日立阿美士多)
;
Shanghai Jiao Tong University(上海交通大学)
KEMO: Event-Driven Keyframe Memory for Long-Horizon Robot Manipulation with VLA Policies
KEMO: 面向长程机器人操作的VLA策略事件驱动关键帧记忆
Yihan Zeng, Minghao Ye, Yiyuan Chen, Yide Shentu, Philipp Wu, Zike Yan, Zhongyu Li
机构
*
Hong Kong Embodied AI Lab(香港具身智能实验室)
;
The Chinese University of Hong Kong(香港中文大学)
;
University of Electronic Science and Technology of China(电子科技大学)
;
Shanghai Jiao Tong University(上海交通大学)
LightSTAR: Efficient Visual Document Retrieval via Lightweight Selection with Vision-Adaptive Refinement
LightSTAR: 通过视觉自适应精炼的轻量级选择实现高效视觉文档检索
Tongkun Guan, Haocheng Wang, Wei Shen, Xiaokang Yang
机构
*
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学与工程学院人工智能研究院教育部人工智能重点实验室)
AdaReP:Adaptive Re-Planning under Model Mismatch for Neural World-Model Predictive Control
AdaReP:模型失配下的自适应重规划用于神经世界模型预测控制
Yutian Cheng, Xiaojian Ma, Xianhao Wang, Min Yang, Rongpeng Su, Hangxin Liu, Xi Chen, Shuai Li, Qing Li
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院)
;
University of Science and Technology of China(中国科学技术大学)
CommentsAccepted at ICANN 2026. This arXiv version contains supplementary materials and appendices that are omitted from the conference version due to space limitations
Physics-Guided Spatiotemporal State Space Modeling for Lookahead Molten Pool Segmentation in Laser Wire-Feed Welding
物理引导的时空状态空间建模用于激光送丝焊接中的前瞻熔池分割
Sen Li, Haichao Cui, Changhao Yin, Chendong Shao, Yaqi Wang, Xinhua Tang, Fenggui Lu
机构
*
Shanghai Key Laboratory of Materials Laser Processing and Modification, School of Materials Science and Engineering, Shanghai Jiao Tong University(上海交通大学材料科学与工程学院上海市激光制造与材料改性重点实验室)
Full-Body Golf Swing Kinematic Reconstruction From a Smartwatch IMU
基于智能手表IMU的全身高尔夫挥杆运动学重建
Yuanshuo Tan, Kezhe Zhu, Xiujie Sun, Chunping Liang, Shuoyang Zhu, Chenquan Xu, Licheng Zhong, Huiming Pan, Yinri Jin, Chang Liu, Bo Xiao, Shenglong Le, Bryndan W. Lindsey, Peter B. Shull
机构
*
State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University(上海交通大学机械与动力工程学院机械系统与振动国家重点实验室)
;
Key Laboratory for Power Machinery and Engineering of the Ministry of Education, Shanghai Jiao Tong University(上海交通大学动力机械与工程教育部重点实验室)
;
Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系)
;
School of Physical Education, Shanghai University of Sport(上海体育大学体育教育学院)
;
Department of Physical Education, Shanghai Jiao Tong University(上海交通大学体育系)
;
Department of Physical Therapy(物理治疗系)
Retrieval-Augmented Multimodal Learning for Enzyme-Substrate Interaction Prediction Under Low-Homology Shift
检索增强的多模态学习用于低同源性偏移下的酶-底物相互作用预测
Chen Liu, Bingxin Zhou, Xinyuan Wang, Ming Li, Guisheng Fan, Liang Hong
机构
*
School of Information Science and Engineering, East China University of Science and Technology(华东理工大学信息科学与工程学院)
;
Institute of Natural Sciences and Zhangjiang Institute for Advanced Study, Shanghai Jiao Tong University(上海交通大学自然科学研究院和张江高等研究院)
;
School of Life Sciences and Biotechnology, Shanghai Jiao Tong University(上海交通大学生命科学技术学院)
Learning Adaptive Dynamical Features via Multi-$τ$ Liquid-Mamba for All-in-one Image Restoration
学习自适应动态特征:用于全能图像恢复的多τ液态Mamba
Hu Gao, Changshuo Wang, Yulong Chen, Lizhuang Ma
机构
*
Department of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学与技术系)
;
Department of Architecture and Design, Harbin Institute of Technology(哈尔滨工业大学建筑与设计系)
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Xi’an Jiaotong University(西安交通大学)
;
Fudan University(复旦大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Zhejiang University(浙江大学)
;
East China Normal University(华东师范大学)
;
Tsinghua University(清华大学)
AI总结
提出MacAgentBench,包含676个跨25个应用的任务,采用规则评估和细粒度多检查点评分,实验表明最佳配置(OpenClaw上的Claude Opus 4.6)达到73.7% Pass@1,优势主要来自技能库而非框架设计。
Interest Entanglement: The Hidden Barrier to Blind Super-Resolution Optimization
兴趣纠缠:盲超分辨率优化的隐藏障碍
Junxiong Lin, Xinji Mai, Qianyu Guo, Haoran Wang, Zeng Tao, Xuan Tong, Ivy Pan, Wenqiang Zhang
机构
*
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院)
;
College of Computer Science and Artificial Intelligence, Fudan University(复旦大学计算机科学与人工智能学院)
;
The University of Hong Kong(香港大学)
;
Shanghai Institute of Virology, Shanghai Jiao Tong University School of Medicine(上海病毒研究所,同济大学医学院)
DeformX: A Versatile Co-Simulation Framework for Deformable Linear Objects
DeformX: 一种用于可变形线性物体的多功能协同仿真框架
Yi Yang, Xiang Fei, Lehong Wang, Chenhao Li, Zilin Dai, Henry Kou, Lu Li, Howie Choset
机构
*
The Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所)
;
Department of Mechanical Engineering, Carnegie Mellon University(卡内基梅隆大学机械工程系)
;
School of Ocean and Civil Engineering, Shanghai Jiao Tong University(上海交通大学海洋与土木工程学院)
;
Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院)
;
John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
AI总结
提出DeformX框架,集成Cosserat杆物理引擎与NVIDIA Isaac Sim,实现可变形线性物体的物理精确与视觉真实仿真,支持机器人学习,在真实线缆分割和绳索摆动任务中验证了仿真到现实的迁移能力。
A Stitch in Time Saves Nine: Preserving Policy Compatibility Under Perception Updates in End-to-End Autonomous Driving
小洞不补,大洞吃苦:端到端自动驾驶中感知更新下的策略兼容性保持
Yueyuan Li, Yifei Xiao, Mingyang Jiang, Xiang Zuo, Songan Zhang, Ming Yang
机构
*
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University(上海交通大学自动化与智能感知学院)
;
Key Laboratory of System Control and Information Processing, Ministry of Education of China(教育部系统控制与信息处理重点实验室)
;
School of Aeronautics and Astronautics, Shanghai Jiao Tong University(上海交通大学航空航天学院)
;
Global Institute of Future Technology, Shanghai Jiao Tong University(上海交通大学全球未来技术学院)
CommentsAccepted by ACM CCS 2026. Please cite this paper as "Tian Dong, Yan Meng, Shaofeng Li, Guoxing Chen, Yuling Chen, Zhen Liu, Haojin Zhu, Hao Chen. DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regeneration. In the Proceedings of ACM Conference on Computer and Communications Security (CCS 2026)."
Ultra-Fusion: A Resilient Tightly-Coupled Multi-Sensor Fusion SLAM Framework under Sensor Degradation and Spatiotemporal Perturbation for Intelligent Transportation Systems
机构
*
Shanghai Key Laboratory of Integrated Administration Technologies for Information Security, School of Computer Science, Shanghai Jiao Tong University(上海信息安全集成管理技术重点实验室,上海交通大学计算机科学学院)
;
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(深圳大学理学院,香港中文大学(深圳))