Seeing the Forest and the Trees: Query-Aware Tokenizer for Long-Video Multimodal Language Models
看清森林与树木:面向长视频多模态语言模型的查询感知分词器
Siyou Li, Huanan Wu, Juexi Shao, Yinghao Ma, Yujian Gan, Yihao Luo, Yuwei Wang, Dong Nie, Lu Wang, Wenqing Wu, Le Zhang, Massimo Poesio, Juntao Yu
机构
*
Queen Mary University of London(伦敦女王学院)
;
University of Sheffield(谢菲尔德大学)
;
Imperial College London(伦敦帝国学院)
;
Pengcheng Laboratory(鹏城实验室)
;
Meta Inc(Meta公司)
;
Meituan Inc(美团公司)
;
Nanjing University of Science(南京理工大学)
;
University of Birmingham(伯明翰大学)
;
Utrecht University(乌得勒支大学)
机构
*
School of Mathematical Sciences, Peking University(北京大学数学科学学院)
;
Center for Machine Learning Research, Peking University(北京大学机器学习研究中心)
;
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院)
;
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(中国科学技术大学认知智能国家重点实验室)
;
Meituan, Beijing(美团(北京))
;
AI for Science Institute, Beijing(北京人工智能科学研究院)
机构
*
Shenzhen Technology University(深圳技术大学)
;
Shenzhen University of Information Technology(深圳信息科技学院)
;
University of Washington(华盛顿大学)
;
Foundation Model Team, Meituan(美团基础模型团队)
;
National University of Singapore(新加坡国立大学)
;
Tongji University(同济大学)
VerifyBench: Benchmarking Reference-based Reward Systems for Large Language Models
VerifyBench: 大型语言模型参考式奖励系统的基准测试
Yuchen Yan, Jin Jiang, Zhenbang Ren, Yijun Li, Xudong Cai, Yang Liu, Xin Xu, Mengdi Zhang, Jian Shao, Yongliang Shen, Jun Xiao, Yueting Zhuang
机构
*
Zhejiang University(浙江大学)
;
Meituan Group(美团集团)
;
Peking University(北京大学)
;
University of Electronic Science and Technology of China(电子科技大学)
;
The Hong Kong University of Science and Technology(香港科技大学)
Expanding Reasoning Potential in Foundation Model by Learning Diverse Chains of Thought Patterns
通过学习多样的思维链模式扩展基础模型的推理潜力
Xuemiao Zhang, Can Ren, Chengying Tu, Rongxiang Weng, Shuo Wang, Hongfei Yan, Jingang Wang, Xunliang Cai
机构
*
School of Computer Science, Peking University(北京大学计算机科学系)
;
Meituan(美团)
;
State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室)
EAGLE: Elevating Geometric Reasoning through LLM-empowered Visual Instruction Tuning
通过LLM赋能的视觉指令微调提升几何推理能力
Zhihao Li, Yao Du, Yang Liu, Yan Zhang, Yufang Liu, Mengdi Zhang, Xunliang Cai, Charles Ling, Boyu Wang
机构
*
Department of Computer Science, Western University(计算机科学系,西部大学)
;
Meituan Inc.(美团公司)
;
Department of Automation, Tsinghua University(自动化系,清华大学)
;
School of Computer Science and Technology, East China Normal University(计算机科学与技术学院,东华大学)
Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
通过自适应视觉令牌缓存学习加速视觉-语言-动作模型
Yujie Wei, Jiahan Fan, Jiyu Guo, Ruichen Zhen, Rui Shao, Xiu Su, Zeke Xie, Shuo Yang
机构
*
Harbin Institute of Technology(哈尔滨工业大学)
;
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
;
Meituan Academy of Robotics Shenzhen, Meituan(美团机器人深圳研究院)
;
Central South University(中南大学)
;
HKUST(GZ)(香港科技大学(广州))
APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation
APEX:一种解耦的记忆型探索者用于异步空中目标导航
Daoxuan Zhang, Ping Chen, Xiaobo Xia, Xiu Su, Ruichen Zhen, Jianqiang Xiao, Shuo Yang
机构
*
Harbin Institute of Technology(哈尔滨工业大学)
;
National University of Singapore(新加坡国立大学)
;
Central South University(中南大学)
;
Meituan Academy of Robotics(美团机器人研究院)
Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning
一次注入,后期存活:向视觉-语言-动作模型注入后门以在下游微调中持续存在
Jianyi Zhou, Yujie Wei, Ruichen Zhen, Bo Zhao, Xiaobo Xia, Rui Shao, Xiu Su, Shuo Yang
机构
*
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Meituan Academy of Robotics Shenzhen, Meituan(美团机器人深圳研究院)
;
Shanghai Jiaotong University(上海交通大学)
;
National University of Singapore(新加坡国立大学)
;
Central South University(中南大学)
Metis-SPECS: Decoupling Multimodal Learning via Self-distilled Preference-based Cold Start
Metis-SPECS: 通过基于偏好自我蒸馏的冷启动解耦多模态学习
Kun Chen, Peng Shi, Haibo Qiu, Zhixiong Zeng, Siqi Yang, Wenji Mao, Lin Ma
机构
*
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所MAIS)
;
Meituan(美团)
机构
*
School of Computer Science and Engineering, Northeastern University, Shenyang, China(东北大学计算机科学与工程学院)
;
NiuTrans Research, Shenyang, China(NiuTrans研究)
;
CAS Key Laboratory of Behavioral Science, Institute of Psychology, CAS, Beijing, China(中国科学院行为科学重点实验室)
;
Meituan Inc.(美团公司)