VANE: Reliable Test-Time Training for Vision-Language-Action Models via Future Visual Representation Prediction
VANE:通过未来视觉表示预测实现视觉-语言-动作模型的可靠测试时训练
Hongjin Ji, Guoyang Xia, Luoyang Sun, Fangxiang Feng, Lei Ren
机构
*
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Beijing University of Posts and Telecommunications(北京邮电大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Li Auto Inc.(理想汽车)
Grounding Large Language Models as Generalizable Policies in Network Control
大语言模型作为网络优化的通用策略
Duo Wu, Linjia Kang, Zhimin Wang, Fangxin Wang, Wei Zhang, Chongbo Sun, Xuefeng Tao, Wei Yang, Le Zhang, Wenwu Zhu, Peng Cui, Zhi Wang
机构
*
Bytedance(字节跳动)
;
Shenzhen International Graduate School(深圳国际研究生院)
;
Tsinghua University(清华大学)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Department of Computer Science and Technology(计算机科学与技术系)
机构
*
Microsoft(微软公司)
;
Shanghai Jiao Tong University(上海交通大学)
;
Fudan University(复旦大学)
;
Nanjing University(南京大学)
;
Tsinghua University(清华大学)
;
The University of Hong Kong(香港大学)
;
Peking University(北京大学)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Donghua University(东华大学)
Yinghan Sun, Aoji Zhu, Xiang Ji, Yamei Li, Jiachi Zhao, Yun Wang, Li Zhang, Huijun Gao, Lidong Yang
机构
*
The Hong Kong Polytechnic University(香港理工大学)
;
The Chinese University of Hong Kong(香港中文大学)
;
Shenzhen Loop Area Institute(深圳河套学院)
;
Harbin Institute of Technology(哈尔滨工业大学)
机构
*
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
;
Center for Language, Intelligence and Machines, Shenzhen Loop Area Institute, Shenzhen(深圳环智中语言、智能与机器中心)
;
School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院)
Characterization of Gaussian Universality Breakdown in High-Dimensional Empirical Risk Minimization
高维经验风险最小化中高斯普适性破坏的表征
Chiheb Yaakoubi, Cosme Louart, Malik Tiomoko, Zhenyu Liao
机构
*
School of Data Science, The Chinese University of Hong Kong, Shenzhen, China
;
Huawei Noah's Ark Lab, Huawei Technologies, Paris, France
;
School of Electronic Information
;
Communications, Huazhong University of Science \& Technology, China
机构
*
University of California San Diego(加州大学圣地亚哥分校)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Peking University(北京大学)
;
University of California, Los Angeles(加州大学洛杉矶分校)
;
California Institute of Technology(加州理工学院)
;
ETH Zurich(苏黎世联邦理工学院)
机构
*
The Pennsylvania State University(宾夕法尼亚州立大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
University of California, Los Angeles(加州大学洛杉矶分校)
;
Rensselaer Polytechnic Institute(罗切斯特理工学院)
;
The Chinese University of Hong Kong(香港中文大学)
;
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
;
NEC Laboratories America(NEC美国实验室)
机构
*
The Chinese University of Hong Kong(香港中文大学)
;
Westlake University(西湖大学)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
CommentsAccepted by Transactions on Machine Learning Research. (32 pages, 12 figures.) This version refines the paper structure, adds experimental results. Project page: https://spherelab.ai/SGP-Gen/
机构
*
Shanghai Qi Zhi Institute(上海期智研究院)
;
Institute of Interdisciplinary Information Sciences, Tsinghua University(清华大学交叉信息研究院)
;
Xiongan AI Institute(雄安人工智能研究院)
;
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)
;
School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
;
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
East China Normal University(华东师范大学)
机构
*
South China University of Technology(南方科技大学)
;
StepFun
;
Institute of Automation Chinese Academy of Sciences(中国科学院自动化研究所)
;
Nanyang Technological University(南洋理工大学)
;
The Chinese University of Hong Kong(香港中文大学)
机构
*
The Hong Kong University of Science and Technology(香港科技大学)
;
University of Oxford(牛津大学)
;
The Chinese University of Hong Kong(香港中文大学)
;
City University of Hong Kong(香港城市大学)
;
Hainan Bielefeld University of Applied Sciences(海南比勒费尔德应用科学大学)
;
BrainGalaxy
机构
*
School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院)
;
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院)