What Makes LVLMs Hallucinate Less? Unveiling the Architectural Factors Behind Hallucination Robustness
什么使LVLMs更少产生幻觉?揭示影响幻觉鲁棒性的架构因素
Yusheng He, Jizhe Zhou, Xia Du, Zheng Lin, Jun Luo, Jiancheng Lv
机构
*
School of Computer Science, Engineering Research Center of Machine Learning and Industry Intelligence, Sichuan University(计算机科学学院,机器学习与产业智能工程研究中心,四川大学)
;
School of Computer and Information Engineering, Xiamen University of Technology(计算机与信息工程学院,厦门理工大学)
;
Department of Electrical and Computer Engineering, University of Hong Kong(电气与计算机工程系,香港大学)
;
College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学)
UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysis
UniMedVL: 通过观察-知识-分析统一医学多模态理解与生成
Junzhi Ning, Wei Li, Cheng Tang, Jiashi Lin, Chenglong Ma, Chaoyang Zhang, Jiyao Liu, Ying Chen, Shujian Gao, Yuandong Pu, Huihui Xu, Chenhui Gou, Ziyan Huang, Yi Xin, Qi Qin, Diping Song, Bin Fu, Guang Yang, Yuanfeng Ji, Tianbin Li, Yanzhou Su, Jin Ye, Shixiang Tang, Zhongying Deng, Lihao Liu, Ming Hu, Junjun He
机构
*
Shanghai Artificial Intelligence Laboratory
;
Shanghai Innovation Institute
;
Shanghai Jiao Tong University
;
Shanghai Institute of Optics
;
Fudan University
;
University of Cambridge
;
Monash University
;
DAMO Academy, Alibaba Group
;
Imperial College London
;
The University of Hong Kong
;
The Hong Kong University of Science
;
Hupan Lab
;
The Chinese University of Hong Kong
Cross-Modal Attention Calibration for LVLM Hallucination Mitigation
跨模态注意力校准用于LVLM幻觉缓解
Jiaming Li, Jiacheng Zhang, Zequn Jie, Lin Ma, Guanbin Li
机构
*
Sun Yat-sen University(中山大学)
;
The University of Hong Kong(香港大学)
;
Meituan(美团)
;
Inspur Database Technology(Inspur数据库技术)
;
Guilin University of Electronic Technology(桂林电子科技大学)
;
Shenzhen Loop Area Institute(深圳河套学院)
;
Guangdong Key Laboratory of Big Data Analysis and Processing(广东大数据分析与处理重点实验室)
机构
*
University of Chinese Academy of Sciences(中国科学院大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
Tsinghua University(清华大学)
;
Zhejiang University(浙江大学)
;
Beihang University(北京航空航天大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
The University of Hong Kong(香港大学)
Phase-Conditioned Imitation Learning with Autonomous Failure Recovery for Robust Deformable Object Manipulation
相位条件化模仿学习与自主故障恢复用于鲁棒可变形物体操作
Dayuan Chen, Kai Tang, Yukuan Zhang, Kazuhiro Kosuge, Yasuhisa Hirata
机构
*
Department of Robotics, Tohoku University(东大理学院机器人系)
;
JC STEM Lab of Robotics for Soft Materials, the Department of Electrical and Computer Engineering, Faculty of Engineering, The University of Hong Kong(香港大学工程学院电气与计算机工程系软材料机器人实验室)
机构
*
The University of Hong Kong(香港大学)
;
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信)
;
Huawei Cloud Computing Technologies(华为云计算技术)
;
Ola Dimensions
;
HKU Shanghai Intelligent Computing Research Center(香港大学上海智能计算研究中心)
Stochastic Gradient Descent with Momentum is Algorithmically Stable
带动量的随机梯度下降具有算法稳定性
Yunwen Lei, Zimeng Wang, Xiaoming Yuan
机构
*
Department of Mathematics, The University of Hong Kong(香港大学数学系)
;
Department of Mathematics and Mathematical Statistics, Umeå University(乌梅大学数学与统计学系)
Learning Theory of the SVRG: Generalization and Convergence Analysis
SVRG的学习理论:泛化与收敛性分析
Yunwen Lei, Zimeng Wang, Xiaoming Yuan
机构
*
Department of Mathematics, The University of Hong Kong(香港大学数学系)
;
Department of Mathematics and Mathematical Statistics, Umeå University(乌梅大学数学与统计学系)
Auditing medical multi-agent AI reveals risks of false consensus
审计医疗多智能体AI揭示虚假共识风险
Yinghao Zhu, Lei Gu, Zixiang Wang, Haoran Sang, Dehao Sui, Wen Tang, Lan Mi, Yasha Wang, Junyi Gao, Liang Yao, Tianfan Fu, Ewen Harrison, Lequan Yu, Liantao Ma
机构
*
National Engineering Research Center for Software Engineering, Peking University(北京大学软件工程国家工程研究中心)
;
School of Computing and Data Science, The University of Hong Kong(香港大学计算机与数据科学学院)
;
Department of Nephrology, Peking University Third Hospital(北京大学第三医院肾内科)
;
Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education), Department of Lymphoma, Peking University Cancer Hospital & Institute(教育部癌症发生与转化研究重点实验室、北京大学肿瘤医院淋巴瘤科)
;
Department of Automation, Tsinghua University(清华大学自动化系)
;
Centre for Medical Informatics, The University of Edinburgh(爱丁堡大学医学信息学中心)
;
Health Data Research UK(英国健康数据研究机构)
;
Lee Kong Chian School of Medicine, Nanyang Technological University(南洋理工大学李科贤医学院)
;
State Key Laboratory for Novel Software Technology, School of Computer Science, Nanjing University(南京大学新型软件技术国家重点实验室、计算机科学学院)
Causal Machine Learning: A Survey and Open Problems
因果机器学习:综述与开放问题
Jean Kaddour, Aengus Lynch, Qi Liu, Matt J. Kusner, Ricardo Silva
机构
*
AI Centre, Department of Computer Science, UCL(人工智能中心,计算机科学系,伦敦大学学院)
;
Department of Computer Science, University of Hong Kong(计算机科学系,香港大学)
;
AI Centre, Department of Statistical Science, UCL(人工智能中心,统计科学系,伦敦大学学院)
机构
*
Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong(香港大学牙科学院应用口腔科学与社区牙科护理系)
;
School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院)
;
School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院)
;
Department of Periodontology, Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山)牙周科)
;
Beijing Institute of Collaborative Innovation(北京协同创新研究院)
;
Department of Orthodontics, Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山)正畸科)
;
Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山))
;
College of Future Technology, Peking University(北京大学未来技术学院)
;
Freedom AI
;
New Cornerstone Science Laboratory, National Biomedical Imaging Center, State Key Laboratory of Membrane Biology, Institute of Molecular Medicine, Peking-Tsinghua Center for Life Sciences, College of Future Technology, Peking University, Beijing 100871, China(新基石科学实验室、国家生物医学成像中心、膜生物学国家重点实验室、分子医学研究院、北京大学未来技术学院、生命科学中心,北京大学,北京100871,中国)
;
IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China(IDG/ McGovern脑科学研究院,北京大学,北京100871,中国)
;
Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, The University of Hong Kong(香港大学牙科学院口腔颌面外科系)
;
Shenzhen Loop Area Institute(深圳河套学院)
;
Department of Cancer Biology, Mayo Clinic Arizona, 5777 E. Mayo Blvd., IERB-3-504A, Phoenix, Arizona, 85054, USA(梅奥诊所亚利桑那分部癌症生物学部门,5777 E. Mayo Blvd., IERB-3-504A, Phoenix, Arizona, 85054, USA)
;
Department of Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, LMU Munich, Munich, Germany(慕尼黑大学医院保守牙科、牙周病学和数字牙科部门,慕尼黑,德国,慕尼黑大学)
;
Division of Periodontology & Implant Dentistry, Faculty of Dentistry, The University of Hong Kong, Hong Kong, SAR, China(香港大学牙科学院牙周病学与种植牙科系,香港,中国)
机构
*
CloudRobo Lab, Huawei Cloud Computing Technologies Co.,Ltd.(华为云计算技术有限公司云机器人实验室)
;
Shanghai Jiao Tong University(上海交通大学)
;
The University of Hong Kong(香港大学)
ECHO-2: A Large-Scale Distributed Rollout Framework for Cost-Efficient Reinforcement Learning
ECHO-2: 一种面向经济高效强化学习的大规模分布式推演框架
Jingwei Song, Meng Chen, Jie Xiao, Qingnan Ren, Jiaqi Huang, Yangshen Deng, Chris Tong, Wanyi Chen, Suli Wang, Zhisheng Chen, Ziqian Bi, Shuo Lu, Yiqun Duan, Xu Wang, Rymon Yu, Lynn Ai, Eric Yang, Tianyu Shi
机构
*
The University of Hong Kong(香港大学)
;
Fudan University(复旦大学)
;
Gradient
;
University of Edinburgh(爱丁堡大学)
;
Soochow University(苏州大学)
;
Technical University of Darmstadt(达姆施塔特技术大学)
;
University of the Chinese Academy of Sciences(中国科学院大学)
机构
*
MMLab, The Chinese University of Hong Kong, Hong Kong SAR(香港理工大学MMLab,香港中文大学,香港特别行政区)
;
The Hong Kong University of Science(香港理工大学)
;
The University of Hong Kong(香港大学)
;
Tsinghua University(清华大学)
机构
*
Case Western Reserve University, Cleveland, OH, USA(凯斯西储大学)
;
Kean University, Union, NJ, USA(凯恩大学)
;
The Ohio State University, Columbus, OH, USA(俄亥俄州立大学)
;
Fudan University, Shanghai, China(复旦大学)
;
Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室)
;
The University of Hong Kong, Hong Kong, China(香港大学)
;
North Carolina State University, Raleigh, NC, USA(北卡罗来纳州立大学)