Do Image-Text Metrics Respect Semantic Invariances?
图像-文本度量是否尊重语义不变性?
Amit Agarwal, Hitesh Laxmichand Patel, Meizhu Liu, Jyotika Singh, Karan Dua, Hansa Meghwani, Matthew Rowe, Michael Avendi, Yassi Abbasi, Tao Sheng, Sujith Ravi, Dan Roth
机构
*
Institute of Big Data Science and Industry(大数据科学与产业研究院)
;
Key Laboratory of Evolutionary Science Intelligence of Shanxi Province(山西省进化智能科学重点实验室)
;
School of Artificial Intelligence, Shanxi University(山西大学人工智能学院)
机构
*
1 Kalyani Government Engineering College, India. 2 IIIT Delhi, India. 3 BITS Pilani Hyderabad Campus, India. 4 University of South Carolina, USA. 5 IIIT Guwahati, India. 6 NIT Silchar, India. 7 San Jos\' e State University, USA. 8 UCLA, USA. 9 Washington State University, USA. 10 Vishwakarma Institute of Information Technology, India. 11 Gandhi Institute for Technological Advancement, India. 12 Meta AI, USA. 13 Amazon AI, USA. 14 BITS Pilani Goa, India.
MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
MMSI-Bench:多图像空间智能基准
Sihan Yang, Runsen Xu, Yiman Xie, Sizhe Yang, Mo Li, Jingli Lin, Chenming Zhu, Xiaochen Chen, Haodong Duan, Xiangyu Yue, Dahua Lin, Tai Wang, Jiangmiao Pang
机构
*
Shanghai AI Laboratory(上海人工智能实验室)
;
The Chinese University of Hong Kong(香港中文大学)
;
Zhejiang University(浙江大学)
;
Tsinghua University(清华大学)
;
Shanghai Jiaotong University(上海交通大学)
;
University of Hong Kong(香港大学)
;
Beijing Normal University(北京师范大学)
Context-driven Missing-Modality Learning for Robust Medical Diagnosis with Image-Tabular Data
基于上下文驱动的缺失模态学习用于图像-表格数据的鲁棒医学诊断
Tianling Liu, Lequan Yu, Tong Han, Liang Wan
机构
*
College of Intelligence and Computing, Tianjin University, Tianjin 300350, China.(智能与计算学院,天津大学,天津300350,中国)
;
Department of Statistics and Actuarial Science, School of Computing and Data Science, The University of Hong Kong, Hong Kong.(统计与精算系,计算与数据科学学院,香港大学,香港)
;
Department of Radiology, Tianjin Huanhu Hospital, Tianjin 300350, China.(放射科,天津华和医院,天津300350,中国)
;
Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin 300350, China.(天津脑血管与神经退行性疾病重点实验室,天津300350,中国)
;
Medical School of Tianjin University, Tianjin 300072, China.(天津大学医学院,天津300072,中国)
机构
*
School of Data Science, Fudan University, Shanghai, China(复旦大学数据科学学院)
;
Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China(复旦大学上海公共卫生临床中心放射科)
;
Department of Electrical and Computer Engineering, Northwestern University, Evanston, USA(西北大学电气与计算机工程系)
;
Shanghai Key Laboratory of Flexible Medical Robotics, Tongren Hospital, Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China(上海柔性医疗机器人重点实验室)
;
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学生物医学工程学院)
;
School of Computer Science, University of Nottingham, Nottingham, UK(诺丁汉大学计算机科学学院)
;
Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学生物医学工程学院医疗机器人研究所)
;
College of Computer Science and Technology, Huaqiao University, Xiamen, China(华侨大学计算机科学与技术学院)
;
School of Electronic Information (School of Artificial Intelligence), Northwest University, Xi'an, China(西北大学电子信息学院(人工智能学院))
;
Department of Mechanical Engineering, University College London, London, UK(伦敦大学学院机械工程系)
;
Institute of Neuroscience and Cardiovascular Research, University of Edinburgh, Edinburgh, UK(爱丁堡大学神经科学与心血管研究学院)
;
CAS Center for Excellence in Nanoscience, National Center for Nanoscience and Technology, Beijing, China(中国科学院纳米科学卓越中心)
;
School of Control Science and Engineering, Shandong University, Jinan, China(山东大学控制科学与工程学院)
;
School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, Birmingham, UK(伯明翰大学工程学院)
机构
*
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Comments12 experiments, 11,000+ training epochs, cross-modal validation (vision + language). Extended version of the Claude-in-the-Loop ecology framework
机构
*
Artificial Intelligence Research Center, National Institute of Advanced Industrial Science and Technology (AIST)(日本国家先进工业科学技术研究院人工智能研究中心)
;
CNRS-AIST JRL (Joint Robotics Laboratory), IRL(法国国家科学研究中心与日本AIST联合机器人实验室)
;
Institute for AI and Robotics, Future Robotics Organization, Waseda University(早稻田大学未来机器人组织人工智能与机器人研究所)
;
AI Robot Association (AIRoA)(人工智能机器人协会)
机构
*
Harbin Institute of Technology, Shenzhen, China(哈尔滨工业大学(深圳))
;
Pengcheng Laboratory, China(鹏城实验室)
;
The University of Queensland, Australia(昆士兰大学)