Multimodal Reasoning with LLM for Encrypted Traffic Interpretation: A Benchmark
基于LLM的多模态推理用于加密流量解释:一个基准
Longgang Zhang, Xiaowei Fu, Fuxiang Huang, Lei Zhang
机构
*
School of Microelectronics and Communication Engineering, Chongqing University(重庆大学微电子与通信工程学院)
;
School of Data Science, Lingnan University(岭南大学数据科学学院)
机构
*
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院)
;
Zhejiang University(浙江大学)
Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation
让 MLLMs 失明:MLLM 内容审核中的对抗走私攻击
Zhiheng Li, Zongyang Ma, Yuntong Pan, Ziqi Zhang, Xiaolei Lv, Bo Li, Jun Gao, Jianing Zhang, Chunfeng Yuan, Bing Li, Weiming Hu
机构
*
State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(中国科学院自动化研究所多模态人工智能系统国家重点实验室)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information(北京市多模态信息超智能安全重点实验室)
;
Hellogroup
;
University of Washington(华盛顿大学)
;
Jilin University(吉林大学)
;
ShanghaiTech University(上海科技大学)
GIRL: Generative Imagination Reinforcement Learning via Information-Theoretic Hallucination Control
GIRL:通过信息论幻觉控制实现生成性想象强化学习
Prakul Sunil Hiremath
机构
*
Department of Computer Science and Engineering, Visvesvaraya Technological University (VTU), Belagavi, India(维斯瓦拉亚科技大学计算机科学与工程系,贝拉加维,印度)
;
Aliens on Earth (AoE) Autonomous Research Group, Belagavi, India(地球外星人自主研究组,贝拉加维,印度)
机构
*
New York University(纽约大学)
;
New York University Abu Dhabi(纽约大学阿布扎比分校)
;
Indian Institute of Technology Kanpur(印度理工学院坎普尔分校)
;
International Institute of Information Technology Hyderabad(国际信息技术学院海得拉巴分校)
机构
*
Tsinghua University(清华大学)
;
Sun Yat-sen University(中山大学)
;
Independent Researcher(独立研究员)
;
The Hong Kong Polytechnic University(香港理工大学)
;
Guangdong Laboratory of AI and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳))
;
University of Illinois Chicago(伊利诺伊大学芝加哥分校)
机构
*
Kyoto University(京都大学)
;
Center for Information and Neural Networks(信息与神经网络中心)
;
National Institute of Information and Communications Technology(国立信息通信技术研究所)
;
The University of Osaka(大阪大学)
机构
*
State Key Laboratory of Complex System Modeling and Simulation Technology(复杂系统建模与仿真技术国家重点实验室)
;
Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所综合信息系统技术国家级重点实验室)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Nanyang Technological University(南洋理工大学)
;
Beijing Forestry University(北京林业大学)
Seyed Amir Ahmad Safavi-Naini, Shuhaib Ali, Omer Shahab, Zahra Shahhoseini, Thomas Savage, Sara Rafiee, Jamil S Samaan, Reem Al Shabeeb, Farah Ladak, Jamie O Yang, Juan Echavarria, Sumbal Babar, Aasma Shaukat, Samuel Margolis, Nicholas P Tatonetti, Girish Nadkarni, Bara El Kurdi, Ali Soroush
机构
*
Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院)
;
University of Texas Health(德克萨斯大学健康科学中心)
;
Virginia Hospital Center(弗吉尼亚医院中心)
;
Shahid Beheshti University of Medical Sciences(沙希德·贝赫什提医科大学)
;
Stanford University(斯坦福大学)
;
Cedars-Sinai Medical Center(西达赛奈医疗中心)
;
Inova Fairfax Medical Campus(伊诺瓦费尔法克斯医疗中心)
;
University of California–Los Angeles(加州大学洛杉矶分校)
;
NYU Grossman School of Medicine(纽约大学格罗斯曼医学院)
;
Columbia University(哥伦比亚大学)
CommentsManuscript Pages: 34, Figures: 7, Tables: 2, Supplementary File Pages: 35, Data Transparency Statement: Code is available at: https://github.com/Sdamirsa/LLM-VLM-in-Gastroenterology . Study data from American College of Gastroenterology (ACG) are restricted and available upon request with ACG permission. Correction: updated abstract considering Llama3.1 results