多模态大模型

VisCRA: A Visual Chain Reasoning Attack for Jailbreaking Multimodal Large Language Models

Bingrui Sima, Linhua Cong, Wenxuan Wang, Kun He

机构 * Huazhong University of Science and Technology（华中科技大学） ； Hong Kong University of Science and Technology（香港科技大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

An uncertainty-aware Digital Shadow for underground multimodal CO2 storage monitoring

Abhinav Prakash Gahlot, Rafael Orozco, Ziyi Yin, Felix J. Herrmann

机构 * Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 其他多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Multimodal Federated Learning With Missing Modalities through Feature Imputation Network

Pranav Poudel, Aavash Chhetri, Prashnna Gyawali, Georgios Leontidis, Binod Bhattarai

机构 * University of Aberdeen（阿伯丁大学） ； NepAl Applied Mathematics and Informatics Institute for research（尼泊尔应用数学与信息技术研究所） ； West Virginia University（西弗吉尼亚大学） ； Fogsphere (Redev.AI)（Fogsphere（Redev.AI）） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments MIUA 2025

ChartSketcher: Reasoning with Multimodal Feedback and Reflection for Chart Understanding

Muye Huang, Lingling Zhang, Jie Ma, Han Lai, Fangzhi Xu, Yifei Li, Wenjun Wu, Yaqiang Wu, Jun Liu

机构 * School of Computer Science and Technology, Xi’an Jiaotong University（计算机科学与技术学院，西安交通大学） ； MOE KLINNS Lab, Xi’an Jiaotong University（教育部KLINNS实验室，西安交通大学） ； Zhongguancun Academy, Beijing（中关村学院，北京） ； Lenovo Research（联想研究） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 23 pages, 9 figures

CAMME: Adaptive Deepfake Image Detection with Multi-Modal Cross-Attention

Naseem Khan, Tuan Nguyen, Amine Bermak, Issa Khalil

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 20 pages, 8 figures, 12 Tables

PCMamba: Physics-Informed Cross-Modal State Space Model for Dual-Camera Compressive Hyperspectral Imaging

Ge Meng, Zhongnan Cai, Jingyan Tu, Yingying Wang, Chenxin Li, Yue Huang, Xinghao Ding

机构 * Xiamen University（厦门大学） 纠错

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV

Multimodal Generative AI for Story Point Estimation in Software Development

Mohammad Rubyet Islam, Peter Sandborn

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Journal ref A revised version of this work is published in the proceedings of the IEEE Conference on Artificial Intelligence 2025

Towards Zero-Shot Differential Morphing Attack Detection with Multimodal Large Language Models

Ria Shekhawat, Hailin Li, Raghavendra Ramachandra, Sushma Venkatesh

机构 * Norwegian University of Science and Technology (NTNU)（挪威科学与技术大学） ； MOBAI AS（MOBAI公司） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at IEEE International Conference on Automatic Face and Gesture Recognition (FG 2025)

MultiMAE Meets Earth Observation: Pre-training Multi-modal Multi-task Masked Autoencoders for Earth Observation Tasks

Jose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada

机构 * SnT, University of Luxembourg（SnT，卢森堡大学） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition

Shuo Zhang, Jinsong Zhang, Zhejun Zhang, Lei Li

机构 * School of Artificial Intelligence, Beijing University of Posts and Telecommunications（人工智能学院，北京邮电大学） ； School of Computer Science and Technology, Harbin Institute of Technology（计算机科学与技术学院，哈尔滨工业大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted to ICME 2025

Uncovering the Genetic Basis of Glioblastoma Heterogeneity through Multimodal Analysis of Whole Slide Images and RNA Sequencing Data

Ahmad Berjaoui, Louis Roussel, Eduardo Hugo Sanchez, Elizabeth Cohen-Jonathan Moyal

机构 * INSERM UMR 1037 Cancer Research Center of Toulouse (CRCT), University Paul Sabatier Toulouse III（里尔癌症研究中心（CRCT）、保罗·萨巴蒂埃大学图卢兹第三分校） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Bridging the Inter-Domain Gap through Low-Level Features for Cross-Modal Medical Image Segmentation

Pengfei Lyu, Pak-Hei Yeung, Xiaosheng Yu, Jing Xia, Jianning Chi, Chengdong Wu, Jagath C. Rajapakse

机构 * Northeastern University, Shenyang, China（东北大学，沈阳，中国） ； Nanyang Technological University, Singapore（南洋理工大学，新加坡） 纠错

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments 11 pages, 2 figures

Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularization

Xu Zheng, Yuanhuiyi Lyu, Lutao Jiang, Danda Pani Paudel, Luc Van Gool, Xuming Hu

机构 * AI Thrust, HKUST(GZ)（香港科技大学（广州）人工智能方向） ； CSE, HKUST（香港科技大学计算机科学与工程系） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Multi-QuAD: Multi-Level Quality-Adaptive Dynamic Network for Reliable Multimodal Classification

Shu Shen, C. L. Philip Chen, Tong Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 12 pages, 11 figures

Towards Global Localization using Multi-Modal Object-Instance Re-Identification

Aneesh Chavan, Vaibhav Agrawal, Vineeth Bhat, Sarthak Chittawar, Siddharth Srivastava, Chetan Arora, K Madhava Krishna

机构 * RRC, IIIT Hyderabad India（IIIT Hyderabad 印度研究院） ； TypeFace Inc. India（印度 Typeface 公司） 纠错

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 8 pages, 5 figures, 3 tables. Accepted at Advances in Robotics, AIR 2025 (Oral)

Memento: Augmenting Personalized Memory via Practical Multimodal Wearable Sensing in Visual Search and Wayfinding Navigation

Indrajeet Ghosh, Kasthuri Jayarajah, Nicholas Waytowich, Nirmalya Roy

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.MM

Comments This work has been accepted to the Proceedings of the ACM UMAP 2025

MatterChat: A Multi-Modal LLM for Material Science

Yingheng Tang, Wenbin Xu, Jie Cao, Weilu Gao, Steve Farrell, Benjamin Erichson, Michael W. Mahoney, Andy Nonaka, Zhi Yao

机构 * Applied Mathematics and Computational Research Division, Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室应用数学与计算研究部） ； National Energy Research Scientific Computing Center, Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室国家能源研究科学计算中心） ； NSF National AI Institute for Student-AI Teaming, University of Colorado at Boulder（国家科学基金会学生-人工智能协同人工智能研究所，科罗拉多大学波德罗分校） ； Department of Electrical and Computer Engineering, The University of Utah（犹他大学电气与计算机工程系） ； Scientific Data Division, Lawrence Berkeley National Laboratory（劳伦斯伯克利国家实验室科学数据部） ； International Computer Science Institute, Berkeley, CA, USA（伯克利加州大学国际计算机科学研究所） ； Department of Statistics, University of California at Berkeley（伯克利加州大学统计学系） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.AI

Exploring Multimodal Prompt for Visualization Authoring with Large Language Models

Zhen Wen, Luoxuan Weng, Yinghao Tang, Runjin Zhang, Yuxin Liu, Bo Pan, Minfeng Zhu, Wei Chen

机构 * State Key Lab of CAD&CG, Zhejiang University（CAD与CG国家重点实验室，浙江大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 11 pages, 8 figures

Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input

Jian Wang, Rishabh Dabral, Diogo Luvizon, Zhe Cao, Lingjie Liu, Thabo Beeler, Christian Theobalt

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

PointNorm-Net: Self-Supervised Normal Prediction of 3D Point Clouds via Multi-Modal Distribution Estimation

Jie Zhang, Minghui Nie, Changqing Zou, Jian Liu, Ligang Liu, Junjie Cao

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Improving Early Prediction of Type 2 Diabetes Mellitus with ECG-DiaNet: A Multimodal Neural Network Leveraging Electrocardiogram and Clinical Risk Factors

Farida Mohsen, Zubair Shah

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Evaluating Graphical Perception with Multimodal LLMs

Rami Huu Nguyen, Kenichi Maeda, Mahsa Geshvadi, Daniel Haehn

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 5 figures, 1 teaser, IEEE Pacific Visualization 2025 Conference

Interactive Sketchpad: A Multimodal Tutoring System for Collaborative, Visual Problem-Solving

Steven-Shine Chen, Jimin Lee, Paul Pu Liang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments To be published in Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA 25)

Multimodal Data Integration for Sustainable Indoor Gardening: Tracking Anyplant with Time Series Foundation Model

Seyed Hamidreza Nabaei, Zeyang Zheng, Dong Chen, Arsalan Heydarian

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at ASCE International Conference on Computing in Civil Engineering (i3ce)

UFM: Unified Feature Matching Pre-training with Multi-Modal Image Assistants

Yide Di, Yun Liao, Hao Zhou, Kaijun Zhu, Qing Duan, Junhui Liu, Mingyu Lu

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 34 pages, 13 figures

Multimodal Image Matching based on Frequency-domain Information of Local Energy Response

Meng Yang, Jun Chen, Wenping Gong, Longsheng Wei, Xin Tian

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 34 pages, 11 figures

CalibQuant: 1-Bit KV Cache Quantization for Multimodal LLMs

Insu Han, Zeliang Zhang, Zhiyuan Wang, Yifan Zhu, Susan Liang, Jiani Liu, Haiting Lin, Mingjie Zhao, Chenliang Xu, Kun Wan, Wentian Zhao

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

When neural implant meets multimodal LLM: A dual-loop system for neuromodulation and naturalistic neuralbehavioral research

Edward Hong Wang, Cynthia Xin Wen

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.AI

MemorySAM: Memorize Modalities and Semantics with Segment Anything Model 2 for Multi-modal Semantic Segmentation

Chenfei Liao, Xu Zheng, Yuanhuiyi Lyu, Haiwei Xue, Yihong Cao, Jiawen Wang, Kailun Yang, Xuming Hu

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV

Multimodal Mamba: Decoder-only Multimodal State Space Model via Quadratic to Linear Distillation

Bencheng Liao, Hongyuan Tao, Qian Zhang, Tianheng Cheng, Yingyue Li, Haoran Yin, Wenyu Liu, Xinggang Wang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Code and model are available at https://github.com/hustvl/mmMamba