多模态大模型

Hyperdimensional Uncertainty Quantification for Multimodal Uncertainty Fusion in Autonomous Vehicles Perception

Luke Chen, Junyao Wang, Trier Mortlock, Pramod Khargonekar, Mohammad Abdullah Al Faruque

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2025

MMRL: Multi-Modal Representation Learning for Vision-Language Models

Yuncheng Guo, Xiaodong Gu

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Adapt-$\infty$: Scalable Continual Multimodal Instruction Tuning via Dynamic Data Selection

Adyasha Maharana, Jaehong Yoon, Tianlong Chen, Mohit Bansal

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments First two authors contributed equally. Code: https://github.com/adymaharana/adapt-inf

Neural-MCRL: Neural Multimodal Contrastive Representation Learning for EEG-based Visual Decoding

Yueyang Li, Zijian Kang, Shengyu Gong, Wenhao Dong, Weiming Zeng, Hongjie Yan, Wai Ting Siok, Nizhuan Wang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Enhancing Explainability with Multimodal Context Representations for Smarter Robots

Anargh Viswanath, Lokesh Veeramacheneni, Hendrik Buschmeier

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments Presented at 3rd Workshop on Explainability in Human-Robot Collaboration at HRI 2025

A Survey on RGB, 3D, and Multimodal Approaches for Unsupervised Industrial Image Anomaly Detection

Yuxuan Lin, Yang Chang, Xuan Tong, Jiawen Yu, Antonio Liotta, Guofan Huang, Wei Song, Deyu Zeng, Zongze Wu, Yan Wang, Wenqiang Zhang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by Information Fusion

xMOD: Cross-Modal Distillation for 2D/3D Multi-Object Discovery from 2D motion

Saad Lahlali, Sandra Kara, Hejer Ammar, Florian Chabot, Nicolas Granger, Hervé Le Borgne, Quoc-Cuong Pham

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2025

FusDreamer: Label-efficient Remote Sensing World Model for Multimodal Data Classification

Jinping Wang, Weiwei Song, Hao Chen, Jinchang Ren, Huimin Zhao

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Robust Multimodal Survival Prediction with the Latent Differentiation Conditional Variational AutoEncoder

Junjie Zhou, Jiao Tang, Yingli Zuo, Peng Wan, Daoqiang Zhang, Wei Shao

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2025

EndoChat: Grounded Multimodal Large Language Model for Endoscopic Surgery

Guankun Wang, Long Bai, Junyi Wang, Kun Yuan, Zhen Li, Tianxu Jiang, Xiting He, Jinlin Wu, Zhen Chen, Zhen Lei, Hongbin Liu, Jiazheng Wang, Fan Zhang, Nicolas Padoy, Nassir Navab, Hongliang Ren

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Aligning First, Then Fusing: A Novel Weakly Supervised Multimodal Violence Detection Method

Wenping Jin, Li Zhu, Jing Sun

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Multi-Modal Mamba Modeling for Survival Prediction (M4Survive): Adapting Joint Foundation Model Representations

Ho Hin Lee, Alberto Santamaria-Pang, Jameson Merkov, Matthew Lungren, Ivan Tarapov

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments 10 pages

AdaptiveFusion: Adaptive Multi-Modal Multi-View Fusion for 3D Human Body Reconstruction

Anjun Chen, Xiangyu Wang, Zhi Xu, Kun Shi, Yan Qin, Yuchi Huo, Jiming Chen, Qi Ye

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments TMM 2025, Project Page: https://chen3110.github.io/adaptivefusion/index.html

M2IST: Multi-Modal Interactive Side-Tuning for Efficient Referring Expression Comprehension

Xuyang Liu, Ting Liu, Siteng Huang, Yi Xin, Yue Hu, Quanjun Yin, Donglin Wang, Yuanyuan Wu, Honggang Chen

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

SIMAC: A Semantic-Driven Integrated Multimodal Sensing And Communication Framework

Yubo Peng, Luping Xiang, Kun Yang, Feibo Jiang, Kezhi Wang, Dapeng Oliver Wu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework

Jianian Zhu, Hang Wu, Haojie Wang, Yinghui Li, Biao Hou, Ruixuan Li, Jidong Zhai

专题命中 多模态训练与对齐 ：multimodal(title)；multi-modal(abstract)；分类 cs.MM

Comments 14 pages, 14 figures

SparseVoxFormer: Sparse Voxel-based Transformer for Multi-modal 3D Object Detection

Hyeongseok Son, Jia He, Seung-In Park, Ying Min, Yunhao Zhang, ByungIn Yoo

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

GraphT5: Unified Molecular Graph-Language Modeling via Multi-Modal Cross-Token Attention

Sangyeup Kim, Nayeon Kim, Yinhua Piao, Sun Kim

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

An Optimization Algorithm for Multimodal Data Alignment

Wei Zhang, Xinyue Wang, Lan Yu, Shi Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments ACL SRW submission

Dynamic Cross-Modal Feature Interaction Network for Hyperspectral and LiDAR Data Classification

Junyan Lin, Feng Gap, Lin Qi, Junyu Dong, Qian Du, Xinbo Gao

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE TGRS 2025

Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Model

Mingxing Li, Rui Wang, Lei Sun, Yancheng Bai, Xiangxiang Chu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

ToFu: Visual Tokens Reduction via Fusion for Multi-modal, Multi-patch, Multi-image Task

Vittorio Pippi, Matthieu Guillaumin, Silvia Cascianelli, Rita Cucchiara, Maximilian Jaritz, Loris Bazzani

专题命中 多模态训练与对齐 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Driving

Zhangshuo Qi, Junyi Ma, Jingyi Xu, Zijie Zhou, Luqi Cheng, Guangming Xiong

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 6 figures

BEVMOSNet: Multimodal Fusion for BEV Moving Object Segmentation

Hiep Truong Cong, Ajay Kumar Sigatapu, Arindam Das, Yashwanth Sharma, Venkatesh Satagopan, Ganesh Sistu, Ciaran Eising

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2025)

Attention Bootstrapping for Multi-Modal Test-Time Adaptation

Yusheng Zhao, Junyu Luo, Xiao Luo, Jinsheng Huang, Jingyang Yuan, Zhiping Xiao, Ming Zhang

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

VoxelNextFusion: A Simple, Unified and Effective Voxel Fusion Framework for Multi-Modal 3D Object Detection

Ziying Song, Guoxin Zhang, Jun Xie, Lin Liu, Caiyan Jia, Shaoqing Xu, Zhepeng Wang

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, vol. 61, 2023, pp. 1-12

A Shared Encoder Approach to Multimodal Representation Learning

Shuvendu Roy, Franklin Ogidi, Ali Etemad, Elham Dolatabadi, Arash Afkanpour

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

LLM-Fusion: A Novel Multimodal Fusion Model for Accelerated Material Discovery

Onur Boyar, Indra Priyadarsini, Seiji Takeda, Lisa Hamada

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments 4 pages, presented at AAAI 2025 Workshop on AI to Accelerating Science and Engineering (AI2ASE)

CFSum: A Transformer-Based Multi-Modal Video Summarization Framework With Coarse-Fine Fusion

Yaowei Guo, Jiazheng Xing, Xiaojun Hou, Shuo Xin, Juntao Jiang, Demetri Terzopoulos, Chenfanfu Jiang, Yong Liu

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

SegLocNet: Multimodal Localization Network for Autonomous Driving via Bird's-Eye-View Segmentation

Zijie Zhou, Zhangshuo Qi, Luqi Cheng, Guangming Xiong

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV