多模态大模型

GazeCLIP: Enhancing Gaze Estimation Through Text-Guided Multimodal Learning

Jun Wang, Hao Ruan, Liangjian Wen, Yong Dai, Mingjie Wang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

DynRefer: Delving into Region-level Multimodal Tasks via Dynamic Resolution

Yuzhong Zhao, Feng Liu, Yue Liu, Mingxiang Liao, Chen Gong, Qixiang Ye, Fang Wan

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in CVPR 2025. Code is available at https://github.com/callsys/DynRefer

CLIP-Optimized Multimodal Image Enhancement via ISP-CNN Fusion for Coal Mine IoVT under Uneven Illumination

Shuai Wang, Shihao Zhang, Jiaqi Wu, Zijian Tian, Wei Chen, Tongzhu Jin, Miaomiao Xue, Zehua Wang, Fei Richard Yu, Victor C. M. Leung

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review

Pei Fu, Tongkun Guan, Zining Wang, Zhentao Guo, Chen Duan, Hao Sun, Boming Chen, Jiayao Ma, Qianyi Jiang, Kai Zhou, Junfeng Luo

专题命中 图文多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Model

Zhongyi Zhou, Yichen Zhu, Minjie Zhu, Junjie Wen, Ning Liu, Zhiyuan Xu, Weibin Meng, Ran Cheng, Yaxin Peng, Chaomin Shen, Feifei Feng

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking

Florian Schneider, Carolin Holtermann, Chris Biemann, Anne Lauscher

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Pretrained Image-Text Models are Secretly Video Captioners

Chunhui Zhang, Yiren Jian, Zhongyu Ouyang, Soroush Vosoughi

专题命中 图文多模态 ：image-text(title)；multimodal(abstract)；分类 cs.CV

Comments Accepted to the 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL 2025). The first two authors contributed equally and were listed in random order

Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisions

Ming Shan Hee, Roy Ka-Wei Lee

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Preprint. Accepted at ICWSM'25

TPCap: Unlocking Zero-Shot Image Captioning with Trigger-Augmented and Multi-Modal Purification Modules

Ruoyu Zhang, Lulu Wang, Yi He, Tongling Pan, Zhengtao Yu, Yingna Li

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Models

Minh Duc Bui, Katharina von der Wense, Anne Lauscher

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to NAACL 2025 Main (Camera-Ready Version)

E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detection

Junjie Wu, Yumeng Fu, Nan Yu, Guohong Fu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.MM

MSTS: A Multimodal Safety Test Suite for Vision-Language Models

Paul Röttger, Giuseppe Attanasio, Felix Friedrich, Janis Goldzycher, Alicia Parrish, Rishabh Bhardwaj, Chiara Di Bonaventura, Roman Eng, Gaia El Khoury Geagea, Sujata Goswami, Jieun Han, Dirk Hovy, Seogyeong Jeong, Paloma Jeretič, Flor Miriam Plaza-del-Arco, Donya Rooein, Patrick Schramowski, Anastassia Shaitarova, Xudong Shen, Richard Willats, Andrea Zugarini, Bertie Vidgen

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments under review

Valley2: Exploring Multimodal Models with Scalable Vision-Language Design

Ziheng Wu, Zhenghao Chen, Ruipu Luo, Can Zhang, Yuan Gao, Zhentao He, Xian Wang, Haoran Lin, Minghui Qiu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

MM-PhyRLHF: Reinforcement Learning Framework for Multimodal Physics Question-Answering

Janak Kapuriya, Chhavi Kirtani, Apoorv Singh, Jay Saraf, Naman Lal, Jatin Kumar, Adarsh Raj Shivam, Astha Verma, Avinash Anand, Rajiv Ratn Shah

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

KAnoCLIP: Zero-Shot Anomaly Detection through Knowledge-Driven Prompt Learning and Enhanced Cross-Modal Integration

Chengyuan Li, Suyang Zhou, Jieping Kong, Lei Qi, Hui Xue

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICASSP 2025

Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction Data

Shuhao Gu, Jialing Zhang, Siyuan Zhou, Kevin Yu, Zhaohu Xing, Liangdong Wang, Zhou Cao, Jintao Jia, Zhuoyi Zhang, Yixuan Wang, Zhenchong Hu, Bo-Wen Zhang, Jijie Li, Dong Liang, Yingli Zhao, Songjing Wang, Yulong Ao, Yiming Ju, Huanhuan Ma, Xiaotong Li, Haiwen Diao, Yufeng Cui, Xinlong Wang, Yaoqi Liu, Fangxiang Feng, Guang Liu

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Comprehensive Multi-Modal Prototypes are Simple and Effective Classifiers for Vast-Vocabulary Object Detection

Yitong Chen, Wenhao Yao, Lingchen Meng, Sihong Wu, Zuxuan Wu, Yu-Gang Jiang

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Code is available at https://github.com/Row11n/Prova/tree/main

Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning

Chenyu Yang, Xizhou Zhu, Jinguo Zhu, Weijie Su, Junjie Wang, Xuan Dong, Wenhai Wang, Lewei Lu, Bin Li, Jie Zhou, Yu Qiao, Jifeng Dai

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Craft: Cross-modal Aligned Features Improve Robustness of Prompt Tuning

Jingchen Sun, Rohan Sharma, Vishnu Suresh Lokhande, Changyou Chen

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted to WACV 2025

CLIP-TNseg: A Multi-Modal Hybrid Framework for Thyroid Nodule Segmentation in Ultrasound Images

Xinjie Sun, Boxiong Wei, Yalong Jiang, Liquan Mao, Qi Zhao

专题命中 图文多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 4 pages, 2 figures, submitted to IEEE Signal Processing Letters

Prediction of Thrombectomy Functional Outcomes using Multimodal Data

Zeynel A. Samak, Philip Clatworthy, Majid Mirmehdi

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at Medical Image Understanding and Analysis (MIUA) 2020

MambaVLT: Time-Evolving Multimodal State Space Model for Vision-Language Tracking

Xinqi Liu, Li Zhou, Zikun Zhou, Jianqiu Chen, Zhenyu He

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Multimodal Autoregressive Pre-training of Large Vision Encoders

Enrico Fini, Mustafa Shukor, Xiujun Li, Philipp Dufter, Michal Klein, David Haldimann, Sai Aitharaju, Victor Guilherme Turrisi da Costa, Louis Béthune, Zhe Gan, Alexander T Toshev, Marcin Eichner, Moin Nabi, Yinfei Yang, Joshua M. Susskind, Alaaeldin El-Nouby

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments https://github.com/apple/ml-aim

LMM-driven Semantic Image-Text Coding for Ultra Low-bitrate Learned Image Compression

Shimon Murai, Heming Sun, Jiro Katto

专题命中 图文多模态 ：image-text(title)；multi-modal(abstract)；分类 cs.CV

Comments IEEE VCIP 2024 poster

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

Wanqi Zhou, Shuanghao Bai, Danilo P. Mandic, Qibin Zhao, Badong Chen

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 13 figures

Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performance

Zhangwei Gao, Zhe Chen, Erfei Cui, Yiming Ren, Weiyun Wang, Jinguo Zhu, Hao Tian, Shenglong Ye, Junjun He, Xizhou Zhu, Lewei Lu, Tong Lu, Yu Qiao, Jifeng Dai, Wenhai Wang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Technical report

Visual Anchors Are Strong Information Aggregators For Multimodal Large Language Model

Haogeng Liu, Quanzeng You, Xiaotian Han, Yongfei Liu, Huaibo Huang, Ran He, Hongxia Yang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Public Domain 12M: A Highly Aesthetic Image-Text Dataset with Novel Governance Mechanisms

Jordan Meyer, Nick Padgett, Cullen Miller, Laura Exline

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.AI

Comments Project Page: https://source.plus/pd12m

Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding

Jiazhen Wang, Bin Liu, Changtao Miao, Zhiwei Zhao, Wanyi Zhuang, Qi Chu, Nenghai Yu

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication. Camera-ready version and supplementary material

Griffon-G: Bridging Vision-Language and Vision-Centric Tasks via Large Multimodal Models

Yufei Zhan, Hongyin Zhao, Yousong Zhu, Fan Yang, Ming Tang, Jinqiao Wang

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication. Codes and data will be later released at https://github.com/jefferyZhan/Griffon