多模态大模型

Perception Tokens Enhance Visual Reasoning in Multimodal Language Models

Mahtab Bigverdi, Zelun Luo, Cheng-Yu Hsieh, Ethan Shen, Dongping Chen, Linda G. Shapiro, Ranjay Krishna

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Can Multimodal Large Language Models Truly Perform Multimodal In-Context Learning?

Shuo Chen, Zhen Han, Bailan He, Jianzhe Liu, Mark Buckley, Yao Qin, Philip Torr, Volker Tresp, Jindong Gu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments accepted by WACV2025

Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning

Divyam Madaan, Taro Makino, Sumit Chopra, Kyunghyun Cho

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted to NeurIPS 2024. Code available at https://github.com/divyam3897/I2M2

Adaptive Interactive Segmentation for Multimodal Medical Imaging via Selection Engine

Zhi Li, Kai Zhao, Yaqi Wang, Shuai Wang

专题命中 其他多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV、cs.AI

DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understanding

Hao Feng, Qi Liu, Hao Liu, Jingqun Tang, Wengang Zhou, Houqiang Li, Can Huang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by Science China Information Sciences (SCIS)

IC3M: In-Car Multimodal Multi-object Monitoring for Abnormal Status of Both Driver and Passengers

Zihan Fang, Zheng Lin, Senkang Hu, Hangcheng Cao, Yiqin Deng, Xianhao Chen, Yuguang Fang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages, 17 figures

TalkMosaic: Interactive PhotoMosaic with Multi-modal LLM Q&A Interactions

Kevin Li, Fulu Li

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments 6 pages, 5 figures

Classifier-guided Gradient Modulation for Enhanced Multimodal Learning

Zirun Guo, Tao Jin, Jingyuan Chen, Zhou Zhao

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted at NeurIPS 2024

Using Multimodal Deep Neural Networks to Disentangle Language from Visual Aesthetics

Colin Conwell, Christopher Hamblin, Chelsea Boccagno, David Mayo, Jesse Cummings, Leyla Isik, Andrei Barbu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

DiaMond: Dementia Diagnosis with Multi-Modal Vision Transformers Using MRI and PET

Yitong Li, Morteza Ghahremani, Youssef Wally, Christian Wachinger

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

TV-SAM: Increasing Zero-Shot Segmentation Performance on Multimodal Medical Images Using GPT-4 Generated Descriptive Prompts Without Human Annotation

Zekun Jiang, Dongjie Cheng, Ziyuan Qin, Jun Gao, Qicheng Lao, Abdullaev Bakhrom Ismoilovich, Urazboev Gayrat, Yuldashov Elyorbek, Bekchanov Habibullo, Defu Tang, LinJing Wei, Kang Li, Le Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 5 figures, 4 tables, accepted by BDMA Journal

Utility of Multimodal Large Language Models in Analyzing Chest X-ray with Incomplete Contextual Information

Choonghan Kim, Seonhee Cho, Joo Heung Yoon

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

From Concrete to Abstract: A Multimodal Generative Approach to Abstract Concept Learning

Haodong Xie, Rahul Singh Maharjan, Federico Tavella, Angelo Cangelosi

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

MSG-Chart: Multimodal Scene Graph for ChartQA

Yue Dai, Soyeon Caren Han, Wei Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accpeted by CIKM Short 2024

CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

Yu Feng, Zhen Tian, Yifan Zhu, Zongfu Han, Haoran Luo, Guangwei Zhang, Meina Song

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACM MM 2024

PASSION: Towards Effective Incomplete Multi-Modal Medical Image Segmentation with Imbalanced Missing Rates

Junjie Shi, Caozhi Shang, Zhaobin Sun, Li Yu, Xin Yang, Zengqiang Yan

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ACM MM 2024

DIM: Dynamic Integration of Multimodal Entity Linking with Large Language Model

Shezheng Song, Shasha Li, Jie Yu, Shan Zhao, Xiaopeng Li, Jun Ma, Xiaodong Liu, Zhuo Li, Xiaoguang Mao

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Published on PRCV24

Imp: Highly Capable Large Multimodal Models for Mobile Devices

Zhenwei Shao, Zhou Yu, Jun Yu, Xuecheng Ouyang, Lihao Zheng, Zhenbiao Gai, Mingyang Wang, Jiajun Ding

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments fix some typos and correct a few number in the tables

Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting

Omar Hamed, Souhail Bakkali, Marie-Francine Moens, Matthew Blaschko, Jordy Van Landeghem

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted at ICDAR 2024

Simplifying Multimodality: Unimodal Approach to Multimodal Challenges in Radiology with General-Domain Large Language Model

Seonhee Cho, Choonghan Kim, Jiho Lee, Chetan Chilkunda, Sujin Choi, Joo Heung Yoon

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Under review

Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations

Sangmin Lee, Bolin Lai, Fiona Ryan, Bikram Boote, James M. Rehg

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments CVPR 2024 Oral

Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

Guillaume Jaume, Anurag Vaidya, Richard Chen, Drew Williamson, Paul Liang, Faisal Mahmood

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to CVPR 2024

VIAssist: Adapting Multi-modal Large Language Models for Users with Visual Impairments

Bufang Yang, Lixing He, Kaiwei Liu, Zhenyu Yan

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IEEE International Workshop on Foundation Models for Cyber-Physical Systems & Internet of Things (FMSys 2024)

Generative Multi-modal Models are Good Class-Incremental Learners

Xusheng Cao, Haori Lu, Linlan Huang, Xialei Liu, Ming-Ming Cheng

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at CVPR 2024

A multimodal deep learning architecture for smoking detection with a small data approach

Robert Lakatos, Peter Pollner, Andras Hajdu, Tamas Joo

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems

Yuxiao Huang, Wenjie Zhang, Liang Feng, Xingyu Wu, Kay Chen Tan

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 8pages,3 figures, 2 tables

Automated Floodwater Depth Estimation Using Large Multimodal Model for Rapid Flood Mapping

Temitope Akinboyewa, Huan Ning, M. Naser Lessani, Zhenlong Li

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comparing Abstraction in Humans and Large Language Models Using Multimodal Serial Reproduction

Sreejan Kumar, Raja Marjieh, Byron Zhang, Declan Campbell, Michael Y. Hu, Umang Bhatt, Brenden Lake, Thomas L. Griffiths

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Source-Free Cross-Modal Knowledge Transfer by Unleashing the Potential of Task-Irrelevant Data

Jinjing Zhu, Yucheng Chen, Lin Wang

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

A Multimodal Approach for Advanced Pest Detection and Classification

Jinli Duan, Haoyu Ding, Sung Kim

专题命中 其他多模态 ：multimodal(title)；cross-modal(abstract)；分类 cs.CV、cs.AI