视觉大模型 / VLM

Lifting the Veil on Visual Information Flow in MLLMs: Unlocking Pathways to Faster Inference

Hao Yin, Guangzong Si, Zilei Wang

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Prior

Seunggwan Lee, Hwanhee Jung, Byoungsoo Koh, Qixing Huang, Sangho Yoon, Sangpil Kim

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments 19 pages, 18 figures

Leveraging Vision Capabilities of Multimodal LLMs for Automated Data Extraction from Plots

Maciej P. Polak, Dane Morgan

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 3 figures

Exploration of VLMs for Driver Monitoring Systems Applications

Paola Natalia Cañas, Marcos Nieto, Oihana Otaegui, Igor Rodríguez

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted in 16th ITS European Congress, Seville, Spain, 19-21 May 2025

From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities

Wanpeng Zhang, Zilong Xie, Yicheng Feng, Yijiang Li, Xingrun Xing, Sipeng Zheng, Zongqing Lu

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

BuildingView: Constructing Urban Building Exteriors Databases with Street View Imagery and Multimodal Large Language Mode

Zongrong Li, Yunlei Su, Hongrong Wang, Wufan Zhao

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments 15 pages, 6 figures

Enhancing Monocular 3D Scene Completion with Diffusion Model

Changlin Song, Jiaqi Wang, Liyun Zhu, He Weng

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments All authors had equal contribution

A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models

Zihao Lin, Samyadeep Basu, Mohammad Beigi, Varun Manjunatha, Ryan A. Rossi, Zichao Wang, Yufan Zhou, Sriram Balasubramanian, Arman Zarei, Keivan Rezaei, Ying Shen, Barry Menglong Yao, Zhiyang Xu, Qin Liu, Yuxiang Zhang, Yan Sun, Shilong Liu, Li Shen, Hongxuan Li, Soheil Feizi, Lifu Huang

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.AI、cs.LG

Comments 30 pages, 4 Figures, 10 Tables

Beyond Vision: How Large Language Models Interpret Facial Expressions from Valence-Arousal Values

Vaibhav Mehra, Guy Laban, Hatice Gunes

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Cached Multi-Lora Composition for Multi-Concept Image Generation

Xiandong Zou, Mingzhu Shen, Christos-Savvas Bouganis, Yiren Zhao

专题命中 其他VLM ：MLLM(abstract)；分类 cs.CV、cs.AI

Comments The Thirteenth International Conference on Learning Representations (ICLR 2025)

CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements

Afshin Khadangi, Amir Sartipi, Igor Tchappi, Gilbert Fridgen

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Boosting Weak Positives for Text Based Person Search

Akshay Modi, Ashhar Aziz, Nilanjana Chatterjee, A V Subramanyam

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

DynaPrompt: Dynamic Test-Time Prompt Tuning

Zehao Xiao, Shilin Yan, Jack Hong, Jiayin Cai, Xiaolong Jiang, Yao Hu, Jiayi Shen, Qi Wang, Cees G. M. Snoek

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2025

Distributed Multi-Agent Coordination Using Multi-Modal Foundation Models

Saaduddin Mahmud, Dorian Benhamou Goldfajn, Shlomo Zilberstein

专题命中 其他VLM ：vision language model(abstract)；分类 cs.AI、cs.LG

VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance

Divyansh Srivastava, Ge Yan, Tsui-Wei Weng

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Appeared at NeurIPS 2024

Re-ranking the Context for Multimodal Retrieval Augmented Generation

Matin Mortaheb, Mohammad A. Amir Khojastepour, Srimat T. Chakradhar, Sennur Ulukus

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Framework

Run Shao, Cheng Yang, Qiujun Li, Qing Zhu, Yongjun Zhang, YanSheng Li, Yu Liu, Yong Tang, Dapeng Liu, Shizhong Yang, Haifeng Li

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.AI、cs.LG

Comments 19 pages, 19 tables, 3 figures

Journal ref IEEE Transactions on Geoscience and Remote Sensing. 2025

Label-free Concept Based Multiple Instance Learning for Gigapixel Histopathology

Susu Sun, Leslie Tessier, Frédérique Meeuwsen, Clément Grisi, Dominique van Midden, Geert Litjens, Christian F. Baumgartner

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Dynamic Prompt Adjustment for Multi-Label Class-Incremental Learning

Haifeng Zhao, Yuguang Jin, Leilei Ma

专题命中 其他VLM ：visual language model(abstract)；分类 cs.CV、cs.LG

Comments published to BICS2024

GCS-M3VLT: Guided Context Self-Attention based Multi-modal Medical Vision Language Transformer for Retinal Image Captioning

Teja Krishna Cherukuri, Nagur Shareef Shaik, Jyostna Devi Bodapati, Dong Hye Ye

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments This paper has been accepted for presentation at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025)

Best-of-N Jailbreaking

John Hughes, Sara Price, Aengus Lynch, Rylan Schaeffer, Fazl Barez, Sanmi Koyejo, Henry Sleight, Erik Jones, Ethan Perez, Mrinank Sharma

专题命中 其他VLM ：vision language model(abstract)；分类 cs.AI、cs.LG

Position-aware Guided Point Cloud Completion with CLIP Model

Feng Zhou, Qi Zhang, Ju Dai, Lei Li, Qing Fan, Junliang Xing

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by AAAI25

Synergistic Development of Perovskite Memristors and Algorithms for Robust Analog Computing

Nanyang Ye, Qiao Sun, Yifei Wang, Liujia Yang, Jundong Zhou, Lei Wang, Guang-Zhong Yang, Xinbing Wang, Chenghu Zhou, Wei Ren, Leilei Gu, Huaqiang Wu, Qinying Gu

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.AI、cs.LG

RealDex: Towards Human-like Grasping for Robotic Dexterous Hand

Yumeng Liu, Yaxun Yang, Youzhuo Wang, Xiaofei Wu, Jiamin Wang, Yichen Yao, Sören Schwertfeger, Sibei Yang, Wenping Wang, Jingyi Yu, Xuming He, Yuexin Ma

专题命中 其他VLM ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments Project Page: https://4dvlab.github.io/RealDex_page/

Journal ref Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence (2024)

CLIPArTT: Adaptation of CLIP to New Domains at Test Time

Gustavo Adolfo Vargas Hakim, David Osowiechi, Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Moslem Yazdanpanah, Ismail Ben Ayed, Christian Desrosiers

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

Aligning Knowledge Concepts to Whole Slide Images for Precise Histopathology Image Analysis

Weiqin Zhao, Ziyu Guo, Yinshuang Fan, Yuming Jiang, Maximus Yeung, Lequan Yu

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.LG

Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmark

Rong-Cheng Tu, Zi-Ao Ma, Tian Lan, Yuehao Zhao, Heyan Huang, Xian-Ling Mao

专题命中 其他VLM ：MLLM(abstract)；分类 cs.CV、cs.AI

INQUIRE: A Natural World Text-to-Image Retrieval Benchmark

Edward Vendrow, Omiros Pantazis, Alexander Shepard, Gabriel Brostow, Kate E. Jones, Oisin Mac Aodha, Sara Beery, Grant Van Horn

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Published in NeurIPS 2024, Datasets and Benchmarks Track

Personalized Video Summarization by Multimodal Video Understanding

Brian Chen, Xiangyuan Zhao, Yingnan Zhu

专题命中 其他VLM ：visual language model(abstract)；分类 cs.CV、cs.AI

Comments In Proceedings of CIKM 2024 Applied Research Track

Journal ref 33rd ACM International Conference on Information and Knowledge Management (CIKM 2024)

TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models

Georgia Gabriela Sampaio, Ruixiang Zhang, Shuangfei Zhai, Jiatao Gu, Josh Susskind, Navdeep Jaitly, Yizhe Zhang

专题命中 其他VLM ：vision-language model(abstract)；分类 cs.CV、cs.AI