视觉大模型 / VLM

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Jiayu Wang, Yifei Ming, Zhenmei Shi, Vibhav Vineet, Xin Wang, Yixuan Li, Neel Joshi

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to NeurIPS 2024

DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution

Yang Yue, Yulin Wang, Bingyi Kang, Yizeng Han, Shenzhi Wang, Shiji Song, Jiashi Feng, Gao Huang

专题命中 视觉推理 ：multimodal large language model(title)；MLLM(abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 6 figures, NeurIPS 2024

Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties

Keunwoo Peter Yu, Zheyuan Zhang, Fengyuan Hu, Shane Storks, Joyce Chai

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages, LaTeX; Accepted to EMNLP 2024 Main

Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning

Xiaoye Qu, Jiashuo Sun, Wei Wei, Yu Cheng

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 7 tables, 7 figures

Every Part Matters: Integrity Verification of Scientific Figures Based on Multimodal Large Language Models

Xiang Shi, Jiawei Liu, Yinpeng Liu, Qikai Cheng, Wei Lu

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Comments 28 pages, 11 figures, under review

In-Context Learning Improves Compositional Understanding of Vision-Language Models

Matteo Nulli, Anesa Ibrahimi, Avik Pal, Hoshe Lee, Ivona Najdenkoska

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Large Vision-Language Models as Emotion Recognizers in Context Awareness

Yuxuan Lei, Dingkang Yang, Zhaoyu Chen, Jiawei Chen, Peng Zhai, Lihua Zhang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

TopViewRS: Vision-Language Models as Top-View Spatial Reasoners

Chengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier, Anna Korhonen, Ivan Vulić

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.LG

Comments 9 pages, 3 figures, 3 tables (21 pages, 4 figures, 15 tables including references and appendices)

Slot Abstractors: Toward Scalable Abstract Visual Reasoning

Shanka Subhra Mondal, Jonathan D. Cohen, Taylor W. Webb

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments 18 pages, 9 figures

InsightSee: Advancing Multi-agent Vision-Language Models for Enhanced Visual Understanding

Huaxiang Zhang, Yaojia Mu, Guo-Niu Zhu, Zhongxue Gan

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

An Examination of the Compositionality of Large Generative Vision-Language Models

Teli Ma, Rong Li, Junwei Liang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

VISREAS: Complex Visual Reasoning with Unanswerable Questions

Syeda Nahida Akter, Sangwu Lee, Yingshan Chang, Yonatan Bisk, Eric Nyberg

专题命中 视觉推理 ：visual reasoning(title)；LLaVA(abstract)；分类 cs.CV、cs.AI

Comments 18 pages, 14 figures, 5 tables

Revisiting Disentanglement in Downstream Tasks: A Study on Its Necessity for Abstract Visual Reasoning

Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li, Yang Gao

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted to AAAI-2024

Prompting Large Vision-Language Models for Compositional Reasoning

Timothy Ossowski, Ming Jiang, Junjie Hu

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning

Gengyuan Zhang, Yurui Zhang, Kerui Zhang, Volker Tresp

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to WACV 2024

ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense

Kankan Zhou, Eason Lai, Wei Bin Au Yeong, Kyriakos Mouratidis, Jing Jiang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments This is the camera-ready version of the paper that will be published in the EMNLP 2023 Findings (Singapore, 6-10 December 2023)

Multimodal Representations for Teacher-Guided Compositional Visual Reasoning

Wafa Aissa, Marin Ferecatu, Michel Crucianu

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Journal ref Advanced Concepts for Intelligent Vision Systems, 21st International Conference (ACIVS 2023), Aug 2023, Kumamoto, Japan

Multimodal Analysis Of Google Bard And GPT-Vision: Experiments In Visual Reasoning

David Noever, Samantha Elizabeth Miller Noever

专题命中 视觉推理 ：visual reasoning(title)；vision-language model(abstract)；分类 cs.CV、cs.LG

Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning

Pengbo Hu, Ji Qi, Xingyu Li, Hong Li, Xinqi Wang, Bing Quan, Ruiyu Wang, Yi Zhou

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages,1 figures, under review

Visual Reasoning: from State to Transformation

Xin Hong, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by TPAMI. arXiv admin note: substantial text overlap with arXiv:2011.13160

Curriculum Learning for Compositional Visual Reasoning

Wafa Aissa, Marin Ferecatu, Michel Crucianu

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Journal ref In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, Feb 2023, Lisbon, Portugal. pp.888-897

Visual Programming: Compositional visual reasoning without training

Tanmay Gupta, Aniruddha Kembhavi

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.AI

Zero-shot visual reasoning through probabilistic analogical mapping

Taylor W. Webb, Shuhao Fu, Trevor Bihl, Keith J. Holyoak, Hongjing Lu

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

A Benchmark for Compositional Visual Reasoning

Aimen Zerroug, Mohit Vaishnav, Julien Colin, Sebastian Musslick, Thomas Serre

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Understanding the computational demands underlying visual reasoning

Mohit Vaishnav, Remi Cadene, Andrea Alamia, Drew Linsley, Rufin VanRullen, Thomas Serre

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments 26 pages, 16 figures

Journal ref Neural Computation, 2022

Grounding Complex Navigational Instructions Using Scene Graphs

Michiel de Jong, Satyapriya Krishna, Anuva Agarwal

专题命中 视觉推理 ：grounding(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Comments arXiv admin note: text overlap with arXiv:1706.07230 by other authors

Comparing Visual Reasoning in Humans and AI

Shravan Murlidaran, William Yang Wang, Miguel P. Eckstein

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Dynamic Language Binding in Relational Visual Reasoning

Thao Minh Le, Vuong Le, Svetha Venkatesh, Truyen Tran

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Comments Early version accepted by IJCAI20, Code available at https://github.com/thaolmk54/LOGNet-VQA

Meta Module Network for Compositional Visual Reasoning

Wenhu Chen, Zhe Gan, Linjie Li, Yu Cheng, William Wang, Jingjing Liu

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted to WACV 21 (Oral)

Few-shot Visual Reasoning with Meta-analogical Contrastive Learning

Youngsung Kim, Jinwoo Shin, Eunho Yang, Sung Ju Hwang

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.AI、cs.LG