视觉大模型 / VLM - arXivDaily 专题

2501.16411 2025-01-30 cs.CV cs.AI cs.CL cs.LG cs.RO 82%

PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding

Wei Chow, Jiageng Mao, Boyi Li, Daniel Seita, Vitor Guizilini, Yue Wang

专题命中视觉推理：vision-language model(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments ICLR 2025. Project page: https://physbench.github.io/ Dataset: https://huggingface.co/datasets/USC-GVL/PhysBench

2312.09997 2025-01-22 cs.AI cs.CV cs.LG 82%

One Self-Configurable Model to Solve Many Abstract Visual Reasoning Problems

Mikołaj Małkiński, Jacek Mańdziuk

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted to The 38th Annual AAAI Conference on Artificial Intelligence (AAAI 2024)

Journal ref Proceedings of the AAAI Conference on Artificial Intelligence, Volume 38, Number 13, March 2024, Pages 14297-14305

2012.01944 2025-01-22 cs.AI cs.CV cs.LG 82%

Multi-Label Contrastive Learning for Abstract Visual Reasoning

Mikołaj Małkiński, Jacek Mańdziuk

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Journal ref IEEE Transactions on Neural Networks and Learning Systems, Volume 35, Issue 2, February 2024, Pages 1941-1953

2404.12652 2025-01-15 cs.CV cs.AI cs.CL cs.LG 82%

Pre-trained Vision-Language Models Learn Discoverable Visual Concepts

Yuan Zang, Tian Yun, Hao Tan, Trung Bui, Chen Sun

专题命中视觉推理：vision-language model(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Transactions on Machine Learning Research, 2025

2409.05840 2025-01-03 cs.CL 82%

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct

Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Minzheng Wang, Pengpeng Zeng, Lianli Gao, Heng Tao Shen, Yunshui Li, Xiaobo Xia, Fei Huang, Jingkuan Song, Yongbin Li

专题命中视觉推理：multimodal large language model(title,abstract)；visual reasoning(abstract)

2412.18826 2024-12-30 cs.CL 82%

RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting

Yilei Jiang, Yingshui Tan, Xiangyu Yue

专题命中视觉推理：multimodal large language model(title,abstract)；MLLM(abstract)

2412.03548 2024-12-10 cs.CV cs.AI cs.LG 82%

Perception Tokens Enhance Visual Reasoning in Multimodal Language Models

Mahtab Bigverdi, Zelun Luo, Cheng-Yu Hsieh, Ethan Shen, Dongping Chen, Linda G. Shapiro, Ranjay Krishna

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

2411.13754 2024-11-22 cs.LG cs.AI cs.CV 82%

Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios

Shantanu Jaiswal, Debaditya Roy, Basura Fernando, Cheston Tan

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments NeurIPS 2024 camera ready; source code to be released at: https://github.com/shantanuj/IPRM_Iterative_and_Parallel_Reasoning_Mechanism

2411.02810 2024-11-06 cs.CE cs.IR 82%

Leveraging Vision-Language Models for Manufacturing Feature Recognition in CAD Designs

Muhammad Tayyab Khan, Lequn Chen, Ye Han Ng, Wenhe Feng, Nicholas Yew Jin Tan, Seung Ki Moon

专题命中视觉推理：vision-language model(title,abstract)；LLaVA(abstract)

Comments Paper has been submitted to The ASME Journal of Computing and Information Science in Engineering (JCISE)

2411.01307 2024-11-05 cs.CL 82%

Can Multimodal Large Language Model Think Analogically?

Diandian Guo, Cong Cao, Fangfang Yuan, Dakui Wang, Wei Ma, Yanbing Liu, Jianhui Fu

专题命中视觉推理：multimodal large language model(title,abstract)；MLLM(abstract)

2402.06798 2024-10-16 cs.RO 82%

Reasoning Grasping via Multimodal Large Language Model

Shiyu Jin, Jinxuan Xu, Yutian Lei, Liangjun Zhang

专题命中视觉推理：multimodal large language model(title,abstract)；LLaVA(abstract)

Comments CoRL 2024

2407.14133 2024-09-13 cs.CL 82%

I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction

Zaiqiao Meng, Hao Zhou, Yifang Chen

专题命中视觉推理：visual language model(title,abstract)；visual reasoning(abstract)

2406.11068 2024-06-18 cs.AI cs.CV cs.LG 82%

A Unified View of Abstract Visual Reasoning Problems

Mikołaj Małkiński, Jacek Mańdziuk

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

2406.07549 2024-06-14 cs.RO 82%

A3VLM: Actionable Articulation-Aware Vision Language Model

Siyuan Huang, Haonan Chang, Yuhan Liu, Yimeng Zhu, Hao Dong, Peng Gao, Abdeslam Boularias, Hongsheng Li

专题命中视觉推理：vision language model(title,abstract)；visual reasoning(abstract)

2405.18358 2024-05-29 cs.CL cs.AI cs.CV cs.LG 82%

MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning

Somnath Kumar, Yash Gadhia, Tanuja Ganu, Akshay Nambi

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

2404.06904 2024-04-11 cs.RO 82%

Vision-Language Model-based Physical Reasoning for Robot Liquid Perception

Wenqiang Lai, Yuan Gao, Tin Lun Lam

专题命中视觉推理：vision-language model(title,abstract)；grounding(abstract)

Comments 8 pages, 6 figures, submitted to IROS 2024

2303.02506 2024-01-22 cs.LG cs.AI cs.CV 82%

Prismer: A Vision-Language Model with Multi-Task Experts

Shikun Liu, Linxi Fan, Edward Johns, Zhiding Yu, Chaowei Xiao, Anima Anandkumar

专题命中视觉推理：vision-language model(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Published at TMLR 2024. Project Page: https://shikun.io/projects/prismer Code: https://github.com/NVlabs/prismer

2301.13007 2023-07-06 cs.CV cs.AI cs.LG 82%

EuclidNet: Deep Visual Reasoning for Constructible Problems in Geometry

Man Fai Wong, Xintong Qi, Chee Wei Tan

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted by 2nd MATH-AI Workshop at NeurIPS'22

Journal ref Adv. Artif. Intell. Mach. Learn.(2023), 3(1):839-852

2205.13803 2023-04-14 cs.CV cs.AI cs.LG 82%

Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions

Huaizu Jiang, Xiaojian Ma, Weili Nie, Zhiding Yu, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments CVPR 2022 (oral); First two authors contributed equally; Code: https://github.com/NVlabs/Bongard-HOI

2202.10284 2023-02-27 cs.AI cs.CV cs.LG 82%

A Review of Emerging Research Directions in Abstract Visual Reasoning

Mikołaj Małkiński, Jacek Mańdziuk

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Journal ref Information Fusion, Volume 91, March 2023, Pages 713-736

2301.05226 2023-01-13 cs.CV cs.AI cs.CL cs.LG 82%

See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning

Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hong, Hao Zhang, Chuang Gan

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments The first two authors contributed equally to this work

2211.16492 2022-11-30 cs.CL cs.AI cs.CV cs.LG 82%

Abstract Visual Reasoning with Tangram Shapes

Anya Ji, Noriyuki Kojima, Noah Rush, Alane Suhr, Wai Keen Vong, Robert D. Hawkins, Yoav Artzi

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments EMNLP 2022 long paper

2202.12162 2022-03-01 cs.LG cs.AI cs.CV 82%

Measuring CLEVRness: Blackbox testing of Visual Reasoning Models

Spyridon Mouselinos, Henryk Michalewski, Mateusz Malinowski

专题命中视觉推理：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.AI、cs.LG

Comments ICLR 2022

2110.15358 2021-10-29 cs.CV cs.AI cs.LG 82%

Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language

Mingyu Ding, Zhenfang Chen, Tao Du, Ping Luo, Joshua B. Tenenbaum, Chuang Gan

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments NeurIPS 2021. Project page: http://vrdp.csail.mit.edu/

2012.08508 2021-10-27 cs.CV cs.AI cs.CL cs.LG 82%

Attention over learned object embeddings enables complex visual reasoning

David Ding, Felix Hill, Adam Santoro, Malcolm Reynolds, Matt Botvinick

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments 22 pages, 5 figures

2011.11603 2021-08-25 cs.CV cs.AI cs.CL cs.LG 82%

Interpretable Visual Reasoning via Induced Symbolic Space

Zhonghao Wang, Kai Wang, Mo Yu, Jinjun Xiong, Wen-mei Hwu, Mark Hasegawa-Johnson, Humphrey Shi

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments ICCV 2021

2011.13160 2021-04-05 cs.CV cs.AI cs.LG 82%

Transformation Driven Visual Reasoning

Xin Hong, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted to CVPR 2021. Resources including the TRANCE dataset and the code can be found at our homepage https://hongxin2019.github.io/TVR

2004.02673 2020-04-07 cs.CV cs.AI cs.LG cs.RO 82%

SHOP-VRB: A Visual Reasoning Benchmark for Object Perception

Michal Nazarczuk, Krystian Mikolajczyk

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments International Conference on Robotics and Automation (ICRA) 2020

1903.02741 2019-03-08 cs.CV cs.AI cs.LG 82%

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

Chi Zhang, Feng Gao, Baoxiong Jia, Yixin Zhu, Song-Chun Zhu

专题命中视觉推理：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.AI、cs.LG

Comments CVPR 2019 paper. Supplementary: http://wellyzhang.github.io/attach/cvpr19zhang_supp.pdf Project: http://wellyzhang.github.io/project/raven.html

1803.06092 2018-07-23 cs.AI cs.CV cs.LG 82%

A Dataset and Architecture for Visual Reasoning with a Working Memory

Guangyu Robert Yang, Igor Ganichev, Xiao-Jing Wang, Jonathon Shlens, David Sussillo

专题命中视觉推理：visual reasoning(title,abstract)；分类 cs.CV、cs.AI、cs.LG

1. 视觉推理 4478 篇

PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding

One Self-Configurable Model to Solve Many Abstract Visual Reasoning Problems

Multi-Label Contrastive Learning for Abstract Visual Reasoning

Pre-trained Vision-Language Models Learn Discoverable Visual Concepts

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct

RapGuard: Safeguarding Multimodal Large Language Models via Rationale-aware Defensive Prompting

Perception Tokens Enhance Visual Reasoning in Multimodal Language Models

Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios

Leveraging Vision-Language Models for Manufacturing Feature Recognition in CAD Designs

Can Multimodal Large Language Model Think Analogically?

Reasoning Grasping via Multimodal Large Language Model

I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction

A Unified View of Abstract Visual Reasoning Problems

A3VLM: Actionable Articulation-Aware Vision Language Model

MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning

Vision-Language Model-based Physical Reasoning for Robot Liquid Perception

Prismer: A Vision-Language Model with Multi-Task Experts

EuclidNet: Deep Visual Reasoning for Constructible Problems in Geometry

Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions

A Review of Emerging Research Directions in Abstract Visual Reasoning

See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning

Abstract Visual Reasoning with Tangram Shapes

Measuring CLEVRness: Blackbox testing of Visual Reasoning Models

Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language

Attention over learned object embeddings enables complex visual reasoning

Interpretable Visual Reasoning via Induced Symbolic Space

Transformation Driven Visual Reasoning

SHOP-VRB: A Visual Reasoning Benchmark for Object Perception

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

A Dataset and Architecture for Visual Reasoning with a Working Memory