视觉大模型 / VLM

Medical Visual Question Answering: A Survey

Zhihong Lin, Donghao Zhang, Qingyi Tao, Danli Shi, Gholamreza Haffari, Qi Wu, Mingguang He, Zongyuan Ge

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering

Yang Liu, Guanbin Li, Liang Lin

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 17 pages, 9 figures. This work has been accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). The datasets, code and models are available at https://github.com/HCPLab-SYSU/CMCIR

LiT-4-RSVQA: Lightweight Transformer-based Visual Question Answering in Remote Sensing

Leonard Hackel, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at IEEE International Geoscience and Remote Sensing Symposium 2023

Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge

Xingyu Fu, Sheng Zhang, Gukyeong Kwon, Pramuditha Perera, Henghui Zhu, Yuhao Zhang, Alexander Hanbo Li, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Dan Roth, Bing Xiang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to ACL 2023 Findings

Improving Visual Question Answering Models through Robustness Analysis and In-Context Learning with a Chain of Basic Questions

Jia-Hong Huang, Modar Alfadly, Bernard Ghanem, Marcel Worring

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 28 pages

SC-ML: Self-supervised Counterfactual Metric Learning for Debiased Visual Question Answering

Xinyao Shu, Shiyang Yan, Xu Yang, Ziheng Wu, Zhongfeng Chen, Zhenyu Lu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Transformer Module Networks for Systematic Generalization in Visual Question Answering

Moyuru Yamada, Vanessa D'Amario, Kentaro Takemoto, Xavier Boix, Tomotake Sasaki

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Polar-VQA: Visual Question Answering on Remote Sensed Ice sheet Imagery from Polar Region

Argho Sarkar, Maryam Rahnemoonfar

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Medical visual question answering using joint self-supervised learning

Yuan Zhou, Jing Mei, Yiqin Yu, Tanveer Syeda-Mahmood

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Visual Question Answering From Another Perspective: CLEVR Mental Rotation Tests

Christopher Beckham, Martin Weiss, Florian Golemo, Sina Honari, Derek Nowrouzezahrai, Christopher Pal

专题命中 视觉问答 ：visual question answering(title)；visual reasoning(abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication to Pattern Recognition journal

PiggyBack: Pretrained Visual Question Answering Environment for Backing up Non-deep Learning Professionals

Zhihao Zhang, Siwen Luo, Junyi Chen, Sijia Lai, Siqu Long, Hyunsuk Chung, Soyeon Caren Han

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by WSDM 2023

Text-Aware Dual Routing Network for Visual Question Answering

Luoqian Jiang, Yifan He, Jian Chen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection

Zhuo Chen, Yufeng Huang, Jiaoyan Chen, Yuxia Geng, Yin Fang, Jeff Pan, Ningyu Zhang, Wen Zhang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments IJCKG 2022. Repository: github.com/hackerchenzhuo/LaKo

Self-supervised vision-language pretraining for Medical visual question answering

Pengfei Li, Gang Liu, Lin Tan, Jinying Liao, Shenjun Zhong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 3 figures

MF2-MVQA: A Multi-stage Feature Fusion method for Medical Visual Question Answering

Shanshan Song, Jiangyun Li, Jing Wang, Yuanxiu Cai, Wenkai Dong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility?

Yang Trista Cao, Kyle Seelman, Kyungjun Lee, Hal Daumé

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Journal ref AACL-IJCNLP 2022 The 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing

Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning

Qingyi Si, Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Findings of EMNLP-2022

Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing

Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in SPIE Remote Sensing (ESI22R)

Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering

Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Under review. 25 pages with 4 figures

Journal ref Expert Systems with Applications, Volume 212, 2023, 118669

Recent, rapid advancement in visual question answering architecture: a review

Venkat Kodali, Daniel Berleant

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 8 pages. Accepted to EIT2022 conference and posted on ArXiv in accordance with IEEE policy

EBMs vs. CL: Exploring Self-Supervised Visual Pretraining for Visual Question Answering

Violetta Shevchenko, Ehsan Abbasnejad, Anthony Dick, Anton van den Hengel, Damien Teney

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Consistency-preserving Visual Question Answering in Medical Imaging

Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Appears in Medical Image Computing and Computer Assisted Interventions (MICCAI), 2022

Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection

Diego Garcia-Olano, Yasumasa Onoe, Joydeep Ghosh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Journal ref Proceedings of the 1st International Workshop on Multimodal Understanding for the Web and Social Media, co-located with the Web Conference 2022 (WWW '22 Companion), April 25--29, 2022, Virtual Event, Lyon, France

A Neuro-Symbolic ASP Pipeline for Visual Question Answering

Thomas Eiter, Nelson Higuera, Johannes Oetsch, Michael Pritz

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Paper presented at the 38th International Conference on Logic Programming (ICLP 2022), 15 pages

Declaration-based Prompt Tuning for Visual Question Answering

Yuhang Liu, Wei Wei, Daowan Peng, Feida Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IJCAI2022, data and codes are available at https://github.com/CCIIPLab/DPT

Regularizing Attention Networks for Anomaly Detection in Visual Question Answering

Doyup Lee, Yeongjae Cheon, Wook-Shin Han

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 16 pages, 7 figures, Accepted by AAAI-21

SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering

Vipul Gupta, Zhuowan Li, Adam Kortylewski, Chenyu Zhang, Yingwei Li, Alan Yuille

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 11 pages, Computer Vision and Pattern Recognition 2022

Dynamic Key-value Memory Enhanced Multi-step Graph Reasoning for Knowledge-based Visual Question Answering

Mingxiao Li, Marie-Francine Moens

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering

Ankur Sikarwar, Gabriel Kreiman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Language bias in Visual Question Answering: A Survey and Taxonomy

Desen Yuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages