视觉大模型 / VLM

Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Models

Tom van Sonsbeek, Mohammad Mahdi Derakhshani, Ivona Najdenkoska, Cees G. M. Snoek, Marcel Worring

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Localized Questions in Medical Visual Question Answering

Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Appears in Medical Image Computing and Computer Assisted Interventions (MICCAI), 2023

Pre-Training Multi-Modal Dense Retrievers for Outside-Knowledge Visual Question Answering

Alireza Salemi, Mahta Rafiee, Hamed Zamani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Improving Selective Visual Question Answering by Learning from Your Peers

Corentin Dancette, Spencer Whitehead, Rishabh Maheshwary, Ramakrishna Vedantam, Stefan Scherer, Xinlei Chen, Matthieu Cord, Marcus Rohrbach

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments CVPR 2023. Code available here: https://github.com/facebookresearch/selective-vqa_ood

Overcoming Language Bias in Remote Sensing Visual Question Answering via Adversarial Training

Zhenghang Yuan, Lichao Mou, Xiao Xiang Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Zero-shot Visual Question Answering with Language Model Feedback

Yifan Du, Junyi Li, Tianyi Tang, Wayne Xin Zhao, Ji-Rong Wen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by ACL2023 findings

Comprehensive Visual Question Answering on Point Clouds through Compositional Scene Manipulation

Xu Yan, Zhihao Yuan, Yuhao Du, Yinghong Liao, Yao Guo, Zhen Li, Shuguang Cui

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Is GPT-3 all you need for Visual Question Answering in Cultural Heritage?

Pietro Bongini, Federico Becattini, Alberto Del Bimbo

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Bilaterally Slimmable Transformer for Elastic and Efficient Visual Question Answering

Zhou Yu, Zitian Jin, Jun Yu, Mingliang Xu, Hongbo Wang, Jianping Fan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at IEEE Transactions on Multimedia, 2023. Code available at https://github.com/MILVLG/bst

A Symmetric Dual Encoding Dense Retrieval Framework for Knowledge-Intensive Visual Question Answering

Alireza Salemi, Juan Altmayer Pizzorno, Hamed Zamani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Multilingual Augmentation for Robust Visual Question Answering in Remote Sensing Images

Zhenghang Yuan, Lichao Mou, Xiao Xiang Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments This paper was submitted to the JURSE 2023 conference on November 5, 2022

FVQA 2.0: Introducing Adversarial Samples into Fact-based Visual Question Answering

Weizhe Lin, Zhilin Wang, Bill Byrne

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted to EACL 2023 Findings

Logical Implications for Visual Question Answering Consistency

Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Interpretable Visual Question Answering Referring to Outside Knowledge

He Zhu, Ren Togo, Takahiro Ogawa, Miki Haseyama

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Under review

RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training

Zheng Yuan, Qiao Jin, Chuanqi Tan, Zhengyun Zhao, Hongyi Yuan, Fei Huang, Songfang Huang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning

Xinyue Hu, Lin Gu, Kazuma Kobayashi, Qiyuan An, Qingyu Chen, Zhiyong Lu, Chang Su, Tatsuya Harada, Yingying Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answering

Tatsuro Yamane, Pang-jo Chun, Ji Dang, Takayuki Okatani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

HRVQA: A Visual Question Answering Benchmark for High-Resolution Aerial Images

Kun Li, George Vosselman, Michael Ying Yang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images

Ryota Tanaka, Kyosuke Nishida, Kosuke Nishida, Taku Hasegawa, Itsumi Saito, Kuniko Saito

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by AAAI2023

Multimodal Inverse Cloze Task for Knowledge-based Visual Question Answering

Paul Lerner, Olivier Ferret, Camille Guinaudeau

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Comments Accepted at ECIR 2023

Change Detection Meets Visual Question Answering

Zhenghang Yuan, Lichao Mou, Zhitong Xiong, Xiaoxiang Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

CL-CrossVQA: A Continual Learning Benchmark for Cross-Domain Visual Question Answering

Yao Zhang, Haokun Chen, Ahmed Frikha, Yezi Yang, Denis Krompass, Gengyuan Zhang, Jindong Gu, Volker Tresp

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 10 pages, 6 figures

VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at WACV 2023. For code and supplementary material, see https://github.com/aditya10/VLC-BERT

Entity-Focused Dense Passage Retrieval for Outside-Knowledge Visual Question Answering

Jialin Wu, Raymond J. Mooney

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments EMNLP 2022

Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly

Spencer Whitehead, Suzanne Petryk, Vedaad Shakib, Joseph Gonzalez, Trevor Darrell, Anna Rohrbach, Marcus Rohrbach

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ECCV 2022. Code and models are available here: https://github.com/facebookresearch/reliable_vqa

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2022

Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline

Lichen Zhao, Daigang Cai, Jing Zhang, Lu Sheng, Dong Xu, Rui Zheng, Yinjie Zhao, Lipeng Wang, Xibo Fan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 10 figures

Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances

Yike Wu, Yu Zhao, Shiwan Zhao, Ying Zhang, Xiaojie Yuan, Guoqing Zhao, Ning Jiang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Published in COLING 2022

Aesthetic Visual Question Answering of Photographs

Xin Jin, Wu Zhou, Xinghui Zhou, Shuai Cui, Le Zhang, Jianwen Lv, Shu Zhao

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 7 figures, on going research

Semantic-aware Modular Capsule Routing for Visual Question Answering

Yudong Han, Jianhua Yin, Jianlong Wu, Yinwei Wei, Liqiang Nie

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 12 pages, 4 figures, submitted to IEEE Transactions on Image Processing