视觉大模型 / VLM

Dataset and Benchmark for Urdu Natural Scenes Text Detection, Recognition and Visual Question Answering

Hiba Maryam, Ling Fu, Jiajun Song, Tajrian ABM Shafayet, Qidi Luo, Xiang Bai, Yuliang Liu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by the International Conference on Document Analysis and Recognition (ICDAR) 2024

MedXChat: A Unified Multimodal Large Language Model Framework towards CXRs Understanding and Generation

Ling Yang, Zhanyu Wang, Zhenghao Chen, Xinyu Liang, Luping Zhou

专题命中 视觉问答 ：multimodal large language model(title,abstract)；分类 cs.CV

Multi-Page Document Visual Question Answering using Self-Attention Scoring Mechanism

Lei Kang, Rubèn Tito, Ernest Valveny, Dimosthenis Karatzas

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted to ICDAR2024

ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Images

Huy Quang Pham, Thang Kien-Bao Nguyen, Quan Van Nguyen, Dan Quang Tran, Nghia Hieu Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering

Cuong Nhat Ha, Shima Asaadi, Sanjeev Kumar Karn, Oladimeji Farri, Tobias Heimann, Thomas Runkler

专题命中 视觉问答 ：visual question answering(title)；vision-language model(abstract)；分类 cs.CV

Comments Clinical NLP @ NAACL 2024

LaPA: Latent Prompt Assist Model For Medical Visual Question Answering

Tiancheng Gu, Kaicheng Yang, Dongnan Liu, Weidong Cai

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 10 pages, 4 figures, Accepted by CVPRW2024

EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models

Sijie Cheng, Zhicheng Guo, Jingwen Wu, Kechen Fang, Peng Li, Huaping Liu, Yang Liu

专题命中 视觉问答 ：vision-language model(title,abstract)；分类 cs.CV

A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Japanese Questions

Shun Inadumi, Seiya Kawano, Akishige Yuguchi, Yasutomo Kawanishi, Koichiro Yoshino

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments LREC-COLING 2024

SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM

Jielin Qiu, Andrea Madotto, Zhaojiang Lin, Paul A. Crook, Yifan Ethan Xu, Xin Luna Dong, Christos Faloutsos, Lei Li, Babak Damavandi, Seungwhan Moon

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Slot-VLM: SlowFast Slots for Video-Language Modeling

Jiaqi Xu, Cuiling Lan, Wenxuan Xie, Xuejin Chen, Yan Lu

专题命中 视觉问答 ：VLM(title,abstract)；分类 cs.CV

Comments 16 pages, 10 figures

NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario

Tianwen Qian, Jingjing Chen, Linhai Zhuo, Yang Jiao, Yu-Gang Jiang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted to AAAI 2024

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

Ziyi Yin, Muchao Ye, Tianrong Zhang, Jiaqi Wang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments AAAI 2024, 11 pages

Prompt-based Personalized Federated Learning for Medical Visual Question Answering

He Zhu, Ren Togo, Takahiro Ogawa, Miki Haseyama

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accept by ICASSP2024

Improving Data Augmentation for Robust Visual Question Answering with Effective Curriculum Learning

Yuhang Zheng, Zhen Wang, Long Chen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering

Mavina Nikandrou, Lu Yu, Alessandro Suglia, Ioannis Konstas, Verena Rieser

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Object-aware Adaptive-Positivity Learning for Audio-Visual Question Answering

Zhangbin Li, Dan Guo, Jinxing Zhou, Jing Zhang, Meng Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by AAAI-2024

Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering

Chengxiang Yin, Zhengping Che, Kun Wu, Zhiyuan Xu, Jian Tang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering

Xiaojie Hong, Zixin Song, Liangzhi Li, Xiaoli Wang, Feiyan Liu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI

UIT-Saviors at MEDVQA-GI 2023: Improving Multimodal Learning with Image Enhancement for Gastrointestinal Visual Question Answering

Triet M. Thai, Anh T. Vo, Hao K. Tieu, Linh N. P. Bui, Thien T. B. Nguyen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ImageCLEF2023 published version: https://ceur-ws.org/Vol-3497/paper-129.pdf

Fine-grained Late-interaction Multi-modal Retrieval for Retrieval Augmented Visual Question Answering

Weizhe Lin, Jinghong Chen, Jingbiao Mei, Alexandru Coca, Bill Byrne

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments To appear at NeurIPS 2023. This is the camera-ready version. We fixed some numbers and added more experiments to address reviewers' comments

3D-Aware Visual Question Answering about Parts, Poses and Occlusions

Xingrui Wang, Wufei Ma, Zhuowan Li, Adam Kortylewski, Alan Yuille

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by NeurIPS2023

A Simple Baseline for Knowledge-Based Visual Question Answering

Alexandros Xenos, Themos Stafylakis, Ioannis Patras, Georgios Tzimiropoulos

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at EMNLP 2023 (camera-ready version)

MaXM: Towards Multilingual Visual Question Answering

Soravit Changpinyo, Linting Xue, Michal Yarom, Ashish V. Thapliyal, Idan Szpektor, Julien Amelot, Xi Chen, Radu Soricut

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments EMNLP 2023 (Findings). https://github.com/google-research-datasets/maxm

Open-Set Knowledge-Based Visual Question Answering with Inference Paths

Jingru Gan, Xinzhe Han, Shuhui Wang, Qingming Huang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answering

Trang Nguyen, Naoaki Okazaki

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI

On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study

Liben Chen, Long Chen, Tian Ellison-Chen, Zhuoyuan Xu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 16 pages, 11 figures

Towards Escaping from Language Bias and OCR Error: Semantics-Centered Text Visual Question Answering

Chengyang Fang, Gangyan Zeng, Yu Zhou, Daiqing Wu, Can Ma, Dayong Hu, Weiping Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Separate and Locate: Rethink the Text in Text-based Visual Question Answering

Chengyang Fang, Jiangnan Li, Liang Li, Can Ma, Dayong Hu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by ACM MM 2023

Context-VQA: Towards Context-Aware and Purposeful Visual Question Answering

Nandita Naik, Christopher Potts, Elisa Kreiss

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Proceedings of ICCV 2023 Workshop on Closing the Loop Between Vision and Language

Progressive Spatio-temporal Perception for Audio-Visual Question Answering

Guangyao Li, Wenxuan Hou, Di Hu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by ACM MM 2023