视觉大模型 / VLM

Focal Visual-Text Attention for Visual Question Answering

Junwei Liang, Lu Jiang, Liangliang Cao, Li-Jia Li, Alexander Hauptmann

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments In CVPR 2018. Code, models and dataset are available here: https://memexqa.cs.cmu.edu/

Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answering

Zhou Yu, Jun Yu, Chenchao Xiang, Jianping Fan, Dacheng Tao

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 9 figures. arXiv admin note: substantial text overlap with arXiv:1708.01471

Journal ref IEEE Transactions On Neural Networks And Learning Systems, Vol. 26, No. 10, October 2015, Pp. 2275-2290

Quantifying and Alleviating the Language Prior Problem in Visual Question Answering

Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yibing Liu, Yinglong Wang, Mohan Kankanhalli

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Answer Them All! Toward Universal Visual Question Answering Models

Robik Shrestha, Kushal Kafle, Christopher Kanan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 8 pages

Generating Natural Language Explanations for Visual Question Answering using Scene Graphs and Visual Attention

Shalini Ghosh, Giedrius Burachas, Arijit Ray, Avi Ziskind

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI

Cycle-Consistency for Robust Visual Question Answering

Meet Shah, Xinlei Chen, Marcus Rohrbach, Devi Parikh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Technical Report

BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection

Hedi Ben-younes, Rémi Cadene, Nicolas Thome, Matthieu Cord

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Improved Fusion of Visual and Language Representations by Dense Symmetric Co-Attention for Visual Question Answering

Duy-Kien Nguyen, Takayuki Okatani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments In Proceeding of CVPR'2018

Visual Question Answering as Reading Comprehension

Hui Li, Peng Wang, Chunhua Shen, Anton van den Hengel

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Explicit Bias Discovery in Visual Question Answering Models

Varun Manjunatha, Nirat Saini, Larry S. Davis

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering

Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted to NIPS 2018

Learning Conditioned Graph Structures for Interpretable Visual Question Answering

Will Norcliffe-Brown, Efstathios Vafeias, Sarah Parisot

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments NIPS 2018 (13 pages, 7 figures)

Knowing Where to Look? Analysis on Attention of Visual Question Answering System

Wei Li, Zehuan Yuan, Xiangzhong Fang, Changhu Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ECCV SiVL Workshop paper

Textually Enriched Neural Module Networks for Visual Question Answering

Khyathi Raghavi Chandu, Mary Arpita Pyreddy, Matthieu Felix, Narendra Nath Joshi

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Learning Convolutional Text Representations for Visual Question Answering

Zhengyang Wang, Shuiwang Ji

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Comments Conference paper at SDM 2018. https://github.com/divelab/svae

Journal ref In proceedings of the 2018 SIAM International Conference on Data Mining (pp. 594-602). 2018

On the Flip Side: Identifying Counterexamples in Visual Question Answering

Gabriel Grand, Aron Szanto, Yoon Kim, Alexander Rush

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments KDD 2018 conference version

Question Relevance in Visual Question Answering

Prakruthi Prabhakar, Nitish Kulkarni, Linghao Zhang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Question Type Guided Attention in Visual Question Answering

Yang Shi, Tommaso Furlanello, Sheng Zha, Animashree Anandkumar

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Learning Visual Knowledge Memory Networks for Visual Question Answering

Zhou Su, Chen Zhu, Yinpeng Dong, Dongqi Cai, Yurong Chen, Jianguo Li

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Supplementary to CVPR 2018 version

Cross-Dataset Adaptation for Visual Question Answering

Wei-Lun Chao, Hexiang Hu, Fei Sha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2018

Learning Answer Embeddings for Visual Question Answering

Hexiang Hu, Wei-Lun Chao, Fei Sha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2018

Visual Question Answering with Memory-Augmented Networks

Chao Ma, Chunhua Shen, Anthony Dick, Qi Wu, Peng Wang, Anton van den Hengel, Ian Reid

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments CVPR 2018

Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering

Somak Aditya, Yezhou Yang, Chitta Baral

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 9 pages, 3 figures, AAAI 2018

Inverse Visual Question Answering: A New Benchmark and VQA Diagnosis Tool

Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:1710.03370

iVQA: Inverse Visual Question Answering

Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments CVPR18 Spotlight

Learning to Count Objects in Natural Images for Visual Question Answering

Yan Zhang, Jonathon Hare, Adam Prügel-Bennett

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Published in ICLR 2018

Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions

Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Structured Triplet Learning with POS-tag Guided Attention for Visual Question Answering

Zhe Wang, Xiaoyi Liu, Liangjian Chen, Limin Wang, Yu Qiao, Xiaohui Xie, Charless Fowlkes

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 8 pages, 5 figures, state-of-the-art VQA system; https://github.com/wangzheallen/STL-VQA

TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering

Yunseok Jang, Yale Song, Youngjae Yu, Youngjin Kim, Gunhee Kim

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted paper at CVPR 2017 (Spotlight)

Visual Question Answering as a Meta Learning Task

Damien Teney, Anton van den Hengel

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV