视觉大模型 / VLM

GLaMM: Pixel Grounding Large Multimodal Model

Hanoona Rasheed, Muhammad Maaz, Sahal Shaji Mullappilly, Abdelrahman Shaker, Salman Khan, Hisham Cholakkal, Rao M. Anwer, Erix Xing, Ming-Hsuan Yang, Fahad S. Khan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments CVPR 2024

LLM-Optic: Unveiling the Capabilities of Large Language Models for Universal Visual Grounding

Haoyu Zhao, Wenhang Ge, Ying-cong Chen

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Project Page: https://haoyu-zhao.github.io/LLM-Optic.github.io/

Unified Hallucination Detection for Multimodal Large Language Models

Xiang Chen, Chenxi Wang, Yida Xue, Ningyu Zhang, Xiaoyan Yang, Qiang Li, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by ACL 2024 (main conference)

WorldAfford: Affordance Grounding based on Natural Language Instructions

Changmao Chen, Yuren Cong, Zhen Kan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Neurosymbolic Grounding for Compositional World Models

Atharva Sehgal, Arya Grayeli, Jennifer J. Sun, Swarat Chaudhuri

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

Comments Uploading ICLR,2024 Camera Ready Version

Which One? Leveraging Context Between Objects and Multiple Views for Language Grounding

Chancharik Mitra, Abrar Anwar, Rodolfo Corona, Dan Klein, Trevor Darrell, Jesse Thomason

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Journal ref North American Chapter of the Association for Computational Linguistics (NAACL), 2024

Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Grounding

Sunoh Kim, Jungchan Cho, Joonsang Yu, YoungJoon Yoo, Jin Young Choi

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in AAAI 2024

Grounding Foundation Models through Federated Transfer Learning: A General Framework

Yan Kang, Tao Fan, Hanlin Gu, Xiaojin Zhang, Lixin Fan, Qiang Yang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

Comments In progress

Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling

Chengxu Zhuang, Evelina Fedorenko, Jacob Andreas

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

HawkEye: Training Video-Text LLMs for Grounding Text in Videos

Yueqian Wang, Xiaojun Meng, Jianxin Liang, Yuxuan Wang, Qun Liu, Dongyan Zhao

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Leveraging Chat-Based Large Vision Language Models for Multimodal Out-Of-Context Detection

Fatma Shalabi, Hichem Felouat, Huy H. Nguyen, Isao Echizen

专题命中 视觉定位与Grounding ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 6 figures , conference

DRAGON: A Dialogue-Based Robot for Assistive Navigation with Visual Language Grounding

Shuijing Liu, Aamir Hasan, Kaiwen Hong, Runxuan Wang, Peixin Chang, Zachary Mizrachi, Justin Lin, D. Livingston McPherson, Wendy A. Rogers, Katherine Driggs-Campbell

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

Comments Published in IEEE Robotics and Automation Letters (RA-L)

VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPT

Yifang Xu, Yunzhuo Sun, Zien Xie, Benxiang Zhai, Sidan Du

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments 15 pages, 7 figures

Adversarial Testing for Visual Grounding via Image-Aware Property Reduction

Zhiyuan Chang, Mingyang Li, Junjie Wang, Cheng Li, Boyu Wu, Fanjiang Xu, Qing Wang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments 14pages, 6 figures

Softened Symbol Grounding for Neuro-symbolic Systems

Zenan Li, Yuan Yao, Taolue Chen, Jingwei Xu, Chun Cao, Xiaoxing Ma, Jian Lü

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

Comments Published as a conference paper at ICLR 2023. Code is available at https://github.com/SoftWiser-group/Soften-NeSy-learning

Grounding-Prompter: Prompting LLM with Multimodal Information for Temporal Sentence Grounding in Long Videos

Houlun Chen, Xin Wang, Hong Chen, Zihan Song, Jia Jia, Wenwu Zhu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Assessing SATNet's Ability to Solve the Symbol Grounding Problem

Oscar Chang, Lampros Flokas, Hod Lipson, Michael Spranger

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI、cs.LG

Grounding Everything: Emerging Localization Properties in Vision-Language Transformers

Walid Bousselham, Felix Petersen, Vittorio Ferrari, Hilde Kuehne

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Code available at https://github.com/WalBouss/GEM

Improved Visual Grounding through Self-Consistent Explanations

Ruozhen He, Paola Cascante-Bonilla, Ziyan Yang, Alexander C. Berg, Vicente Ordonez

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.LG

Comments Project Page: https://catherine-r-he.github.io/SelfEQ/

ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidance

Zoey Guo, Yiwen Tang, Ray Zhang, Dong Wang, Zhigang Wang, Bin Zhao, Xuelong Li

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICCV 2023. Code is released at https://github.com/Ivan-Tang-3D/ViewRefer3D

Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V

Jianwei Yang, Hao Zhang, Feng Li, Xueyan Zou, Chunyuan Li, Jianfeng Gao

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Text-Visual Prompting for Efficient 2D Temporal Video Grounding

Yimeng Zhang, Xin Chen, Jinghan Jia, Sijia Liu, Ke Ding

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to the CVPR 2023 and code released (https://github.com/intel/TVP)

Dense Object Grounding in 3D Scenes

Wencan Huang, Daizong Liu, Wei Hu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments ACM MM 2023

Perceptual Grouping in Contrastive Vision-Language Models

Kanchana Ranasinghe, Brandon McKinzie, Sachin Ravi, Yinfei Yang, Alexander Toshev, Jonathon Shlens

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted and presented at ICCV 2023

Knowing Where to Focus: Event-aware Transformer for Video Grounding

Jinhyun Jang, Jungin Park, Jin Kim, Hyeongjun Kwon, Kwanghoon Sohn

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.LG

Comments ICCV 2023. Code is available at https://github.com/jinhyunj/EaTR

Temporal Sentence Grounding in Videos: A Survey and Future Directions

Hao Zhang, Aixin Sun, Wei Jing, Joey Tianyi Zhou

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

Parallel Vertex Diffusion for Unified Visual Grounding

Zesen Cheng, Kehan Li, Peng Jin, Xiangyang Ji, Li Yuan, Chang Liu, Jie Chen

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Differentiable Parsing and Visual Grounding of Natural Language Instructions for Object Placement

Zirui Zhao, Wee Sun Lee, David Hsu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.LG

Comments To appear in ICRA 2023

Weakly-Supervised Temporal Article Grounding

Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad Ayyubi, Heng Ji, Shih-Fu Chang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments EMNLP 2022, https://github.com/zjuchenlong/WSAG

DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

Zhuo Chen, Yufeng Huang, Jiaoyan Chen, Yuxia Geng, Wen Zhang, Yin Fang, Jeff Z. Pan, Huajun Chen

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV、cs.AI

Comments AAAI 2023 (Oral). Repository: https://github.com/zjukg/DUET