视觉大模型 / VLM

Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding

WonJun Moon, Sangeek Hyun, SuBeen Lee, Jae-Pil Heo

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments 29 pages, 15 figures, 14 tables, Code is available at https://github.com/wjun0830/CGDETR

A Refer-and-Ground Multimodal Large Language Model for Biomedicine

Xiaoshuang Huang, Haifeng Huang, Lingdong Shen, Yehui Yang, Fangxin Shang, Junwei Liu, Jia Liu

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI2024

On the Role of Visual Grounding in VQA

Daniel Reich, Tanja Schultz

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval

Weitong Cai, Jiabo Huang, Shaogang Gong, Hailin Jin, Yang Liu

专题命中 视觉定位与Grounding ：MLLM(title,abstract)；分类 cs.CV

Comments Under review

Simplify Implant Depth Prediction as Video Grounding: A Texture Perceive Implant Depth Prediction Network

Xinquan Yang, Xuguang Li, Xiaoling Luo, Leilei Zeng, Yudi Zhang, Linlin Shen, Yongqiang Deng

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Journal ref MICCAI'2024

PUMGPT: A Large Vision-Language Model for Product Understanding

Wei Xue, Zongyi Guo, Baoliang Cui, Zheng Xing, Xiaoyi Zeng, Xiufei Wang, Shuhui Wu, Weiming Lu

专题命中 视觉定位与Grounding ：vision-language model(title)；vision language model(abstract)；分类 cs.CV

CARLOR @ Ego4D Step Grounding Challenge: Bayesian temporal-order priors for test time refinement

Carlos Plou, Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Ana C. Murillo

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Dual Attribute-Spatial Relation Alignment for 3D Visual Grounding

Yue Xu, Kaizhi Yang, Jiebo Luo, Xuejin Chen

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

AutoTVG: A New Vision-language Pre-training Paradigm for Temporal Video Grounding

Xing Zhang, Jiaxi Gu, Haoyu Zhao, Shicong Wang, Hang Xu, Renjing Pei, Songcen Xu, Zuxuan Wu, Yu-Gang Jiang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Technique Report

Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics

Shan Jia, Reilin Lyu, Kangran Zhao, Yize Chen, Zhiyuan Yan, Yan Ju, Chuanbo Hu, Xin Li, Baoyuan Wu, Siwei Lyu

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.AI

DARA: Domain- and Relation-aware Adapters Make Parameter-efficient Tuning for Visual Grounding

Ting Liu, Xuyang Liu, Siteng Huang, Honggang Chen, Quanjun Yin, Long Qin, Donglin Wang, Yue Hu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted by ICME 2024 (Oral)

Text Promptable Surgical Instrument Segmentation with Vision-Language Models

Zijian Zhou, Oluwatosin Alabi, Meng Wei, Tom Vercauteren, Miaojing Shi

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Comments NeurIPS 2023

Journal ref https://proceedings.neurips.cc/paper_files/paper/2023/hash/5af741d487c5f0b08bfe56e11d1883e4-Abstract-Conference.html

Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection

Tianhe Ren, Qing Jiang, Shilong Liu, Zhaoyang Zeng, Wenlong Liu, Han Gao, Hongjie Huang, Zhengyu Ma, Xiaoke Jiang, Yihao Chen, Yuda Xiong, Hao Zhang, Feng Li, Peijun Tang, Kent Yu, Lei Zhang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments homepage: https://deepdataspace.com/home

Video sentence grounding with temporally global textual knowledge

Cai Chen, Runzhong Zhang, Jianjun Gao, Kejun Wu, Kim-Hui Yap, Yi Wang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

A Joint Study of Phrase Grounding and Task Performance in Vision and Language Models

Noriyuki Kojima, Hadar Averbuch-Elor, Yoav Artzi

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments This was published in TMLR in 2024, on January 24th

What, when, and where? -- Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions

Brian Chen, Nina Shvetsova, Andrew Rouditchenko, Daniel Kondermann, Samuel Thomas, Shih-Fu Chang, Rogerio Feris, James Glass, Hilde Kuehne

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments To be presented at CVPR 2024. Project page: https://brian7685.github.io/STG/

Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model

Jihao Dong, Renjie Pan, Hua Yang

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Talk to Parallel LiDARs: A Human-LiDAR Interaction Method Based on 3D Visual Grounding

Yuhang Liu, Boyi Sun, Guixu Zheng, Yishuo Wang, Jing Wang, Fei-Yue Wang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding

Wenrui Li, Xiaopeng Hong, Ruiqin Xiong, Xiaopeng Fan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding

Chaolei Tan, Jianhuang Lai, Wei-Shi Zheng, Jian-Fang Hu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. v2: fix a typo in figure 1

Grounding Realizable Entities

Michael Rabenberg, Carter Benson, Federico Donato, Yongqun He, Anthony Huffman, Shane Babcock, John Beverley

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI

Comments 13

Ferret-v2: An Improved Baseline for Referring and Grounding with Large Language Models

Haotian Zhang, Haoxuan You, Philipp Dufter, Bowen Zhang, Chen Chen, Hong-You Chen, Tsu-Jui Fu, William Yang Wang, Shih-Fu Chang, Zhe Gan, Yinfei Yang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Preprint. 14 pages, 4 figures

SnAG: Scalable and Accurate Video Grounding

Fangzhou Mu, Sicheng Mo, Yin Li

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Code available at https://github.com/fmu2/snag_release

WaterVG: Waterway Visual Grounding based on Text-Guided Vision and mmWave Radar

Runwei Guan, Liye Jia, Fengyufan Yang, Shanliang Yao, Erick Purwanto, Xiaohui Zhu, Eng Gee Lim, Jeremy Smith, Ka Lok Man, Xuming Hu, Yutao Yue

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments 10 pages, 10 figures

SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environments

Abhinav Rajvanshi, Karan Sikka, Xiao Lin, Bhoram Lee, Han-Pang Chiu, Alvaro Velasquez

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI

Vision-language models for decoding provider attention during neonatal resuscitation

Felipe Parodi, Jordan Matelsky, Alejandra Regla-Vargas, Elizabeth Foglia, Charis Lim, Danielle Weinberg, Konrad Kording, Heidi Herrick, Michael Platt

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Comments 9 pages, 4 figures

Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Grounding

Syed Talal Wasim, Muzammal Naseer, Salman Khan, Ming-Hsuan Yang, Fahad Shahbaz Khan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding

Zhihao Yuan, Jinke Ren, Chun-Mei Feng, Hengshuang Zhao, Shuguang Cui, Zhen Li

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2024, project website: https://curryyuan.github.io/ZSVG3D/

Exploiting Auxiliary Caption for Video Grounding

Hongxiang Li, Meng Cao, Xuxin Cheng, Zhihong Zhu, Yaowei Li, Yuexian Zou

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

GSVA: Generalized Segmentation via Multimodal Large Language Models

Zhuofan Xia, Dongchen Han, Yizeng Han, Xuran Pan, Shiji Song, Gao Huang

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2024 (19 pages, 9 figures, 11 tables)