视觉大模型 / VLM

Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation

Bohan Lyu, Yadi Cao, Duncan Watson-Parris, Leon Bergen, Taylor Berg-Kirkpatrick, Rose Yu

机构 * Tsinghua University（清华大学） ； University of California, San Diego（加州大学圣地亚哥分校） 纠错

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments 37 pages, 16 figures

Journal ref In Proceedings of the Forty-second International Conference on Machine Learning (ICML 2025)

LogicQA: Logical Anomaly Detection with Vision Language Model Generated Questions

Yejin Kwon, Daeun Moon, Youngje Oh, Hyunsoo Yoon

机构 * Department of Industrial Engineering, Yonsei University（工业工程系，延世大学） 纠错

专题命中 视觉定位与Grounding ：vision language model(title)；分类 cs.CV、cs.AI

Comments Accepted Industry Track at ACL 2025

Evaluating Vision Language Models (VLMs) for Radiology: A Comprehensive Analysis

Frank Li, Hari Trivedi, Bardia Khosravi, Theo Dapamede, Mohammadreza Chavoshi, Abdulhameed Dere, Rohan Satya Isaac, Aawez Mansuri, Janice Newsome, Saptarshi Purkayastha, Judy Gichoya

专题命中 视觉定位与Grounding ：vision language model(title)；分类 cs.CV、cs.AI

VocalEyes: Enhancing Environmental Perception for the Visually Impaired through Vision-Language Models and Distance-Aware Object Detection

Kunal Chavan, Keertan Balaji, Spoorti Barigidad, Samba Raju Chiluveru

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.LG

Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models

Deval Mehta, Yiwen Jiang, Catherine L Jan, Mingguang He, Kshitij Jadhav, Zongyuan Ge

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

Comments Accepted to Information Processing in Medical Imaging (IPMI) 2025

Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding

Xin Gu, Yaojie Shen, Chenxi Luo, Tiejian Luo, Yan Huang, Yuewei Lin, Heng Fan, Libo Zhang

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

Self-adaptive vision-language model for 3D segmentation of pulmonary artery and vein

Xiaotong Guo, Deqian Yang, Dan Wang, Haochen Zhao, Yuan Li, Zhilin Sui, Tao Zhou, Lijun Zhang, Yanda Meng

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

Comments 8 pages,3 figures

Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval

Sheryl Hsu, Omar Khattab, Chelsea Finn, Archit Sharma

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Grounding Language in Multi-Perspective Referential Communication

Zineng Tang, Lingjun Mao, Alane Suhr

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

Comments Accepted to EMNLP2024 Main

Individuation in Neural Models with and without Visual Grounding

Alexey Tikhonov, Lisa Bylinina, Ivan P. Yamshchikov

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Grounding Language Models in Autonomous Loco-manipulation Tasks

Jin Wang, Nikos Tsagarakis

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments Summit to ICRA@40. arXiv admin note: substantial text overlap with arXiv:2406.14655

Evaluating Vision-Language Models for Zero-Shot Detection, Classification, and Association of Motorcycles, Passengers, and Helmets

Lucas Choi, Ross Greer

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

V-IRL: Grounding Virtual Intelligence in Real Life

Jihan Yang, Runyu Ding, Ellis Brown, Xiaojuan Qi, Saining Xie

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

Comments Project page: https://virl-platform.github.io

Augmented Commonsense Knowledge for Remote Object Grounding

Bahram Mohammadi, Yicong Hong, Yuankai Qi, Qi Wu, Shirui Pan, Javen Qinfeng Shi

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

IVLMap: Instance-Aware Visual Language Grounding for Consumer Robot Navigation

Jiacui Huang, Hongtao Zhang, Mingbo Zhao, Zhou Wu

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

The Potential of Vision-Language Models for Content Moderation of Children's Videos

Syed Hammad Ahmed, Shengnan Hu, Gita Sukthankar

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.LG

Comments 5 pages, 1 figure. Accepted at IEEE ICMLA 2023

The Contemporary Art of Image Search: Iterative User Intent Expansion via Vision-Language Model

Yilin Ye, Qian Zhu, Shishi Xiao, Kang Zhang, Wei Zeng

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

Comments Accepted by The 2024 ACM SIGCHI Conference on Computer-Supported Cooperative Work & Social Computing (CSCW) (Proc. CSCW 2024)

ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection

Thinh Phan, Khoa Vo, Duy Le, Gianfranco Doretto, Donald Adjeroh, Ngan Le

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

Suspected Object Matters: Rethinking Model's Prediction for One-stage Visual Grounding

Yang Jiao, Zequn Jie, Jingjing Chen, Lin Ma, Yu-Gang Jiang

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

Comments Accepted to ACM MM 23

IMAGINATOR: Pre-Trained Image+Text Joint Embeddings using Word-Level Grounding of Images

Varuna Krishna, S Suryavardan, Shreyash Mishra, Sathyanarayanan Ramamoorthy, Parth Patwa, Megha Chakraborty, Aman Chadha, Amitava Das, Amit Sheth

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.AI

WEDGE: A multi-weather autonomous driving dataset built from generative vision-language models

Aboli Marathe, Deva Ramanan, Rahee Walambe, Ketan Kotecha

专题命中 视觉定位与Grounding ：vision-language model(title)；分类 cs.CV、cs.AI

Comments Accepted in Vision Datasets Understanding at CVPR 2023

Grounding Visual Representations with Texts for Domain Generalization

Seonwoo Min, Nokyung Park, Siwon Kim, Seunghyun Park, Jinkyu Kim

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.LG

Comments ECCV 2022; 25 pages (including Supplementary Materials); Updated related works

Retrieve, Caption, Generate: Visual Grounding for Enhancing Commonsense in Text Generation Models

Steven Y. Feng, Kevin Lu, Zhuofu Tao, Malihe Alikhani, Teruko Mitamura, Eduard Hovy, Varun Gangal

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments Accepted to AAAI 2022. Code at https://github.com/styfeng/VisCTG

Neural-Symbolic Integration for Interactive Learning and Conceptual Grounding

Benedikt Wagner, Artur d'Avila Garcez

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments Corrected references

Journal ref 1st Workshop on Human and Machine Decisions (WHMD 2021), NeurIPS 2021

Grounding Psychological Shape Space in Convolutional Neural Networks

Lucas Bechberger, Kai-Uwe Kühnberger

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.LG

Comments accepted at CIFMA2021 (https://cifma.github.io/)

Embodied Language Grounding with 3D Visual Feature Representations

Mihir Prabhudesai, Hsiao-Yu Fish Tung, Syed Ashar Javed, Maximilian Sieb, Adam W. Harley, Katerina Fragkiadaki

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.LG

Journal ref Conference on Computer Vision and Pattern Recognition. 2020, pp. 2220-2229

MAF: Multimodal Alignment Framework for Weakly-Supervised Phrase Grounding

Qinxin Wang, Hao Tan, Sheng Shen, Michael W. Mahoney, Zhewei Yao

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.CV、cs.LG

Grounding Language for Transfer in Deep Reinforcement Learning

Karthik Narasimhan, Regina Barzilay, Tommi Jaakkola

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments JAIR 2018

Grounding the Experience of a Visual Field through Sensorimotor Contingencies

Alban Laflaquière

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments 23 pages, 7 figures, published in Neurocomputing

Journal ref Neurocomputing, Volume 268, 13 December 2017, Pages 142-152

Grounding Perception: A Developmental Approach to Sensorimotor Contingencies

Alban Laflaquière, Nikolas Hemion, Michaël Garcia Ortiz, Jean-Christophe Baillie

专题命中 视觉定位与Grounding ：grounding(title)；分类 cs.AI、cs.LG

Comments 8 pages, 4 figures, workshop at IROS 2015 conference