视觉大模型 / VLM

Infer Human's Intentions Before Following Natural Language Instructions

Yanming Wan, Yue Wu, Yiping Wang, Jiayuan Mao, Natasha Jaques

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

DAP-LED: Learning Degradation-Aware Priors with CLIP for Joint Low-light Enhancement and Deblurring

Ling Wang, Chen Wu, Lin Wang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Transformer with Controlled Attention for Synchronous Motion Captioning

Karim Radouane, Sylvie Ranwez, Julien Lagarde, Andon Tchechmedjiev

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Open-Vocabulary Remote Sensing Image Semantic Segmentation

Qinglong Cao, Yuntian Chen, Chao Ma, Xiaokang Yang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Language-Guided World Models: A Model-Based Approach to AI Control

Alex Zhang, Khanh Nguyen, Jens Tuyls, Albert Lin, Karthik Narasimhan

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments SpLU-RoboNLP workshop at ACL 2024

GraspSplats: Efficient Manipulation with 3D Feature Splatting

Mazeyu Ji, Ri-Zhao Qiu, Xueyan Zou, Xiaolong Wang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Project webpage: https://graspsplats.github.io/

VHAKG: A Multi-modal Knowledge Graph Based on Synchronized Multi-view Videos of Daily Activities

Shusaku Egami, Takahiro Ugai, Swe Nwe Nwe Htun, Ken Fukuda

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 4 figures, accepted by CIKM2024 Resource Track

DSTI at LLMs4OL 2024 Task A: Intrinsic versus extrinsic knowledge for type classification

Hanna Abi Akl

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 4 figures, accepted for the LLMs4OL challenge at the International Semantic Web Conference (ISWC) 2024

Neural Reward Machines

Elena Umili, Francesco Argenziano, Roberto Capobianco

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Prompts

Peng Wu, Xuerong Zhou, Guansong Pang, Zhiwei Yang, Qingsen Yan, Peng Wang, Yanning Zhang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by ACMMM2024

User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance

Mrinal Verghese, Brian Chen, Hamid Eghbalzadeh, Tushar Nagarajan, Ruta Desai

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 9 pages, 4 figures

An analysis of HOI: using a training-free method with multimodal visual foundation models when only the test set is available, without the training set

Chaoyi Ai

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibili

Han Wang, Tan Rui Yang, Usman Naseem, Roy Ka-Wei Lee

专题命中 视觉定位与Grounding ：VLM(abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 3 figures, ACM Multimedia 2024

Radar Spectra-Language Model for Automotive Scene Parsing

Mariia Pushkareva, Yuri Feldman, Csaba Domokos, Kilian Rambach, Dotan Di Castro

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Laying Anchors: Semantically Priming Numerals in Language Modeling

Mandar Sharma, Rutuja Murlidhar Taware, Pravesh Koirala, Nikhil Muralidhar, Naren Ramakrishnan

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Accepted to the findings of NAACL 2024

Multimodal Guidance Network for Missing-Modality Inference in Content Moderation

Zhuokai Zhao, Harish Palani, Tianyi Liu, Lena Evans, Ruth Toner

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments ICME 2024 Camera Ready. Code is available at https://github.com/zhuokaizhao/multimodal-guidance-network

DEF-oriCORN: efficient 3D scene understanding for robust language-directed manipulation without demonstrations

Dongwon Son, Sanghyeon Son, Jaehyung Kim, Beomjoon Kim

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

How Good (Or Bad) Are LLMs at Detecting Misleading Visualizations?

Leo Yu-Ho Lo, Huamin Qu

专题命中 视觉定位与Grounding ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments To be presented at IEEE VIS 2024

OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem Alshikh, Ruslan Salakhutdinov

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

ChEX: Interactive Localization and Region Description in Chest X-rays

Philip Müller, Georgios Kaissis, Daniel Rueckert

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Accepted at ECCV 2024

Interfacing Foundation Models' Embeddings

Xueyan Zou, Linjie Li, Jianfeng Wang, Jianwei Yang, Mingyu Ding, Junyi Wei, Zhengyuan Yang, Feng Li, Hao Zhang, Shilong Liu, Arul Aravinthan, Yong Jae Lee, Lijuan Wang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments CODE: https://github.com/UX-Decoder/FIND

Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environments

Djamahl Etchegaray, Zi Huang, Tatsuya Harada, Yadan Luo

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments To appear in ECCV 2024. Source code: https://github.com/djamahl99/findnpropagate

HACMan++: Spatially-Grounded Motion Primitives for Manipulation

Bowen Jiang, Yilin Wu, Wenxuan Zhou, Chris Paxton, David Held

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Large Language Model-Augmented Auto-Delineation of Treatment Target Volume in Radiation Therapy

Praveenbalaji Rajendran, Yong Yang, Thomas R. Niedermayr, Michael Gensheimer, Beth Beadle, Quynh-Thu Le, Lei Xing, Xianjin Dai

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV、cs.AI

Agent Lumos: Unified and Modular Training for Open-Source Language Agents

Da Yin, Faeze Brahman, Abhilasha Ravichander, Khyathi Chandu, Kai-Wei Chang, Yejin Choi, Bill Yuchen Lin

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Accepted to ACL 2024 Main Conference; Camera Ready. Project website: https://allenai.github.io/lumos/

MetaCOG: A Hierarchical Probabilistic Model for Learning Meta-Cognitive Visual Representations

Marlene D. Berke, Zhangir Azerbayev, Mario Belledonne, Zenna Tavares, Julian Jara-Ettinger

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 23 pages, 7 figures, UAI 2024

Grounded Relational Inference: Domain Knowledge Driven Explainable Autonomous Driving

Chen Tang, Nishan Srishankar, Sujitha Martin, Masayoshi Tomizuka

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments 19 pages, 15 figures, IEEE Transactions on Intelligent Transportation Systems (T-ITS)

Lung-CADex: Fully automatic Zero-Shot Detection and Classification of Lung Nodules in Thoracic CT Images

Furqan Shaukat, Syed Muhammad Anwar, Abhijeet Parida, Van Khanh Lam, Marius George Linguraru, Mubarak Shah

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV、cs.LG

The Solution for the ICCV 2023 Perception Test Challenge 2023 -- Task 6 -- Grounded videoQA

Hailiang Zhang, Dian Chao, Zhihao Guan, Yang Yang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

LMDX: Language Model-based Document Information Extraction and Localization

Vincent Perot, Kai Kang, Florian Luisier, Guolong Su, Xiaoyu Sun, Ramya Sree Boppana, Zilong Wang, Zifeng Wang, Jiaqi Mu, Hao Zhang, Chen-Yu Lee, Nan Hua

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG