多模态大模型

SnAG: Scalable and Accurate Video Grounding

Fangzhou Mu, Sicheng Mo, Yin Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024. Code available at https://github.com/fmu2/snag_release

Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

Peng Jin, Ryuichi Takanobu, Wancai Zhang, Xiaochun Cao, Li Yuan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024 (Highlight)

GaitSTR: Gait Recognition with Sequential Two-stream Refinement

Wanrong Zheng, Haidong Zhu, Zhaoheng Zheng, Ram Nevatia

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Event-assisted Low-Light Video Object Segmentation

Hebei Li, Jin Wang, Jiahui Yuan, Yue Li, Wenming Weng, Yansong Peng, Yueyi Zhang, Zhiwei Xiong, Xiaoyan Sun

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2024

Leveraging YOLO-World and GPT-4V LMMs for Zero-Shot Person Detection and Action Recognition in Drone Imagery

Christian Limberg, Artur Gonçalves, Bastien Rigault, Helmut Prendinger

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 4 pages

Event Causality Is Key to Computational Story Understanding

Yidan Sun, Qin Chao, Boyang Li

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL

TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting

Defu Cao, Furong Jia, Sercan O Arik, Tomas Pfister, Yixiang Zheng, Wen Ye, Yan Liu

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CL

Comments Accepted by ICLR 2024. Camera Ready Version

Harnessing Large Language Models for Training-free Video Anomaly Detection

Luca Zanella, Willi Menapace, Massimiliano Mancini, Yiming Wang, Elisa Ricci

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2024. Project website at https://lucazanella.github.io/lavad/

Continual Learning for Smart City: A Survey

Li Yang, Zhipeng Luo, Shiming Zhang, Fei Teng, Tianrui Li

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Preprint. Work in Progress

Context-Aware Integration of Language and Visual References for Natural Language Tracking

Yanyan Shao, Shuting He, Qi Ye, Yuchao Feng, Wenhan Luo, Jiming Chen

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

Single-Model and Any-Modality for Video Object Tracking

Zongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu, Chao Ma, Danda Pani Paudel, Luc Van Gool, Radu Timofte

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

VicTR: Video-conditioned Text Representations for Activity Recognition

Kumara Kahatapitiya, Anurag Arnab, Arsha Nagrani, Michael S. Ryoo

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV

Comments To appear at CVPR 2024

Bringing Robots Home: The Rise of AI Robots in Consumer Electronics

Haiwei Dong, Yang Liu, Ted Chu, Abdulmotaleb El Saddik

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.MM

Comments Accepted by IEEE Consumer Electronics Magazine

ExpressEdit: Video Editing with Natural Language and Sketching

Bekzat Tilekbay, Saelyne Yang, Michal Lewkowicz, Alex Suryapranata, Juho Kim

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 22 pages, 5 figures, to be published in ACM IUI 2024

Exploiting Auxiliary Caption for Video Grounding

Hongxiang Li, Meng Cao, Xuxin Cheng, Zhihong Zhu, Yaowei Li, Yuexian Zou

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations

Kewei Wang, Yizheng Wu, Jun Cen, Zhiyu Pan, Xingyi Li, Zhe Wang, Zhiguo Cao, Guosheng Lin

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

ExACT: Language-guided Conceptual Reasoning and Uncertainty Estimation for Event-based Action Recognition and More

Jiazhou Zhou, Xu Zheng, Yuanhuiyi Lyu, Lin Wang

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

VideoMamba: State Space Model for Efficient Video Understanding

Kunchang Li, Xinhao Li, Yi Wang, Yinan He, Yali Wang, Limin Wang, Yu Qiao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 19 Pages, 7 Figures, 8 Tables

PASTS: Progress-Aware Spatio-Temporal Transformer Speaker For Vision-and-Language Navigation

Liuyi Wang, Chengju Liu, Zongtao He, Shu Li, Qingqing Yan, Huiyi Chen, Qijun Chen

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments 15 pages, 11 figures

Journal ref [J]. Engineering Applications of Artificial Intelligence, 2024, 128: 107487

OVEL: Large Language Model as Memory Manager for Online Video Entity Linking

Haiquan Zhao, Xuwu Wang, Shisong Chen, Zhixu Li, Xin Zheng, Yanghua Xiao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CL

Comments 13 pages, 6 figures

Navigating Hallucinations for Reasoning of Unintentional Activities

Shresth Grover, Vibhav Vineet, Yogesh S Rawat

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Multi-Sensor and Multi-temporal High-Throughput Phenotyping for Monitoring and Early Detection of Water-Limiting Stress in Soybean

Sarah E. Jones, Timilehin Ayanlade, Benjamin Fallen, Talukder Z. Jubery, Arti Singh, Baskar Ganapathysubramanian, Soumik Sarkar, Asheesh K. Singh

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 25 pages, 5 figures

Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmark

Zeyu Xi, Ge Shi, Xuefen Li, Junchi Yan, Zun Li, Lifang Wu, Zilin Liu, Liang Wang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment

Yiming Ren, Xiao Han, Chengfeng Zhao, Jingya Wang, Lan Xu, Jingyi Yu, Yuexin Ma

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024

GARNN: An Interpretable Graph Attentive Recurrent Neural Network for Predicting Blood Glucose Levels via Multivariate Time Series

Chengzhe Piao, Taiyu Zhu, Stephanie E Baldeweg, Paul Taylor, Pantelis Georgiou, Jiahao Sun, Jun Wang, Kezhi Li

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Full-Duplex Strategy for Video Object Segmentation

Ge-Peng Ji, Deng-Ping Fan, Keren Fu, Zhe Wu, Jianbing Shen, Ling Shao

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at ICCV-2021 (Journal Submission). Project Page: http://dpfan.net/FSNet/

Journal ref Comp. Visual Media 9, 155-175 (2023)

Anchorage: Visual Analysis of Satisfaction in Customer Service Videos via Anchor Events

Kam Kwai Wong, Xingbo Wang, Yong Wang, Jianben He, Rong Zhang, Huamin Qu

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.MM

Comments 13 pages. A preprint version of a publication at IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023

Follow Anything: Open-set detection, tracking, and following in real-time

Alaa Maalouf, Ninad Jadhav, Krishna Murthy Jatavallabhula, Makram Chahine, Daniel M. Vogt, Robert J. Wood, Antonio Torralba, Daniela Rus

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project webpage: https://github.com/alaamaalouf/FollowAnything Explainer video: https://www.youtube.com/watch?v=6Mgt3EPytrw

FROSTER: Frozen CLIP Is A Strong Teacher for Open-Vocabulary Action Recognition

Xiaohu Huang, Hao Zhou, Kun Yao, Kai Han

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted by ICLR 2024

GazeGPT: Augmenting Human Capabilities using Gaze-contingent Contextual AI for Smart Eyewear

Robert Konrad, Nitish Padmanaban, J. Gabriel Buckmaster, Kevin C. Boyle, Gordon Wetzstein

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project video: https://youtu.be/AuDFHHTK_m8