多模态大模型

Look, Remember and Reason: Grounded reasoning in videos with language models

Apratim Bhattacharyya, Sunny Panchal, Mingu Lee, Reza Pourreza, Pulkit Madan, Roland Memisevic

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments To appear at ICLR 2024

Dual-Branched Spatio-temporal Fusion Network for Multi-horizon Tropical Cyclone Track Forecast

Zili Liu, Kun Hao, Xiaoyi Geng, Zhenwei Shi

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

EZ-CLIP: Efficient Zeroshot Video Action Recognition

Shahzad Ahmad, Sukalpa Chanda, Yogesh S Rawat

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV

Instance Brownian Bridge as Texts for Open-vocabulary Video Instance Segmentation

Zesen Cheng, Kehan Li, Hao Li, Peng Jin, Chang Liu, Xiawu Zheng, Rongrong Ji, Jie Chen

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV

CLIPRerank: An Extremely Simple Method for Improving Ad-hoc Video Search

Aozhu Chen, Fangming Zhou, Ziyuan Wang, Xirong Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.MM

Comments Accepted by ICASSP 2024

Jump Cut Smoothing for Talking Heads

Xiaojuan Wang, Taesung Park, Yang Zhou, Eli Shechtman, Richard Zhang

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Correct typos in the caption of Figure 1; Change the project website address. Project page: https://jeanne-wang.github.io/jumpcutsmoothing/

Predicting the Skies: A Novel Model for Flight-Level Passenger Traffic Forecasting

Sina Ehsani, Elina Sergeeva, Wendy Murdy, Benjamin Fox

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 9 pages, 6 figures, to be published

Two-stream joint matching method based on contrastive learning for few-shot action recognition

Long Deng, Ziqiang Li, Bingxin Zhou, Zhongming Chen, Ao Li, Yongxin Ge

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

G2L: Semantically Aligned and Uniform Video Grounding via Geodesic and Game Theory

Hongxiang Li, Meng Cao, Xuxin Cheng, Yaowei Li, Zhihong Zhu, Yuexian Zou

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments ICCV2023 oral, release the code

Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues

Zitong Yu, Rizhao Cai, Zhi Li, Wenhan Yang, Jingang Shi, Alex C. Kot

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Dependable and Secure Computing (TDSC). Corresponding authors: Zitong Yu and Wenhan Yang

Language-Assisted Deep Learning for Autistic Behaviors Recognition

Andong Deng, Taojiannan Yang, Chen Chen, Qian Chen, Leslie Neely, Sakiko Oyama

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Smart Health Journal

Explore Human Parsing Modality for Action Recognition

Jinfu Liu, Runwei Ding, Yuhang Wen, Nan Dai, Fanyang Meng, Shen Zhao, Mengyuan Liu

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2307.07977

On Time-Indexing as Inductive Bias in Deep RL for Sequential Manipulation Tasks

M. Nomaan Qureshi, Ben Eisner, David Held

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Glance and Focus: Memory Prompting for Multi-Event Video Question Answering

Ziyi Bai, Ruiping Wang, Xilin Chen

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted in NeurIPS 2023

HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

Yilan Dong, Chunlin Yu, Ruiyang Ha, Ye Shi, Yuexin Ma, Lan Xu, Yanwei Fu, Jingya Wang

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Event-based Shape from Polarization with Spiking Neural Networks

Peng Kang, Srutarshi Banerjee, Henry Chopp, Aggelos Katsaggelos, Oliver Cossairt

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 25 pages

Open-Vocabulary Video Relation Extraction

Wentao Tian, Zheng Wang, Yuqian Fu, Jingjing Chen, Lechao Cheng

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments accpeted by AAAI 2024

Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrieval

Zhihang Liu, Jun Li, Hongtao Xie, Pandeng Li, Jiannan Ge, Sun-Ao Liu, Guoqing Jin

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to AAAI 2024

Multimodality in Online Education: A Comparative Study

Praneeta Immadisetty, Pooja Rajesh, Akshita Gupta, Anala M R, Soumya A, K. N. Subramanya

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Hierarchical Graph Pattern Understanding for Zero-Shot VOS

Gensheng Pei, Fumin Shen, Yazhou Yao, Tao Chen, Xian-Sheng Hua, Heng-Tao Shen

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments accepted by IEEE Transactions on Image Processing

Journal ref IEEE Transactions on Image Processing 2023

Generative Model-based Feature Knowledge Distillation for Action Recognition

Guiqin Wang, Peng Zhao, Yanjiang Shi, Cong Zhao, Shusen Yang

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted on AAAI2024

District-scale surface temperatures generated from high-resolution longitudinal thermal infrared images

Subin Lin, Vasantha Ramani, Miguel Martin, Pandarasamy Arjunan, Adrian Chong, Filip Biljecki, Marcel Ignatius, Kameshwar Poolla, Clayton Miller

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Journal ref Sci Data 10, 859 (2023)

Leveraging Generative Language Models for Weakly Supervised Sentence Component Analysis in Video-Language Joint Learning

Zaber Ibn Abdul Hakim, Najibul Haque Sarker, Rahul Pratap Singh, Bishmoy Paul, Ali Dabouei, Min Xu

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Early Action Recognition with Action Prototypes

Guglielmo Camporese, Alessandro Bergamo, Xunyu Lin, Joseph Tighe, Davide Modolo

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2023): Workshop and Shared Task Report

Ali Hürriyetoğlu, Hristo Tanev, Osman Mutlu, Surendrabikram Thapa, Fiona Anting Tan, Erdem Yörük

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL

Comments https://aclanthology.org/2023.case-1.22

Consistency Prototype Module and Motion Compensation for Few-Shot Action Recognition (CLIP-CP$\mathbf{M^2}$C)

Fei Guo, Li Zhu, YiKang Wang, Han Qi

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Zero-Shot Video Question Answering with Procedural Programs

Rohan Choudhury, Koichiro Niinuma, Kris M. Kitani, László A. Jeni

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 16 pages, 7 figures

LEAP: LLM-Generation of Egocentric Action Programs

Eadom Dessalene, Michael Maynord, Cornelia Fermüller, Yiannis Aloimonos

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Dataset: https://drive.google.com/drive/folders/1Cpkw_TI1IIxXdzor0pOXG3rWJWuKU5Ex?usp=drive_link

Object-based (yet Class-agnostic) Video Domain Adaptation

Dantong Niu, Amir Bar, Roei Herzig, Trevor Darrell, Anna Rohrbach

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Sketch-based Video Object Localization

Sangmin Woo, So-Yeong Jeon, Jinyoung Park, Minji Son, Sumin Lee, Changick Kim

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments WACV 2024; Code: https://github.com/sangminwoo/SVOL