多模态大模型

Modeling Explicit Concerning States for Reinforcement Learning in Visual Dialogue

Zipeng Xu, Fandong Meng, Xiaojie Wang, Duo Zheng, Chenxu Lv, Jie Zhou

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments In BMVC 2021

DVCFlow: Modeling Information Flow Towards Human-like Video Captioning

Xu Yan, Zhengcong Fei, Shuhui Wang, Qingming Huang, Qi Tian

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

PyTorchVideo: A Deep Learning Library for Video Understanding

Haoqi Fan, Tullie Murrell, Heng Wang, Kalyan Vasudev Alwala, Yanghao Li, Yilei Li, Bo Xiong, Nikhila Ravi, Meng Li, Haichuan Yang, Jitendra Malik, Ross Girshick, Matt Feiszli, Aaron Adcock, Wan-Yen Lo, Christoph Feichtenhofer

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Technical report

Video Sentiment Analysis with Bimodal Information-augmented Multi-Head Attention

Ting Wu, Junjie Peng, Wenqiang Zhang, Huiran Zhang, Chuanshuai Ma, Yansong Huang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 12 pages, 4 figures, content and journal information updated

Journal ref Knowledge Based Systems 235 (2022) 107676

Towards Privacy-Preserving Affect Recognition: A Two-Level Deep Learning Architecture

Jimiama M. Mase, Natalie Leesakul, Fan Yang, Grazziela P. Figueredo, Mercedes Torres Torres

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, 6 figures, 4 tables

How does a Pre-Trained Transformer Integrate Contextual Keywords? Application to Humanitarian Computing

Barriere Valentin, Jacquet Guillaume

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL

Comments Oral ISCRAM2021

Technical Report: Disentangled Action Parsing Networks for Accurate Part-level Action Parsing

Xuanhan Wang, Xiaojia Chen, Lianli Gao, Lechao Chen, Jingkuan Song

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Sequence-to-Sequence Modeling for Action Identification at High Temporal Resolution

Aakash Kaku, Kangning Liu, Avinash Parnandi, Haresh Rengaraj Rajamohan, Kannan Venkataramanan, Anita Venkatesan, Audre Wirtanen, Natasha Pandit, Heidi Schambra, Carlos Fernandez-Granda

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Under review as a conference paper at ICLR 2022

CCVS: Context-aware Controllable Video Synthesis

Guillaume Le Moing, Jean Ponce, Cordelia Schmid

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2021

Invertible Frowns: Video-to-Video Facial Emotion Translation

Ian Magnusson, Aruna Sankaranarayanan, Andrew Lippman

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 9 pages, 2 figures, 4 tables, accepted at ADGD @ ACM Multimedia 2021

Quantified Facial Expressiveness for Affective Behavior Analytics

Md Taufeeq Uddin, Shaun Canavan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). 2022

Digital Taxonomist: Identifying Plant Species in Community Scientists' Photographs

Riccardo de Lutio, Yihang She, Stefano D'Aronco, Stefania Russo, Philipp Brun, Jan D. Wegner, Konrad Schindler

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted for publication in the ISPRS Journal of Photogrammetry and Remote Sensing

Self-Supervised Action-Space Prediction for Automated Driving

Faris Janjoš, Maxim Dolgov, J. Marius Zöllner

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Merchant Category Identification Using Credit Card Transactions

Chin-Chia Michael Yeh, Zhongfang Zhuang, Yan Zheng, Liang Wang, Junpeng Wang, Wei Zhang

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 9 pages

Object Tracking by Jointly Exploiting Frame and Event Domain

Jiqing Zhang, Xin Yang, Yingkai Fu, Xiaopeng Wei, Baocai Yin, Bo Dong

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Learning to Combine the Modalities of Language and Video for Temporal Moment Localization

Jungkyoo Shin, Jinyoung Moon

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

What Matters for Ad-hoc Video Search? A Large-scale Evaluation on TRECVID

Aozhu Chen, Fan Hu, Zihan Wang, Fangming Zhou, Xirong Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.MM

Comments Accepted by ViRal'21@ICCV 2021

DanceIt: Music-inspired Dancing Video Synthesis

Xin Guo, Yifan Zhao, Jia Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments 14 pages, 20 figures. [J]. IEEE Transactions on Image Processing, 2021

Tensor Representations for Action Recognition

Piotr Koniusz, Lei Wang, Anoop Cherian

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Published with TPAMI, 2020. arXiv admin note: text overlap with arXiv:1604.00239

Learning Video Representations from Textual Web Supervision

Jonathan C. Stroud, Zhichao Lu, Chen Sun, Jia Deng, Rahul Sukthankar, Cordelia Schmid, David A. Ross

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Support-Set Based Cross-Supervision for Video Grounding

Xinpeng Ding, Nannan Wang, Shiwei Zhang, De Cheng, Xiaomeng Li, Ziyuan Huang, Mingqian Tang, Xinbo Gao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ICCV 2021

Feature-Supervised Action Modality Transfer

Fida Mohammad Thoker, Cees G. M. Snoek

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments IEEE International Conference on Pattern Recognition (ICPR), 2020

Bifold and Semantic Reasoning for Pedestrian Behavior Prediction

Amir Rasouli, Mohsen Rohani, Jun Luo

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments ICCV 2021. 11 pages; 5 Figures; 5 tables

AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Prediction

Alessia Bertugli, Simone Calderara, Pasquale Coscia, Lamberto Ballan, Rita Cucchiara

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at Computer Vision and Image Understanding (CVIU)

Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition

Yang Liu, Keze Wang, Guanbin Li, Liang Lin

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments This paper focuses on the sensor-to-vision heterogenous action recognition problem. Code is available at https://github.com/YangLiu9208/SAKDN

Zeroth-Order Supervised Policy Improvement

Hao Sun, Ziping Xu, Yuhang Song, Meng Fang, Jiechao Xiong, Bo Dai, Bolei Zhou

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

EPIC-KITCHENS-100 Unsupervised Domain Adaptation Challenge for Action Recognition 2021: Team M3EM Technical Report

Lijin Yang, Yifei Huang, Yusuke Sugano, Yoichi Sato

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Weakly Supervised Temporal Adjacent Network for Language Grounding

Yuechen Wang, Jiajun Deng, Wengang Zhou, Houqiang Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Multimedia, 2021

Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion

Amirreza Farnoosh, Sarah Ostadabbas

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

A Novel Graph based Trajectory Predictor with Pseudo Oracle

Biao Yang, Guocheng Yan, Pin Wang, Chingyao Chan, Xiang Song, Yang Chen

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 17 apges, 8 figures

Journal ref already published by TNNLS 2021