多模态大模型

Associated Spatio-Temporal Capsule Network for Gait Recognition

Aite Zhao, Junyu Dong, Jianbo Li, Lin Qi, Huiyu Zhou

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Trying Bilinear Pooling in Video-QA

Thomas Winterbottom, Sarah Xiao, Alistair McLean, Noura Al Moubayed

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments 16 Pages, 8 Figures, 4 Tables, +Supp Mats

Movie Summarization via Sparse Graph Construction

Pinelopi Papalampidi, Frank Keller, Mirella Lapata

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments Accepted at AAAI 2021

Deep learning for video game genre classification

Yuhang Jiang, Lukun Zheng

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments 21 pages, 6 figures, 3 tables. arXiv admin note: substantial text overlap with arXiv:2011.07658

Language guided machine action

Feng Qi

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 4 figures

Scaling Laws for Autoregressive Generative Modeling

Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments 20+17 pages, 33 figures; added appendix with additional language results

CNN based Multistage Gated Average Fusion (MGAF) for Human Action Recognition Using Depth and Inertial Sensors

Zeeshan Ahmad, Naimul khan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

Comments arXiv admin note: text overlap with arXiv:1910.11482

What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets

Jianing Yang, Yuying Zhu, Yongxin Wang, Ruitao Yi, Amir Zadeh, Louis-Philippe Morency

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Video-Grounded Dialogues with Pretrained Generation Language Models

Hung Le, Steven C. H. Hoi

专题命中 视频多模态 ：audio-visual(abstract)；分类 cs.CV、cs.CL

Comments Accepted at ACL 2020 (Short Paper)

Journal ref Association for Computational Linguistics (2020) 5842-5848

Span-based Localizing Network for Natural Language Video Localization

Hao Zhang, Aixin Sun, Wei Jing, Joey Tianyi Zhou

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments To appear at ACL 2020

Retrieving and Highlighting Action with Spatiotemporal Reference

Seito Kasai, Yuchi Ishikawa, Masaki Hayashi, Yoshimitsu Aoki, Kensho Hara, Hirokatsu Kataoka

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.CL

Comments Accepted to ICIP 2020

Video Storytelling: Textual Summaries for Events

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

Comments Published in IEEE Transactions on Multimedia

Journal ref J. Li, Y. Wong, Q. Zhao and M. S. Kankanhalli, "Video Storytelling: Textual Summaries for Events," in IEEE Transactions on Multimedia, 2019

Video Object Grounding using Semantic Roles in Language Description

Arka Sadhu, Kan Chen, Ram Nevatia

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL

Comments CVPR20 camera-ready including appendix

Zero-Shot Activity Recognition with Videos

Evin Pinar Ornek

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments This is a research report done during master's studies

Language2Pose: Natural Language Grounded Pose Forecasting

Chaitanya Ahuja, Louis-Philippe Morency

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Seeing and Hearing Egocentric Actions: How Much Can We Learn?

Alejandro Cartas, Jordi Luque, Petia Radeva, Carlos Segura, Mariella Dimiccoli

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、eess.AS

Comments Accepted for the Fifth International Workshop on Egocentric Perception, Interaction and Computing (EPIC) at the International Conference on Computer Vision (ICCV) 2019

Posture and sequence recognition for Bharatanatyam dance performances using machine learning approach

Tanwi Mallick, Partha Pratim Das, Arun Kumar Majumdar

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.MM

VideoBERT: A Joint Model for Video and Language Representation Learning

Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, Cordelia Schmid

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments ICCV 2019 camera ready

ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain

Tu Bui, Daniel Cooper, John Collomosse, Mark Bell, Alex Green, John Sheridan, Jez Higgins, Arindra Das, Jared Keller, Olivier Thereaux, Alan Brown

专题命中 视频多模态 ：audio-visual(abstract)；分类 cs.CV、cs.AI

Comments Accepted to CVPR Blockchain Workshop 2019

MMED: A Multi-domain and Multi-modality Event Dataset

Zhenguo Yang, Zehang Lin, Min Cheng, Qing Li, Wenyin Liu

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.MM

Deep Learning for Human Affect Recognition: Insights and New Developments

Philipp V. Rouast, Marc T. P. Adam, Raymond Chiong

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments To be published in IEEE Transactions on Affective Computing. 20 pages, 7 figures, 6 tables

Driver Action Prediction Using Deep (Bidirectional) Recurrent Neural Network

Oluwatobi Olabiyi, Eric Martinson, Vijay Chintalapudi, Rui Guo

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments ITSC'17

A Read-Write Memory Network for Movie Story Understanding

Seil Na, Sangho Lee, Jisung Kim, Gunhee Kim

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments accepted paper at ICCV 2017

MemexQA: Visual Memex Question Answering

Lu Jiang, Junwei Liang, Liangliang Cao, Yannis Kalantidis, Sachin Farfade, Alexander Hauptmann

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments https://memexqa.cs.cmu.edu/

AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challenge

Michel Valstar, Jonathan Gratch, Bjorn Schuller, Fabien Ringeval, Denis Lalanne, Mercedes Torres Torres, Stefan Scherer, Guiota Stratou, Roddy Cowie, Maja Pantic

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.MM

Comments Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, AVEC'16, co-located with the 24th ACM International Conference on Multimedia, MM 2016, pages 3-10, Amsterdam, The Netherlands, October 2016. ACM

Detecting Violence in Video using Subclasses

Xirong Li, Yujia Huo, Jieping Xu, Qin Jin

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV、cs.MM

Fusing Multi-Stream Deep Networks for Video Classification

Zuxuan Wu, Yu-Gang Jiang, Xi Wang, Hao Ye, Xiangyang Xue, Jun Wang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

VideoStory Embeddings Recognize Events when Examples are Scarce

Amirhossein Habibian, Thomas Mensink, Cees G. M. Snoek

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

An interactive engine for multilingual video browsing using semantic content

M. Ben Halima, M. Hamroun, S. Ben Moussa, A. M. Alimi

专题命中 视频多模态 ：audio-visual(abstract)；分类 cs.CV、cs.MM

Comments 4 pages, IGS 2013 Conference; IGS 2013

Cambrian-S: Towards Spatial Supersensing in Video

Shusheng Yang, Jihan Yang, Pinzhi Huang, Ellis Brown, Zihao Yang, Yue Yu, Shengbang Tong, Zihan Zheng, Yifan Xu, Muhan Wang, Daohan Lu, Rob Fergus, Yann LeCun, Li Fei-Fei, Saining Xie

机构 * New York University（纽约大学） ； Stanford University（斯坦福大学） 纠错

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV；MLLM(comments)

Comments Website: https://cambrian-mllm.github.io/