多模态大模型

ViMGuard: A Novel Multi-Modal System for Video Misinformation Guarding

Andrew Kan, Christopher Kan, Zaid Nabulsi

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CL

Comments 7 pages, 2 figures

MMUTF: Multimodal Multimedia Event Argument Extraction with Unified Template Filling

Philipp Seeberger, Dominik Wagner, Korbinian Riedhammer

专题命中 视频多模态 ：multimodal(title)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2024

Multimodal Power Outage Prediction for Rapid Disaster Response and Resource Allocation

Alejandro Aparcedo, Christian Lopez, Abhinav Kotta, Mengjie Li

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 7 pages, 4 figures, 1 table

Detecting Calls to Action in Multimodal Content: Analysis of the 2021 German Federal Election Campaign on Instagram

Michael Achmann-Denkler, Jakob Fehle, Mario Haim, Christian Wolff

专题命中 视频多模态 ：multimodal(title)；分类 cs.CL

Comments Accepted Archival Paper for the CPSS Workshop at KONVENS 2024. Camera Ready Submission

CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring

Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Accepted in ECCV2024

InternVideo2: Scaling Foundation Models for Multimodal Video Understanding

Yi Wang, Kunchang Li, Xinhao Li, Jiashuo Yu, Yinan He, Chenting Wang, Guo Chen, Baoqi Pei, Ziang Yan, Rongkun Zheng, Jilan Xu, Zun Wang, Yansong Shi, Tianxiang Jiang, Songze Li, Hongjie Zhang, Yifei Huang, Yu Qiao, Yali Wang, Limin Wang

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments a technical report about video understanding (accepted to ECCV2024)

PUDD: Towards Robust Multi-modal Prototype-based Deepfake Detection

Alvaro Lopez Pellcier, Yi Li, Plamen Angelov

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments CVPR2024

Journal ref CVPR2024

StreamingFlow: Streaming Occupancy Forecasting with Asynchronous Multi-modal Data Streams via Neural Ordinary Differential Equation

Yining Shi, Kun Jiang, Ke Wang, Jiusi Li, Yunlong Wang, Mengmeng Yang, Diange Yang

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments cvpr2024 poster (highlight), code at https://github.com/synsin0/StreamingFlow

Open-Ended Multi-Modal Relational Reasoning for Video Question Answering

Haozheng Luo, Ruiyang Qin, Chenwei Xu, Guo Ye, Zening Luo

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)

Affective Behaviour Analysis via Integrating Multi-Modal Knowledge

Wei Zhang, Feng Qiu, Chen Liu, Lincheng Li, Heming Du, Tiancheng Guo, Xin Yu

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments 11 pages, 1 figure

One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skill

Sangwoo Shin, Daehee Lee, Minjong Yoo, Woo Kyung Kim, Honguk Woo

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments ICML-2023 Camera Ready Version

Multi-modal News Understanding with Professionally Labelled Videos (ReutersViLNews)

Shih-Han Chou, Matthew Kowal, Yasmin Niknam, Diana Moyano, Shayaan Mehdi, Richard Pito, Cheng Zhang, Ian Knopke, Sedef Akinli Kocak, Leonid Sigal, Yalda Mohsenzadeh

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Mining multi-modal communication patterns in interaction with explainable and non-explainable robots

Suna Bensch, Amanda Eriksson

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Journal ref IEEE RO-MAN 2023, 32nd IEEE International conference on Robot and Human Interactive Communication; Workshop Human-Robot Interaction for Explainability in Robotics, Busan, Korea, August 28-31, 2023

Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living

Zdravko Marinov, David Schneider, Alina Roitberg, Rainer Stiefelhagen

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 8 pages, 7 figures, to be published in IROS 2022

Object-centric Cross-modal Feature Distillation for Event-based Object Detection

Lei Li, Alexander Liniger, Mario Millhaeusler, Vagia Tsiminaki, Yuanyou Li, Dengxin Dai

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments 12 pages, 8 figures

Multimodal Visual Concept Learning with Weakly Supervised Techniques

Giorgos Bouritsas, Petros Koutras, Athanasia Zlatintsi, Petros Maragos

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments CVPR 2018

Journal ref Proc. IEEE/CVF Conf. Comp. Vis. Patt. Rec. (CVPR) pp. 4914 - 4923 (2018)

EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting

Inhwan Bae, Jean Oh, Hae-Gon Jeon

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments Accepted at ICCV 2023

MINOTAUR: Multi-task Video Grounding From Multimodal Queries

Raghav Goyal, Effrosyni Mavroudi, Xitong Yang, Sainbayar Sukhbaatar, Leonid Sigal, Matt Feiszli, Lorenzo Torresani, Du Tran

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 22 pages, 8 figures and 13 tables

MSED: a multi-modal sleep event detection model for clinical sleep analysis

Alexander Neergaard Olesen, Poul Jennum, Emmanuel Mignot, Helge B. D. Sorensen

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments 10 pages, 4 figures. Accepted for publication in IEEE Transactions on Biomedical Engineering

Multi-video Moment Ranking with Multimodal Clue

Danyang Hou, Liang Pang, Yanyan Lan, Huawei Shen, Xueqi Cheng

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 9 pages,6 figures

Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation

Xueliang Zhao, Yuxuan Wang, Chongyang Tao, Chenshuo Wang, Dongyan Zhao

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CL

Comments To appear at EMNLP 2022 findings

Instance Segmentation with Cross-Modal Consistency

Alex Zihao Zhu, Vincent Casser, Reza Mahjourian, Henrik Kretzschmar, Sören Pirk

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments 8 pages, 9 figures, 5 tables. Presented at IROS 2022

Snowpack Estimation in Key Mountainous Water Basins from Openly-Available, Multimodal Data Sources

Malachy Moran, Kayla Woputz, Derrick Hee, Manuela Girotto, Paolo D'Odorico, Ritwik Gupta, Daniel Feldman, Puya Vahabi, Alberto Todeschini, Colorado J Reed

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted Oral Presentation at CVPR 2022 MultiEarth

Evaluating Multimodal Interactive Agents

Josh Abramson, Arun Ahuja, Federico Carnevale, Petko Georgiev, Alex Goldin, Alden Hung, Jessica Landon, Timothy Lillicrap, Alistair Muldal, Blake Richards, Adam Santoro, Tamara von Glehn, Greg Wayne, Nathaniel Wong, Chen Yan

专题命中 视频多模态 ：multimodal(title)；分类 cs.AI

Multi-modal curb detection and filtering

Sandipan Das, Navid Mahabadi, Saikat Chatterjee, Maurice Fallon

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

An EEG-Based Multi-Modal Emotion Database with Both Posed and Authentic Facial Actions for Emotion Analysis

Xiaotian Li, Xiang Zhang, Huiyuan Yang, Wenna Duan, Weiying Dai, Lijun Yin

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Journal ref FG2021(long Oral)

MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization

Alexander Kunitsyn, Maksim Kalashnikov, Maksim Dzabraev, Andrei Ivaniuta

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Discourse Parsing in Videos: A Multi-modal Appraoch

Arjun R. Akula, Song-Chun Zhu

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments Accepted in CVPR 2019 Workshop on Language and Vision (Oral Presentation)

Journal ref CVPR 2019 Workshop on Language and Vision (Oral Presentation)

EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation

Lin Wang, Yujeong Chae, Sung-Hoon Yoon, Tae-Kyun Kim, Kuk-Jin Yoon

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments CVPR 2021 (updated references in this version)

VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles

Alexander Amini, Tsun-Hsuan Wang, Igor Gilitschenski, Wilko Schwarting, Zhijian Liu, Song Han, Sertac Karaman, Daniela Rus

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments First two authors contributed equally. Code and project website is available here: https://vista.csail.mit.edu