多模态大模型

M2LADS Demo: A System for Generating Multimodal Learning Analytics Dashboards

Alvaro Becerra, Roberto Daza, Ruth Cobos, Aythami Morales, Julian Fierrez

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Published in the Workshop on Innovation and Responsibility in AI-Supported Education (iRAISE25) at AAAI 2025

Ev-Layout: A Large-scale Event-based Multi-modal Dataset for Indoor Layout Estimation and Tracking

Xucheng Guo, Yiran Shen, Xiaofang Xiao, Yuanfeng Zhou, Lin Wang

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

CASP: Compression of Large Multimodal Models Based on Attention Sparsity

Mohsen Gholami, Mohammad Akbari, Kevin Cannons, Yong Zhang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

LongCaptioning: Unlocking the Power of Long Video Caption Generation in Large Multimodal Models

Hongchen Wei, Zhihong Tan, Yaosi Hu, Chang Wen Chen, Zhenzhong Chen

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

MindMem: Multimodal for Predicting Advertisement Memorability Using LLMs and Deep Learning

Sepehr Asgarian, Qayam Jetha, Jouhyun Jeon

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 7 pages, 5 figures, 4 Tables, AAAI 2025 Economics of Modern ML: Markets, Incentives, and Generative AI Workshop

Multi-modal and Metadata Capture Model for Micro Video Popularity Prediction

Jiacheng Lu, Mingyuan Xiao, Weijian Wang, Yuxin Du, Zhengze Wu, Cheng Hua

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.MM

Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models

Zhenyu Pan, Haozheng Luo, Manling Li, Han Liu

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CL

Comments International Conference on Learning Representations (ICLR) 2025

SleepGMUformer: A gated multimodal temporal neural network for sleep staging

Chenjun Zhao, Xuesen Niu, Xinglin Yu, Long Chen, Na Lv, Huiyu Zhou, Aite Zhao

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Event-Based Video Frame Interpolation With Cross-Modal Asymmetric Bidirectional Motion Fields

Taewoo Kim, Yujeong Chae, Hyun-Kurl Jang, Kuk-Jin Yoon

专题命中 视频多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted in CVPR2023(Highlight)

S2C: Learning Noise-Resistant Differences for Unsupervised Change Detection in Multimodal Remote Sensing Images

Lei Ding, Xibing Zuo, Danfeng Hong, Haitao Guo, Jun Lu, Zhihui Gong, Lorenzo Bruzzone

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model

Jan Held, Hani Itani, Anthony Cioppa, Silvio Giancola, Bernard Ghanem, Marc Van Droogenbroeck

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Building a Multi-modal Spatiotemporal Expert for Zero-shot Action Recognition with CLIP

Yating Yu, Congqi Cao, Yueran Zhang, Qinyi Lv, Lingtong Min, Yanning Zhang

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

Hierarchical Time-Aware Mixture of Experts for Multi-Modal Sequential Recommendation

Shengzhe Zhang, Liyi Chen, Dazhong Shen, Chao Wang, Hui Xiong

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.AI

Comments Accepted to WWW 2025

Learning Complex Heterogeneous Multimodal Fake News via Social Latent Network Inference

Mingxin Li, Yuchen Zhang, Haowei Xu, Xianghua Li, Chao Gao, Zhen Wang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.MM

Comments AAAI 2025

Multi-modal Fusion and Query Refinement Network for Video Moment Retrieval and Highlight Detection

Yifang Xu, Yunzhuo Sun, Benxiang Zhai, Zien Xie, Youyao Jia, Sidan Du

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICME 2024

VanGogh: A Unified Multimodal Diffusion-based Framework for Video Colorization

Zixun Fang, Zhiheng Liu, Kai Zhu, Yu Liu, Ka Leong Cheng, Wei Zhai, Yang Cao, Zheng-Jun Zha

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Enhancing Multi-Modal Video Sentiment Classification Through Semi-Supervised Clustering

Mehrshad Saadatinia, Minoo Ahmadi, Armin Abdollahi

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMs

Dabing Cheng, Haosen Zhan, Xingchen Zhao, Guisheng Liu, Zemin Li, Jinghui Xie, Zhao Song, Weiguo Feng, Bingyue Peng

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 16pages conference

TB-Bench: Training and Testing Multi-Modal AI for Understanding Spatio-Temporal Traffic Behaviors from Dashcam Images/Videos

Korawat Charoenpitaks, Van-Quang Nguyen, Masanori Suganuma, Kentaro Arai, Seiji Totsuka, Hiroshi Ino, Takayuki Okatani

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Main Paper: 8 pages, Supplementary Materials: 15 pages

ISR-DPO: Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO

Daechul Ahn, Yura Choi, San Kim, Youngjae Yu, Dongyeop Kang, Jonghyun Choi

专题命中 视频多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments AAAI 2025

AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Framework

Run Shao, Cheng Yang, Qiujun Li, Qing Zhu, Yongjun Zhang, YanSheng Li, Yu Liu, Yong Tang, Dapeng Liu, Shizhong Yang, Haifeng Li

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 19 pages, 19 tables, 3 figures

Journal ref IEEE Transactions on Geoscience and Remote Sensing. 2025

MVP: Multimodal Emotion Recognition based on Video and Physiological Signals

Valeriya Strizhkova, Hadi Kachmar, Hava Chaptoukaev, Raphael Kalandadze, Natia Kukhilava, Tatia Tsmindashvili, Nibras Abo-Alzahab, Maria A. Zuluaga, Michal Balazia, Antitza Dantcheva, François Brémond, Laura Ferrari

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Preprint. Final paper accepted at Affective Behavior Analysis in-the-Wild (ABAW) at IEEE/CVF European Conference on Computer Vision (ECCV), Milan, September, 2024. 17 pages

Multimodal Large Models Are Effective Action Anticipators

Binglu Wang, Yao Tian, Shunzhou Wang, Le Yang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Multimodal joint prediction of traffic spatial-temporal data with graph sparse attention mechanism and bidirectional temporal convolutional network

Dongran Zhang, Jiangnan Yan, Kemal Polat, Adi Alhudhaif, Jun Li

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

M3-CVC: Controllable Video Compression with Multimodal Generative Models

Rui Wan, Qi Zheng, Yibo Fan

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICASSP 2025

MANGO: Multimodal Acuity traNsformer for intelliGent ICU Outcomes

Jiaqing Zhang, Miguel Contreras, Sabyasachi Bandyopadhyay, Andrea Davidson, Jessica Sena, Yuanfang Ren, Ziyuan Guan, Tezcan Ozrazgat-Baslanti, Tyler J. Loftus, Subhash Nerella, Azra Bihorac, Parisa Rashidi

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

A Multimodal Approach For Endoscopic VCE Image Classification Using BiomedCLIP-PubMedBERT

Nagarajan Ganapathy, Podakanti Satyajith Chary, Teja Venkata Ramana Kumar Pithani, Pavan Kavati, Arun Kumar S

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments 11 Pages, 2 Figures, Capsule Vision 2024 Challenge

Exploiting Multimodal Spatial-temporal Patterns for Video Object Tracking

Xiantao Hu, Ying Tai, Xu Zhao, Chen Zhao, Zhenyu Zhang, Jun Li, Bineng Zhong, Jian Yang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents

Shaofei Cai, Bowei Zhang, Zihao Wang, Haowei Lin, Xiaojian Ma, Anji Liu, Yitao Liang

专题命中 视频多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

Learning Complex Non-Rigid Image Edits from Multimodal Conditioning

Nikolai Warner, Jack Kolb, Meera Hahn, Vighnesh Birodkar, Jonathan Huang, Irfan Essa

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV