多模态大模型

Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models

Weichen Fan, Chenyang Si, Junhao Song, Zhenyu Yang, Yinan He, Long Zhuo, Ziqi Huang, Ziyue Dong, Jingwen He, Dongwei Pan, Yi Wang, Yuming Jiang, Yaohui Wang, Peng Gao, Xinyuan Chen, Hengjie Li, Dahua Lin, Yu Qiao, Ziwei Liu

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

iMoT: Inertial Motion Transformer for Inertial Navigation

Son Minh Nguyen, Linh Duy Tran, Duc Viet Le, Paul J. M Havinga

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.AI

Comments Accepted as technical research paper in 39th AAAI Conference on Artificial Intelligence, 2025 (AAAI 2025)

The Streetscape Application Services Stack (SASS): Towards a Distributed Sensing Architecture for Urban Applications

Navid Salami Pargoo, Mahshid Ghasemi, Shuren Xia, Mehmet Kerem Turkcan, Taqiya Ehsan, Chengbo Zang, Yuan Sun, Javad Ghaderi, Gil Zussman, Zoran Kostic, Jorge Ortiz

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Identity-Preserving Video Dubbing Using Motion Warping

Runzhen Liu, Qinjie Lin, Yunfei Liu, Lijian Lin, Ye Zhu, Yu Li, Chuhua Xian, Fa-Ting Hong

专题命中 视频多模态 ：audio-visual(abstract)；分类 cs.CV

Comments v2, Under Review

MotionBridge: Dynamic Video Inbetweening with Flexible Controls

Maham Tanveer, Yang Zhou, Simon Niklaus, Ali Mahdavi Amiri, Hao Zhang, Krishna Kumar Singh, Nanxuan Zhao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Project website: [https://motionbridge.github.io/]

From Glucose Patterns to Health Outcomes: A Generalizable Foundation Model for Continuous Glucose Monitor Data Analysis

Guy Lutsker, Gal Sapir, Smadar Shilo, Jordi Merino, Anastasia Godneva, Jerry R Greenfield, Dorit Samocha-Bonet, Raja Dhir, Francisco Gude, Shie Mannor, Eli Meirom, Gal Chechik, Hagai Rossman, Eran Segal

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Dense Video Captioning Using Unsupervised Semantic Information

Valter Estevam, Rayson Laroca, Helio Pedrini, David Menotti

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Published at Journal of Visual Communication and Image Representation

PG-SAG: Parallel Gaussian Splatting for Fine-Grained Large-Scale Urban Buildings Reconstruction via Semantic-Aware Grouping

Tengfei Wang, Xin Wang, Yongmao Hou, Yiwei Xu, Wendi Zhang, Zongqian Zhan

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

On the Robustness of Cover Version Identification Models: A Study Using Cover Versions from YouTube

Simon Hachmeier, Robert Jäschke

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.MM

Comments accepted for presentation at iConference 2025

UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models

Yujie Li, Wenjia Xu, Guangzuo Li, Zijian Yu, Zhiwei Wei, Jiuniu Wang, Mugen Peng

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 12 pages, 5 figures

Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline

Dingyi Yang, Chunru Zhan, Ziheng Wang, Biao Wang, Tiezheng Ge, Bo Zheng, Qin Jin

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.MM

Comments 15 pages, 13 figures

Journal ref https://aclanthology.org/2024.acl-long.513/

Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries

Roberto Amoroso, Gengyuan Zhang, Rajat Koner, Lorenzo Baraldi, Rita Cucchiara, Volker Tresp

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments WACV 2025

C2F-TP: A Coarse-to-Fine Denoising Framework for Uncertainty-Aware Trajectory Prediction

Zichen Wang, Hao Miao, Senzhang Wang, Renzhi Wang, Jianxin Wang, Jian Zhang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments Accepted by AAAI 2025

MAGIC++: Efficient and Resilient Modality-Agnostic Semantic Segmentation via Hierarchical Modality Selection

Xu Zheng, Yuanhuiyi Lyu, Lutao Jiang, Jiazhou Zhou, Lin Wang, Xuming Hu

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

MVTN: A Multiscale Video Transformer Network for Hand Gesture Recognition

Mallika Garg, Debashis Ghosh, Pyari Mohan Pradhan

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Journal ref Eccv 2024 workshop paper

PruneVid: Visual Token Pruning for Efficient Video Large Language Models

Xiaohu Huang, Hao Zhou, Kai Han

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Efficient Video Large Language Models

ReXplain: Translating Radiology into Patient-Friendly Video Reports

Luyang Luo, Jenanan Vairavamurthy, Xiaoman Zhang, Abhinav Kumar, Ramon R. Ter-Oganesyan, Stuart T. Schroff, Dan Shilo, Rydhwana Hossain, Mike Moritz, Pranav Rajpurkar

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 12 pages. The project page is https://www.rajpurkarlab.hms.harvard.edu/rexplain

Instruction-based Image Manipulation by Watching How Things Move

Mingdeng Cao, Xuaner Zhang, Yinqiang Zheng, Zhihao Xia

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project page: https://ljzycmd.github.io/projects/InstructMove/

CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understanding

Guo Chen, Yicheng Liu, Yifei Huang, Yuping He, Baoqi Pei, Jilan Xu, Yali Wang, Tong Lu, Limin Wang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 14 pages, 9 figures

Overview of TREC 2024 Medical Video Question Answering (MedVidQA) Track

Deepak Gupta, Dina Demner-Fushman

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Bridging Vision and Language: Modeling Causality and Temporality in Video Narratives

Ji-jun Park, Soo-joon Choi

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

IQViC: In-context, Question Adaptive Vision Compressor for Long-term Video Understanding LMMs

Sosuke Yamao, Natsuki Miyahara, Yuki Harazono, Shun Takeuchi

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments The first and second authors contributed equally to this work

Towards Robust and Fair Vision Learning in Open-World Environments

Thanh-Dat Truong

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments PhD Dissertation

GEXIA: Granularity Expansion and Iterative Approximation for Scalable Multi-grained Video-language Learning

Yicheng Wang, Zhikang Zhang, Jue Wang, David Fan, Zhenlin Xu, Linda Liu, Xiang Hao, Vimal Bhat, Xinyu Li

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding

Yan Shu, Zheng Liu, Peitian Zhang, Minghao Qin, Junjie Zhou, Zhengyang Liang, Tiejun Huang, Bo Zhao

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

NewMove: Customizing text-to-video models with novel motions

Joanna Materzynska, Josef Sivic, Eli Shechtman, Antonio Torralba, Richard Zhang, Bryan Russell

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project page: this website https://joaanna.github.io/customizing_motion/

How to Squeeze An Explanation Out of Your Model

Tiago Roxo, Joana C. Costa, Pedro R. M. Inácio, Hugo Proença

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Streaming Detection of Queried Event Start

Cristobal Eyzaguirre, Eric Tang, Shyamal Buch, Adrien Gaidon, Jiajun Wu, Juan Carlos Niebles

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

STORM: Strategic Orchestration of Modalities for Rare Event Classification

Payal Kamboj, Ayan Banerjee, Sandeep K. S. Gupta

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted in IEEE Asilomar Conference on Signals, Systems, and Computers, 2024

Revisiting Generative Policies: A Simpler Reinforcement Learning Algorithmic Perspective

Jinouwen Zhang, Rongkun Xue, Yazhe Niu, Yun Chen, Jing Yang, Hongsheng Li, Yu Liu

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI