arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4726 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4726 篇

2306.05244 2023-12-07 physics.optics 78%

Spectral-temporal-spatial customization via modulating multimodal nonlinear pulse propagation

Tong Qiu, Honghao Cao, Kunzan Liu, Li-Yu Yu, Manuel Levy, Eva Lendaro, Fan Wang, Sixian You

专题命中 视频多模态 :multimodal(title,abstract)

Comments 36 pages, 19 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.14226 2023-11-27 cs.HC cs.CY 78%

Uncovering Gender Stereotypes in Video Game Character Designs: A Multi-Modal Analysis of Honor of Kings

Bingqing Liu, Kyrie Zhixuan Zhou, Danlei Zhu, Jaihyun Park

专题命中 视频多模态 :multi-modal(title,abstract)

Comments 3rd International Conference on Natural Language Processing for Digital Humanities (NLP4DH)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.01881 2023-11-06 eess.IV 78%

Quantitative Evaluation of a Multi-Modal Camera Setup for Fusing Event Data with RGB Images

Julian Moosmann, Jakub Mandula, Philipp Mayer, Luca Benini, Michele Magno

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.03813 2023-11-01 cs.LG eess.SP 78%

A Multimodal Sensing Ring for Quantification of Scratch Intensity

Akhil Padmanabha, Sonal Choudhary, Carmel Majidi, Zackory Erickson

专题命中 视频多模态 :multimodal(title,abstract)

Journal ref Commun Med 3, 115 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.06839 2023-10-24 cs.HC 78%

Close-up and Whispering: An Understanding of Multimodal and Parasocial Interactions in YouTube ASMR videos

Shuo Niu, Hugh S. Manon, Ava Bartolome, Nguyen B. Ha, Keegan Veazey

专题命中 视频多模态 :multimodal(title,abstract)

Comments 4 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.14549 2023-10-24 cs.LG 78%

Multimodal Graph Learning for Modeling Emerging Pandemics with Big Data

Khanh-Tung Tran, Truong Son Hy, Lili Jiang, Xuan-Son Vu

专题命中 视频多模态 :multimodal(title);multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.13250 2023-10-12 stat.AP stat.ME 78%

Spatio-Temporal Wildfire Prediction using Multi-Modal Data

Chen Xu, Yao Xie, Daniel A. Zuniga Vazquez, Rui Yao, Feng Qiu

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.05485 2023-10-10 cs.LG stat.ML 78%

Integration-free Training for Spatio-temporal Multimodal Covariate Deep Kernel Point Processes

Yixuan Zhang, Quyu Kong, Feng Zhou

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.04701 2023-10-10 cs.LG cs.SE 78%

Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System

Jun Huang, Yang Yang, Hang Yu, Jianguo Li, Xiao Zheng

专题命中 视频多模态 :multi-modal(title,abstract)

Comments This paper have been accepted by ASE 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.02361 2023-10-05 cs.RO 78%

Event-Enhanced Multi-Modal Spiking Neural Network for Dynamic Obstacle Avoidance

Yang Wang, Bo Dong, Yuji Zhang, Yunduo Zhou, Haiyang Mei, Ziqi Wei, Xin Yang

专题命中 视频多模态 :multi-modal(title);multimodal(abstract)

Comments In Proceedings of the 31st ACM International Conference on Multimedia (ACM MM 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.12764 2023-09-25 cs.SI 78%

Multi-Modal Embeddings for Isolating Cross-Platform Coordinated Information Campaigns on Social Media

Fabio Barbero, Sander op den Camp, Kristian van Kuijk, Carlos Soto García-Delgado, Gerasimos Spanakis, Adriana Iamnitchi

专题命中 视频多模态 :multi-modal(title,abstract)

Comments To appear in the 5th Multidisciplinary International Symposium on Disinformation in Open Online Media (MISDOOM 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.03536 2023-09-08 q-bio.NC 78%

Multimodal Integration of Olfactory and Visual Processing through DCM analysis: Contextual Modulation of Facial Perception

Gianluca Rho, Alejandro Luis Callara, Francesco Bossi, Dimitri Ognibene, Cinzia Cecchetto, Tommaso Lomonaco, Enzo Pasquale Scilingo, Alberto Greco

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.14320 2023-08-29 cs.HC 78%

Video Multimodal Emotion Recognition System for Real World Applications

Sun-Kyung Lee, Jong-Hwan Kim

专题命中 视频多模态 :multimodal(title,abstract)

Comments Interspeech 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.10710 2023-07-21 cs.LG 78%

Reparameterized Policy Learning for Multimodal Trajectory Optimization

Zhiao Huang, Litian Liang, Zhan Ling, Xuanlin Li, Chuang Gan, Hao Su

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.02578 2023-07-07 cs.LG 78%

Multimodal Temporal Fusion Transformers Are Good Product Demand Forecasters

Maarten Sukel, Stevan Rudinac, Marcel Worring

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.17925 2023-05-30 cs.CY cs.NI 78%

Identifying shifts in multi-modal travel patterns during special events using mobile data: Celebrating Vappu in Helsinki

Zhiren Huang, Charalampos Sipetas, Alonso Espinosa Mireles de Villafranca, Tri Quach

专题命中 视频多模态 :multi-modal(title,abstract)

Comments 6 pages, 12 figures, Submitted to ITSC2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.15159 2023-05-25 cs.IR 78%

Collaborative Recommendation Model Based on Multi-modal Multi-view Attention Network: Movie and literature cases

Zheng Hu, Shi-Min Cai, Jun Wang, Tao Zhou

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.04639 2023-05-09 cs.RO 78%

Multimodal Detection and Identification of Robot Manipulation Failures

Arda Inceoglu, Eren Erdal Aksoy, Sanem Sariel

专题命中 视频多模态 :multimodal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2011.05817

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.11258 2023-03-21 eess.IV 78%

Bronchoscopic video synchronization for interactive multimodal inspection of bronchial lesions

Qi Chang, Patrick D. Byrnes, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.02684 2023-03-07 cs.RO 78%

Robust Multi-Modal Multi-LiDAR-Inertial Odometry and Mapping for Indoor Environments

Li Qingqing, Yu Xianjia, Jorge Peña Queralta, Tomi Westerlund

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.12548 2023-01-31 cs.LG cs.CY 78%

Global Flood Prediction: a Multimodal Machine Learning Approach

Cynthia Zeng, Dimitris Bertsimas

专题命中 视频多模态 :multimodal(title,abstract)

Comments 6 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.08249 2023-01-23 cs.LG 78%

Causal conditional hidden Markov model for multimodal traffic prediction

Yu Zhao, Pan Deng, Junting Liu, Xiaofeng Jia, Mulan Wang

专题命中 视频多模态 :multimodal(title,abstract)

Comments 8 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.07013 2022-12-15 cs.RO cs.LG 78%

Learning and Predicting Multimodal Vehicle Action Distributions in a Unified Probabilistic Model Without Labels

Charles Richter, Patrick R. Barragán, Sertac Karaman

专题命中 视频多模态 :multimodal(title,abstract)

Comments Presented at the Fresh Perspectives on the Future of Autonomous Driving workshop, ICRA 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.15217 2022-11-30 cs.LG cs.RO 78%

AquaFeL-PSO: A Monitoring System for Water Resources using Autonomous Surface Vehicles based on Multimodal PSO and Federated Learning

Micaela Jara Ten Kathen, Princy Johnson, Isabel Jurado Flores, Daniel Guti errez Reina

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.10340 2022-11-21 cs.LG cs.SI 78%

Few-shot Learning for Multi-modal Social Media Event Filtering

José Nascimento, João Phillipe Cardenuto, Jing Yang, Anderson Rocha

专题命中 视频多模态 :multi-modal(title,abstract)

Comments Accepted in IEEE International Workshop on Information Forensics and Security - WIFS 2022, Shanghai, China

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.06839 2022-11-15 cs.RO cs.LG 78%

Out-of-Dynamics Imitation Learning from Multimodal Demonstrations

Yiwen Qiu, Jialong Wu, Zhangjie Cao, Mingsheng Long

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.06331 2022-11-14 cs.SI cs.LG 78%

MGTCOM: Community Detection in Multimodal Graphs

E. Dmitriev, M. W. Chekol, S. Wang

专题命中 视频多模态 :multimodal(title,abstract)

Comments 10 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.08078 2022-09-02 cs.LG 78%

Joint Demand Prediction for Multimodal Systems: A Multi-task Multi-relational Spatiotemporal Graph Neural Network Approach

Yuebing Liang, Guan Huang, Zhan Zhao

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.06878 2022-06-15 cs.LG cs.IT math.IT 78%

Temporal Multimodal Multivariate Learning

Hyoshin Park, Justice Darko, Niharika Deshpande, Venktesh Pandey, Hui Su, Masahiro Ono, Dedrick Barkely, Larkin Folsom, Derek Posselt, Steve Chien

专题命中 视频多模态 :multimodal(title,abstract)

Comments 11 pages, 12 figures, SIGKDD Conference on Knowledge Discovery and Data Mining,

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.07698 2022-05-27 cs.AI cs.CL cs.CV 78%

Detecting Cross-Modal Inconsistency to Defend Against Neural Fake News

Reuben Tan, Bryan A. Plummer, Kate Saenko

专题命中 视频多模态 :cross-modal(title);分类 cs.CV、cs.CL、cs.AI

Comments Accepted at EMNLP 2020

详情

展开后加载摘要…

URL PDF HTML 收藏