arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4726 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4726 篇

2204.04045 2022-05-12 hep-ex 78%

Probing Fundamental Physics With Multi-Modal Cosmic Ray Events

D. Beznosko, K. Baigarin, R. Beisembaev, E. Beisembaeva, E. Gladysz-Dziadu, V. Ryabov, T. Sadykov, S. Shaulov, V. Shiltsev, A. Stepanov, M. Vildanova, A. Zhitnitsky, V. Zhukov

专题命中 视频多模态 :multi-modal(title,abstract)

Comments White paper contribution to Snowmass 2021 (CF7) (minor typo fixes). arXiv admin note: text overlap with arXiv:2108.04826

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.12690 2022-04-28 cs.SI 78%

Multimodal Pipeline for Collection of Misinformation Data from Telegram

Jose Sosa, Serge Sharoff

专题命中 视频多模态 :multimodal(title,abstract)

Comments Language Resources and Evaluation Conference (LREC) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.09833 2021-10-20 astro-ph.HE 78%

Multimodal analysis of Gravitational Wave signals and Gamma-Ray Bursts from binary neutron star mergers

Elena Cuoco, Barbara Patricelli, Alberto Iess, Filip Morawski

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.04222 2021-09-10 cs.RO 78%

Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

An T. Le, Meng Guo, Niels van Duijkeren, Leonel Rozo, Robert Krug, Andras G. Kupcsik, Mathias Buerger

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.03479 2021-09-09 cs.HC 78%

VideoModerator: A Risk-aware Framework for Multimodal Video Moderation in E-Commerce

Tan Tang, Yanhong Wu, Lingyun Yu, Yuhong Li, Yingcai Wu

专题命中 视频多模态 :multimodal(title,abstract)

Comments 9 pages, 2 references

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.02398 2021-09-07 cs.SI 78%

Click-Through Rate Prediction with Multi-Modal Hypergraphs

Li He, Hongxu Chen, Dingxian Wang, Jameel Shoaib, Philip Yu, Guandong Xu

专题命中 视频多模态 :multi-modal(title,abstract)

Comments 9 pages,8 figures,Proceedings of the 30th ACM International Conference on Information and Knowledge Management

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.07125 2021-06-15 cs.RO 78%

Variational Policy Search using Sparse Gaussian Process Priors for Learning Multimodal Optimal Actions

Hikaru Sasaki, Takamitsu Matsubara

专题命中 视频多模态 :multimodal(title,abstract)

Comments Accepted by Neural Networks

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.13864 2021-05-31 cs.LG eess.SP 78%

SalientSleepNet: Multimodal Salient Wave Detection Network for Sleep Staging

Ziyu Jia, Youfang Lin, Jing Wang, Xuehui Wang, Peiyi Xie, Yingbin Zhang

专题命中 视频多模态 :multimodal(title,abstract)

Comments Accepted by IJCAI 2021. The SOLE copyright holder is IJCAI (International Joint Conferences on Artificial Intelligence), all rights reserved

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.05393 2021-04-07 physics.optics nlin.PS 78%

Managing Self-Phase Modulation in Pseudolinear Multimodal and Monomodal Systems

M. Zitelli, M. Ferraro, F. Mangini, S. Wabnitz

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.01711 2021-03-03 cs.NI 78%

An Event-Based Stack For Data Transmission Through Underwater Multimodal Networks

Roberto Francescon, Filippo Campagnaro, Emanuele Coccolo, Alberto Signori, Federico Guerra, Federico Favaro, Michele Zorzi

专题命中 视频多模态 :multimodal(title,abstract)

Comments 5 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.11191 2020-11-24 cs.RO 78%

Socially Aware Crowd Navigation with Multimodal Pedestrian Trajectory Prediction for Autonomous Vehicles

Kunming Li, Mao Shan, Karan Narula, Stewart Worrall, Eduardo Nebot

专题命中 视频多模态 :multimodal(title,abstract)

Comments 8 pages, 6 figures, submitted to IEEE International Conference on Intelligent Transportation Systems 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.07735 2020-11-17 cs.CV cs.AI cs.LG cs.MM eess.IV 78%

iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering

Aman Chadha, Gurneet Arora, Navpreet Kaloty

专题命中 视频多模态 :multi-modal(title);分类 cs.CV、cs.AI、cs.MM

Comments 13 pages, 6 figures, 4 tables, Project Page: https://iperceive.amanchadha.com

Journal ref IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.13373 2020-10-27 cs.IR cs.LG 78%

Multimodal Topic Learning for Video Recommendation

Shi Pu, Yijiang He, Zheng Li, Mao Zheng

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.10979 2020-10-12 physics.flu-dyn nlin.CD 78%

Lagrangian complexity persists with multimodal flow forcing in poroelastic systems

Michael Trefry, Daniel Lester, Guy Metcalfe, Junhong Wu

专题命中 视频多模态 :multimodal(title,abstract)

Comments 12 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.00001 2020-09-02 cs.HC stat.AP 78%

Toward Multimodal Modeling of Emotional Expressiveness

Victoria Lin, Jeffrey M. Girard, Michael A. Sayette, Louis-Philippe Morency

专题命中 视频多模态 :multimodal(title,abstract)

Comments V. Lin and J.M. Girard contributed equally to this research. This paper was accepted to ICMI 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.05557 2020-08-19 cs.SI cs.IR 78%

ReCOVery: A Multimodal Repository for COVID-19 News Credibility Research

Xinyi Zhou, Apurva Mulay, Emilio Ferrara, Reza Zafarani

专题命中 视频多模态 :multimodal(title,abstract)

Comments Proceedings of the 29th ACM International Conference on Information and Knowledge Management (CIKM '20)

详情

展开后加载摘要…

URL PDF HTML 收藏
1909.12494 2020-08-04 cs.RO 78%

Deep Gated Multi-modal Learning: In-hand Object Pose Changes Estimation using Tactile and Image Data

Tomoki Anzai, Kuniyuki Takahashi

专题命中 视频多模态 :multi-modal(title,abstract)

Comments 8 pages. Accepted to IROS 2020. An accompanying video is available at https://youtu.be/2OPQxQIcSxY

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.11847 2020-07-24 cs.LG stat.ML 78%

METEOR: Learning Memory and Time Efficient Representations from Multi-modal Data Streams

Amila Silva, Shanika Karunasekera, Christopher Leckie, Ling Luo

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1901.03906 2020-07-01 eess.IV cs.LG stat.ML 78%

ChronoMID - Cross-Modal Neural Networks for 3-D Temporal Medical Imaging Data

Alexander G. Rakowski, Petar Veličković, Enrico Dall'Ara, Pietro Liò

专题命中 视频多模态 :cross-modal(title,abstract)

Comments 8 pages, 7 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.09979 2020-06-18 cs.IR cs.LG 78%

I know why you like this movie: Interpretable Efficient Multimodal Recommender

Barbara Rychalska, Dominika Basaj, Jacek Dąbrowski, Michał Daniluk

专题命中 视频多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.00028 2020-06-02 cs.RO 78%

Multi-modal Transfer Learning for Grasping Transparent and Specular Objects

Thomas Weng, Amith Pallankize, Yimin Tang, Oliver Kroemer, David Held

专题命中 视频多模态 :multi-modal(title,abstract)

Comments RA-L with presentation at ICRA 2020

Journal ref IEEE ROBOTICS AND AUTOMATION LETTERS, VOL. 5, NO. 3, JULY 2020. 3791-3798

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.01023 2020-04-03 cs.MM cs.CV cs.CY cs.SD eess.AS 78%

Multi-Modal Video Forensic Platform for Investigating Post-Terrorist Attack Scenarios

Alexander Schindler, Andrew Lindley, Anahid Jalali, Martin Boyer, Sergiu Gordea, Ross King

专题命中 视频多模态 :multi-modal(title);分类 cs.CV、cs.MM、eess.AS

Journal ref In Proceedings of the 11th ACM Multimedia Systems Conference (MMSys2020), June 06-11, 2020, Istanbul, Turkey

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.10643 2020-03-25 cs.NI cs.SI stat.AP stat.ML 78%

DeepSIP: A System for Predicting Service Impact of Network Failure by Temporal Multimodal CNN

Yoichi Matsuo, Tatsuaki Kimura, Ken Nishimatsu

专题命中 视频多模态 :multimodal(title,abstract)

Comments to appear in IEEE/IFIP International Workshop on Analytics for Network and Service Management (AnNet 2020)

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.02632 2020-03-06 eess.SP 78%

STAR: Spatio-Temporal Prediction of Air Quality Using A Multimodal Approach

Tien-Cuong Bui, Joonyoung Kim, Taewoo Kang, Donghyeon Lee, Junyoung Choi, Insoon Yang, Kyomin Jung, Sang Kyun Cha

专题命中 视频多模态 :multimodal(title,abstract)

Comments 18 pages, 9 figures, Intelligent System Conference (Intellisys 2020 - Accepted)

详情

展开后加载摘要…

URL PDF HTML 收藏
1910.00444 2020-01-20 cs.HC 78%

On Assessing Driver Awareness of Situational Criticalities: Multi-modal Bio-sensing and Vision-based Analysis, Evaluations, and Insights

Siddharth Siddharth, Mohan M. Trivedi

专题命中 视频多模态 :multi-modal(title,abstract)

Comments Journal article published in MDPI Brain Sciences. arXiv admin note: text overlap with arXiv:1905.00503

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.05629 2019-08-28 cs.CY 78%

A blockchain-based user-centric emission monitoring and trading system for multi-modal mobility

Johannes Eckert, David López, Carlos Lima Azevedo, Bilal Farooq

专题命中 视频多模态 :multi-modal(title,abstract)

Comments 15 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.07012 2019-07-09 cs.RO 78%

Understanding of Object Manipulation Actions Using Human Multi-Modal Sensory Data

Bahareh Abbasi, Ehsan Noohi, Sina Parastegari, Milos Zefran

专题命中 视频多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1811.11688 2019-06-10 q-bio.NC 78%

Disrupted core-periphery structure of multimodal brain networks in Alzheimer's Disease

Jeremy Guillon, Mario Chavez, Federico Battiston, Yohan Attal, Valentina La Corte, Michel Thiebaut de Schotten, Bruno Dubois, Denis Schwartz, Olivier Colliot, Fabrizio De Vico Fallani

专题命中 视频多模态 :multimodal(title,abstract)

Comments 5 figures, 1 table, 1 supplementary figure, 2 supplementary tables

Journal ref Network Neuroscience 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.07039 2019-05-20 cs.LG cs.HC eess.SP stat.ML 78%

Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computing

Siddharth Siddharth, Tzyy-Ping Jung, Terrence J. Sejnowski

专题命中 视频多模态 :multi-modal(title,abstract)

Comments Accepted for publication in IEEE Transactions on Affective Computing. This version on the arXiv is the updated version of the same manuscript

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.07319 2019-04-17 cs.RO cs.LG 78%

Learning Probabilistic Multi-Modal Actor Models for Vision-Based Robotic Grasping

Mengyuan Yan, Adrian Li, Mrinal Kalakrishnan, Peter Pastor

专题命中 视频多模态 :multi-modal(title,abstract)

Journal ref The 2019 International Conference on Robotics and Automation (ICRA)

详情

展开后加载摘要…

URL PDF HTML 收藏