arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4878 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4878 篇

2408.17233 2024-09-02 cs.AI 74%

A methodological framework for Resilience as a Service (RaaS) in multimodal urban transportation networks

Sara Jaber, Mostafa Ameli, S. M. Hassan Mahdavi, Neila Bhouri

专题命中 其他多模态 :multimodal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.08574 2024-06-26 cs.HC cs.AI cs.LG 74%

Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models

David Chuan-En Lin, Nikolas Martelaro

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments https://jigsaw.to

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.04206 2024-06-14 cs.HC cs.AI cs.RO 74%

Effects of Multimodal Explanations for Autonomous Driving on Driving Performance, Cognitive Load, Expertise, Confidence, and Trust

Robert Kaufman, Jean Costa, Everlyne Kimani

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments 14 pages, published in Scientific Reports

Journal ref Scientific Reports volume 14, Article number: 13061 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.07163 2024-05-14 physics.ed-ph cs.AI 74%

Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI

Gyeong-Geon Lee, Xiaoming Zhai

专题命中 其他多模态 :multimodal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.09207 2024-03-19 cs.CV 74%

Visual Object Tracking on Multi-modal RGB-D Videos: A Review

Xue-Feng Zhu, Tianyang Xu, Xiao-Jun Wu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments I prefer not to present this paper due to its subpar quality

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.07407 2024-03-13 cs.CV 74%

In-context learning enables multimodal large language models to classify cancer pathology images

Dyke Ferber, Georg Wölflein, Isabella C. Wiest, Marta Ligero, Srividhya Sainath, Narmin Ghaffari Laleh, Omar S. M. El Nahhas, Gustav Müller-Franzes, Dirk Jäger, Daniel Truhn, Jakob Nikolas Kather

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 40 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.15779 2024-02-27 cs.CR cs.AI cs.IR 74%

Cryptanalysis and improvement of multimodal data encryption by machine-learning-based system

Zakaria Tolba

专题命中 其他多模态 :multimodal(title);分类 cs.AI

Comments Doctoral thesis. Keywords: Cryptanalysis, Black-box, Deep learning, Machine learning, Ciphertext, Plaintext, Genetic algorithm, Permutation box, Substitution Box

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.08035 2024-02-14 cs.CV 74%

Multiple Random Masking Autoencoder Ensembles for Robust Multimodal Semi-supervised Learning

Alexandru-Raul Todoran, Marius Leordeanu

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 17 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.01487 2024-01-04 cs.LG cs.CL 74%

Natural Language Processing and Multimodal Stock Price Prediction

Kevin Taylor, Jerry Ng

专题命中 其他多模态 :multimodal(title);分类 cs.CL

Comments 13 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.01520 2023-11-21 cs.CV cs.RO 74%

4D-Former: Multimodal 4D Panoptic Segmentation

Ali Athar, Enxu Li, Sergio Casas, Raquel Urtasun

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments accepted at CoRL 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.14083 2023-11-01 cs.LG cs.CL 74%

Counterfactual Augmentation for Multimodal Learning Under Presentation Bias

Victoria Lin, Louis-Philippe Morency, Dimitrios Dimitriadis, Srinagesh Sharma

专题命中 其他多模态 :multimodal(title);分类 cs.CL

Comments Accepted to Findings of EMNLP 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.10627 2023-08-22 cs.CV 74%

Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data

Patrick Ruhkamp, Daoyi Gao, HyunJun Jung, Nassir Navab, Benjamin Busam

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted at ICCV 2023 TRICKY Workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.11921 2023-07-25 cs.LG cs.CV 74%

Poverty rate prediction using multi-modal survey and earth observation data

Simone Fobi, Manuel Cardona, Elliott Collins, Caleb Robinson, Anthony Ortiz, Tina Sederholm, Rahul Dodhia, Juan Lavista Ferres

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments In 2023 ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS 23) Short Papers Track

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.09851 2023-06-19 cs.CV 74%

Joint multi-modal Self-Supervised pre-training in Remote Sensing: Application to Methane Source Classification

Paul Berg, Minh-Tan Pham, Nicolas Courty

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments 4 pages, 1 figure. Accepted to IGARSS 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.14124 2023-03-01 eess.IV cs.CV 74%

Multimodal Deep Learning to Differentiate Tumor Recurrence from Treatment Effect in Human Glioblastoma

Tonmoy Hossain, Zoraiz Qureshi, Nivetha Jayakumar, Thomas Eluvathingal Muttikkal, Sohil Patel, David Schiff, Miaomiao Zhang, Bijoy Kundu

专题命中 其他多模态 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.04812 2022-12-12 cs.CV cs.LG 74%

Reliable Multimodal Trajectory Prediction via Error Aligned Uncertainty Optimization

Neslihan Kose, Ranganath Krishnan, Akash Dhamasia, Omesh Tickoo, Michael Paulitsch

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments Accepted to ECCV 2022 workshop - Safe Artificial Intelligence for Automated Driving

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.03968 2022-12-09 cs.CV 74%

Multimodal Vision Transformers with Forced Attention for Behavior Analysis

Tanay Agrawal, Michal Balazia, Philipp Müller, François Brémond

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments Preprint. Full paper accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, USA, Jan 2023. 11 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.11921 2022-10-14 eess.IV cs.CV 74%

Unsupervised MRI Super-Resolution Using Deep External Learning and Guided Residual Dense Network with Multimodal Image Priors

Yutaro Iwamoto, Kyohei Takeda, Yinhao Li, Akihiko Shiino, Yen-Wei Chen

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 10 pages, 3 figures, Accepted by IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI)

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.10553 2022-09-28 cs.CV cs.CR cs.DC 74%

Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentation

Holger R. Roth, Ali Hatamizadeh, Ziyue Xu, Can Zhao, Wenqi Li, Andriy Myronenko, Daguang Xu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted to DeCaF 2022 held in conjunction with MICCAI 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.09953 2022-07-21 cs.CV cs.LG cs.RO 74%

Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction

Inhwan Bae, Jin-Hwi Park, Hae-Gon Jeon

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted at ECCV 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.16031 2022-07-21 eess.IV cs.CV 74%

ResViT: Residual vision transformers for multi-modal medical image synthesis

Onat Dalmaz, Mahmut Yurt, Tolga Çukur

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.06695 2022-07-15 cs.CV 74%

DavarOCR: A Toolbox for OCR and Multi-Modal Document Understanding

Liang Qiao, Hui Jiang, Ying Chen, Can Li, Pengfei Li, Zaisheng Li, Baorui Zou, Dashan Guo, Yingda Xu, Yunlu Xu, Zhanzhan Cheng, Yi Niu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Short paper, Accept by ACM MM2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.11684 2022-03-15 eess.IV cs.CV 74%

Multimodal-Boost: Multimodal Medical Image Super-Resolution using Multi-Attention Network with Wavelet Transform

Fayaz Ali Dharejo, Muhammad Zawish, Farah Deeba Yuanchun Zhou, Kapal Dev, Sunder Ali Khowaja, Nawab Muhammad Faseeh Qureshi

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments 14 pages, 13 Figures, and 3 Tables. Submitted to IEEE/ACM TCBB

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.09572 2022-03-14 cs.CV 74%

Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data

Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted by CVPR 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.09693 2022-02-07 eess.IV cs.CV cs.LG 74%

Shape-consistent Generative Adversarial Networks for multi-modal Medical segmentation maps

Leo Segre, Or Hirschorn, Dvir Ginzburg, Dan Raviv

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.12386 2022-02-01 eess.IV cs.CV 74%

Few-shot Unsupervised Domain Adaptation for Multi-modal Cardiac Image Segmentation

Mingxuan Gu, Sulaiman Vesal, Ronak Kosti, Andreas Maier

专题命中 其他多模态 :multi-modal(title);分类 cs.CV

Comments Accepted t0 BVM2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.14873 2021-12-02 eess.IV cs.CV 74%

Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas

Adrià Casamitjana, Marco Lorenzi, Sebastiano Ferraris, Loc Peter, Marc Modat, Allison Stevens, Bruce Fischl, Tom Vercauteren, Juan Eugenio Iglesias

专题命中 其他多模态 :multimodal(title);分类 cs.CV

Comments Medical Image Analysis (Accepted on 07/10/2021). 22 pages, 11 figures,

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.07646 2021-11-16 cs.CV cs.LG eess.IV 74%

Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learning

Dwarikanath Mahapatra

专题命中 其他多模态 :multimodal(title);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.05764 2021-11-11 cs.CR cs.AI cs.LG 74%

A framework for comprehensible multi-modal detection of cyber threats

Jan Kohout, Čeněk Škarda, Kyrylo Shcherbin, Martin Kopp, Jan Brabec

专题命中 其他多模态 :multi-modal(title);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.07325 2021-10-26 cs.AI cs.LG 74%

Cross-modal Adversarial Reprogramming

Paarth Neekhara, Shehzeen Hussain, Jinglong Du, Shlomo Dubnov, Farinaz Koushanfar, Julian McAuley

专题命中 其他多模态 :cross-modal(title);分类 cs.AI

Comments Accepted at WACV 2022

详情

展开后加载摘要…

URL PDF HTML 收藏