arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4951 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态生成 4951 篇

2403.09391 2024-03-15 physics.optics physics.med-ph 78%

A hollow-core fiber based stand-alone multimodal (2-photon, 3-photon, SHG, THG) nonlinear flexible imaging endoscope

D. Septier, G. Brévalle-Wasilewski, E. Lefebvre, N. Gajendra Kumar, Y. J. Wang, A. Kaszas, H. Rigneault, A. Kudlinski

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.06284 2024-03-11 physics.comp-ph cs.GR physics.flu-dyn 78%

Efficient Generation of Multimodal Fluid Simulation Data

Daniele Baieri, Donato Crisostomi, Stefano Esposito, Filippo Maggioli, Emanuele Rodolà

专题命中 多模态生成 :multimodal(title);multi-modal(abstract)

Comments 10 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.00106 2024-03-05 cs.HC 78%

Umwelt: Accessible Structured Editing of Multimodal Data Representations

Jonathan Zong, Isabella Pedraza Pineros, Mengzhu Katie Chen, Daniel Hajas, Arvind Satyanarayan

专题命中 多模态生成 :multimodal(title,abstract)

Comments ACM CHI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.08199 2024-02-26 physics.optics physics.comp-ph 78%

Photonic Modes Prediction via Multi-Modal Diffusion Model

Jinyang Sun, Xi Chen, Xiumei Wang, Dandan Zhu, Xingping Zhou

专题命中 多模态生成 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.15665 2024-01-05 q-bio.QM cs.LG q-bio.BM 78%

A Multi-Modal Contrastive Diffusion Model for Therapeutic Peptide Generation

Yongkang Wang, Xuan Liu, Feng Huang, Zhankun Xiong, Wen Zhang

专题命中 多模态生成 :multi-modal(title,abstract)

Comments This paper is accepted by AAAI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.18837 2023-12-01 cs.CV cs.AI cs.LG cs.MM 78%

VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models

Zhen Xing, Qi Dai, Zihao Zhang, Hui Zhang, Han Hu, Zuxuan Wu, Yu-Gang Jiang

专题命中 多模态生成 :multi-modal(title);分类 cs.CV、cs.AI、cs.MM

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.17951 2023-12-01 cs.LG 78%

C3Net: Compound Conditioned ControlNet for Multimodal Content Generation

Juntao Zhang, Yuehuai Liu, Yu-Wing Tai, Chi-Keung Tang

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.14143 2023-11-21 eess.SP 78%

Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines

Xiang Cheng, Haotian Zhang, Jianan Zhang, Shijian Gao, Sijiang Li, Ziwei Huang, Lu Bai, Zonghui Yang, Xinhu Zheng, Liuqing Yang

专题命中 多模态生成 :multi-modal(title,abstract)

Comments This paper has been accepted by IEEE Communications Surveys & Tutorials

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.03815 2023-11-08 cs.NI eess.SP 78%

Integrated Sensing, Communication, and Computing for Cost-effective Multimodal Federated Perception

Ning Chen, Zhipeng Cheng, Xuwei Fan, Bangzhen Huang, Yifeng Zhao, Lianfen Huang, Xiaojiang Du, Mohsen Guizani

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.17237 2023-10-03 stat.ME cs.LG stat.ML 78%

Latent Multimodal Functional Graphical Model Estimation

Katherine Tsai, Boxin Zhao, Sanmi Koyejo, Mladen Kolar

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.16685 2023-10-02 q-bio.BM cs.LG 78%

Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning

Nhat Khang Ngo, Truong Son Hy

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.04997 2023-09-12 cs.CY 78%

Gender Bias in Multimodal Models: A Transnational Feminist Approach Considering Geographical Region and Culture

Abhishek Mandal, Suzanne Little, Susan Leavy

专题命中 多模态生成 :multimodal(title,abstract)

Comments Selected for publication at the Aequitas 2023: Workshop on Fairness and Bias in AI | co-located with ECAI 2023, Kraków, Poland

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.11211 2023-08-23 physics.optics cond-mat.mtrl-sci 78%

Simultaneous 3D Construction and Imaging of Plant Cells Using Plasmonic Nanoprobe Assisted Multimodal Nonlinear Optical Microscopy

Kun Liu, Yutian Lei, Dawei Li

专题命中 多模态生成 :multimodal(title,abstract)

Comments 18 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2002.02572 2023-05-09 cs.LG stat.ML 78%

Multimodal Controller for Generative Models

Enmao Diao, Jie Ding, Vahid Tarokh

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.04616 2023-01-24 cs.LG stat.ML 78%

Discriminative Multimodal Learning via Conditional Priors in Generative Models

Rogelio A. Mancisidor, Michael Kampffmeyer, Kjersti Aas, Robert Jenssen

专题命中 多模态生成 :multimodal(title);multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.01774 2022-11-04 stat.ML math.PR 78%

Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

Jacopo Guidolin, Vyacheslav Kungurtsev, Ondřej Kuželka

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.14476 2022-10-13 stat.ML cs.LG 78%

Can Push-forward Generative Models Fit Multimodal Distributions?

Antoine Salmona, Valentin de Bortoli, Julie Delon, Agnès Desolneux

专题命中 多模态生成 :multimodal(title,abstract)

Comments In Thirty-sixth Conference on Neural Information Processing Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.09007 2022-08-18 cs.HC 78%

Opal: Multimodal Image Generation for News Illustration

Vivian Liu, Han Qiao, Lydia Chilton

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.04496 2022-06-10 cs.LG 78%

Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization

Adrián Javaloy, Maryam Meghdadi, Isabel Valera

专题命中 多模态生成 :multimodal(title,abstract)

Comments Accepted as a Spotlight paper at ICML 2022. 27 pages, 10 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.05395 2022-05-30 math.OC 78%

Resiliency of On-Demand Multimodal Transit Systems During a Pandemic

Ramon Auad, Kevin Dalmeijer, Connor Riley, Tejas Santanam, Anthony Trasatti, Pascal Van Hentenryck, Hanyu Zhang

专题命中 多模态生成 :multimodal(title,abstract)

Comments 25 pages, 23 figures, 6 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.16706 2022-04-01 eess.SP cs.SY eess.SY 78%

Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard

Debashri Roy, Batool Salehi, Stella Banou, Subhramoy Mohanti, Guillem Reus-Muns, Mauro Belgiovine, Prashant Ganesh, Carlos Bocanegra, Chris Dick, Kaushik Chowdhury

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.06757 2022-03-07 cs.LG cs.HC 78%

Multimodal Data Visualization and Denoising with Integrated Diffusion

Manik Kuchroo, Abhinav Godavarthi, Alexander Tong, Guy Wolf, Smita Krishnaswamy

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.00203 2022-01-04 eess.SP cs.IT math.IT 78%

NOMA Computation Over Multi-Access Channels for Multimodal Sensing

Michel Kulhandjian, Gunes Karabulut Kurt, Hovannes Kulhandjian, Halim Yanikomeroglu, Claude D'Amours

专题命中 多模态生成 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.07973 2022-01-03 physics.flu-dyn nlin.PS 78%

Weak branch and multimodal convection in rapidly rotating spheres at low Prandtl number

Ferran Garcia, Frank Stefani, Emmanuel Dormy

专题命中 多模态生成 :multimodal(title,abstract)

Comments 22 pages, 19 figures, 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.01659 2021-10-07 cs.LG 78%

Cross-Modal Virtual Sensing for Combustion Instability Monitoring

Tryambak Gangopadhyay, Vikram Ramanan, Satyanarayanan R Chakravarthy, Soumik Sarkar

专题命中 多模态生成 :cross-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.11551 2021-09-27 quant-ph physics.atom-ph 78%

Any-to-any connected cavity-mediated architecture for quantum computing with trapped ions or Rydberg arrays

Joshua Ramette, Josiah Sinclair, Zachary Vendeiro, Alyssa Rudelis, Marko Cetina, Vladan Vuletić

专题命中 多模态生成 :any-to-any(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.06645 2021-08-17 cs.SE cs.LG cs.PL 78%

On Multi-Modal Learning of Editing Source Code

Saikat Chakraborty, Baishakhi Ray

专题命中 多模态生成 :multi-modal(title,abstract)

Comments Accepted for publication in 36th IEEE/ACM conference on Automated Software Engineering (ASE-2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.01582 2021-07-26 eess.IV 78%

Generation of annotated multimodal ground truth datasets for abdominal medical image registration

Dominik F. Bauer, Tom Russ, Barbara I. Waldkirch, Christian Tönnes, William P. Segars, Lothar R. Schad, Frank G. Zöllner, Alena-Kathrin Golla

专题命中 多模态生成 :multimodal(title,abstract)

Comments 12 pages, 5 figures. This work has been published in the International Journal of Computer Assisted Radiology and Surgery volume

Journal ref Int J CARS 16, 1277-1285 (2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.09883 2021-07-22 cs.LG q-bio.GN 78%

MG-NET: Leveraging Pseudo-Imaging for Multi-Modal Metagenome Analysis

Sathyanarayanan N. Aakur, Sai Narayanan, Vineela Indla, Arunkumar Bagavathi, Vishalini Laguduva Ramnath, Akhilesh Ramachandran

专题命中 多模态生成 :multi-modal(title,abstract)

Comments To appear in MICCAI 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.06677 2021-07-15 eess.SP cs.LG 78%

Hybrid Model and Data Driven Algorithm for Online Learning of Any-to-Any Path Loss Maps

M. A. Gutierrez-Estevez, Martin Kasparick, Renato L. G. Cavalvante, Sławomir Stańczak

专题命中 多模态生成 :any-to-any(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏