arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 3460 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 跨模态检索 3460 篇

2305.14485 2023-05-25 cs.DB cs.IR cs.LG 50%

Knowledge Graphs Querying

Arijit Khan

专题命中 跨模态检索 :multimodal(abstract)

Comments accepted at ACM SIGMOD Record 2023

Journal ref ACM SIGMOD Record 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.04072 2023-05-09 cs.IR 50%

Keyword-Based Diverse Image Retrieval by Semantics-aware Contrastive Learning and Transformer

Minyi Zhao, Jinpeng Wang, Dongliang Liao, Yiru Wang, Huanzhong Duan, Shuigeng Zhou

专题命中 跨模态检索 :cross-modal(abstract)

Comments Accepted by SIGIR2023 (long paper)

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.10249 2023-04-21 cs.LG 50%

Harnessing the Power of Text-image Contrastive Models for Automatic Detection of Online Misinformation

Hao Chen, Peng Zheng, Xin Wang, Shu Hu, Bin Zhu, Jinrong Hu, Xi Wu, Siwei Lyu

专题命中 跨模态检索 :image-text(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.00135 2023-04-11 q-bio.QM cs.HC cs.LG 50%

AVIDA: Alternating method for Visualizing and Integrating Data

Kathryn Dover, Zixuan Cang, Anna Ma, Qing Nie, Roman Vershynin

专题命中 跨模态检索 :multimodal(abstract)

Comments To appear in Journal of Computational Science (Accepted, 2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.12860 2023-01-31 cs.LG stat.ML 50%

Massively Scaling Heteroscedastic Classifiers

Mark Collier, Rodolphe Jenatton, Basil Mustafa, Neil Houlsby, Jesse Berent, Effrosyni Kokiopoulou

专题命中 跨模态检索 :multimodal(abstract)

Comments Accepted to ICLR 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.04560 2023-01-12 math.DS 50%

Model reduction for nonlinearizable dynamics via delay-embedded spectral submanifolds

Joar Axås, George Haller

专题命中 跨模态检索 :multimodal(abstract)

Comments 31 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.07619 2022-12-16 cs.LG 50%

Curriculum Learning Meets Weakly Supervised Modality Correlation Learning

Sijie Mai, Ya Sun, Haifeng Hu

专题命中 跨模态检索 :multimodal(abstract)

Comments Accepted by EMNLP 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.01748 2022-12-06 cs.RO cs.LG 50%

Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification

Shuai Wang, Chengyang Li, Derrick Wing Kwan Ng, Yonina C. Eldar, H. Vincent Poor, Qi Hao, Chengzhong Xu

专题命中 跨模态检索 :multi-modal(abstract)

Comments 10 pages, 6 figures, IEEE Network, accepted from open call

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.00519 2022-12-02 cs.HC 50%

Corvo: Visualizing CellxGene Single-Cell Datasets in Virtual Reality

Luke Hyman, Ivo F. Sbalzarini, Stephen Quake, Ulrik Günther

专题命中 跨模态检索 :multimodal(abstract)

Comments 3 pages, 2 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.09850 2022-10-25 physics.ao-ph cs.LG 50%

Near Real-time CO$_2$ Emissions Based on Carbon Satellite and Artificial Intelligence

Zhengwen Zhang, Jinjin Gu, Junhua Zhao, Jianwei Huang, Haifeng Wu

专题命中 跨模态检索 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.12318 2022-09-27 cs.HC 50%

Scrapbook: Screenshot-Based Bookmarks for Effective Digital Resource Curation across Applications

Donghan Hu, Sang Won Lee

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.08912 2022-08-19 cs.LG physics.ao-ph physics.comp-ph 50%

Learning-based estimation of in-situ wind speed from underwater acoustics

Matteo Zambra, Dorian Cazau, Nicolas Farrugia, Alexandre Gensse, Sara Pensieri, Roberto Bozzano, Ronan Fablet

专题命中 跨模态检索 :multimodal(abstract)

Comments 13 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.04945 2022-08-11 eess.IV 50%

Multiscale Autoencoder with Structural-Functional Attention Network for Alzheimer's Disease Prediction

Yongcheng Zong, Changhong Jing, Qiankun Zuo

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.01394 2022-08-03 cs.NI eess.SP 50%

UniPreCIS : A data pre-processing solution for collocated services on shared IoT

Anirban Das, Navlika Singh, Suchetana Chakraborty

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.00976 2022-06-13 cs.LG 50%

Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classification

Junwen Bai, Shufeng Kong, Carla P. Gomes

专题命中 跨模态检索 :multimodal(abstract)

Comments Accepted to ICML 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.01436 2022-06-06 cs.LG cs.IR q-bio.QM 50%

Modeling electronic health record data using a knowledge-graph-embedded topic model

Yuesong Zou, Ahmad Pesaranghader, Aman Verma, David Buckeridge, Yue Li

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.13279 2022-05-27 cs.LG 50%

Triangular Contrastive Learning on Molecular Graphs

MinGyu Choi, Wonseok Shin, Yijingxiu Lu, Sun Kim

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.03220 2022-05-25 q-bio.NC cs.LG physics.med-ph q-bio.QM 50%

Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis

Yanqiao Zhu, Hejie Cui, Lifang He, Lichao Sun, Carl Yang

专题命中 跨模态检索 :multimodal(abstract)

Comments Formal version accepted to IEEE EMBC 2022; previously presented at ICML 2021 Workshop on Computational Approaches to Mental Health (no proceedings)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.09593 2022-05-20 cs.IR 50%

Improving Micro-video Recommendation via Contrastive Multiple Interests

Beibei Li, Beihong Jin, Jiageng Song, Yisong Yu, Yiyuan Zheng, Wei Zhuo

专题命中 跨模态检索 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.08387 2022-05-18 cs.SI cs.CY 50%

Understanding and Detecting Hateful Content using Contrastive Learning

Felipe González-Pizarro, Savvas Zannettou

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.08569 2022-04-20 cs.IR cs.LG 50%

Learning Similarity Preserving Binary Codes for Recommender Systems

Yang Shi, Young-joo Chung

专题命中 跨模态检索 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.09667 2022-03-29 cs.LG 50%

Poisoning and Backdooring Contrastive Learning

Nicholas Carlini, Andreas Terzis

专题命中 跨模态检索 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.01542 2022-01-10 cs.IR 50%

iART: A Search Engine for Art-Historical Images to Support Research in the Humanities

Matthias Springstein, Stefanie Schneider, Javad Rahnama, Eyke Hüllermeier, Hubertus Kohle, Ralph Ewerth

专题命中 跨模态检索 :cross-modal(abstract)

Journal ref ACM Multimedia Conference 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.10255 2021-12-21 eess.SP 50%

Task-Oriented Multi-User Semantic Communications

Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief

专题命中 跨模态检索 :multimodal(abstract)

Comments 14 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.13468 2021-11-29 cs.IR 50%

Emotion Embedding Spaces for Matching Music to Stories

Minz Won, Justin Salamon, Nicholas J. Bryan, Gautham J. Mysore, Xavier Serra

专题命中 跨模态检索 :cross-modal(abstract)

Comments International Society for Music Information Retrieval (ISMIR) 2021, Best Student Paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.01495 2021-10-29 cs.LG 50%

Task-Adaptive Neural Network Search with Meta-Contrastive Learning

Wonyong Jeong, Hayeon Lee, Gun Park, Eunyoung Hyung, Jinheon Baek, Sung Ju Hwang

专题命中 跨模态检索 :cross-modal(abstract)

Comments NeurIPS 2021 (Spotlight)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.13561 2021-10-27 cs.LG 50%

Non-Gaussian Gaussian Processes for Few-Shot Regression

Marcin Sendera, Jacek Tabor, Aleksandra Nowak, Andrzej Bedychaj, Massimiliano Patacchiola, Tomasz Trzciński, Przemysław Spurek, Maciej Zięba

专题命中 跨模态检索 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.08918 2021-10-19 cs.LG q-bio.QM 50%

Using Clinical Drug Representations for Improving Mortality and Length of Stay Predictions

Batuhan Bardak, Mehmet Tan

专题命中 跨模态检索 :multimodal(abstract)

Comments Published in IEEE CIBCB 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.08063 2021-09-17 cs.LG 50%

Associative Memories via Predictive Coding

Tommaso Salvatori, Yuhang Song, Yujian Hong, Simon Frieder, Lei Sha, Zhenghua Xu, Rafal Bogacz, Thomas Lukasiewicz

专题命中 跨模态检索 :multi-modal(abstract)

Comments 24 pages, 18 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.07622 2021-09-17 cs.LG 50%

Towards Zero-shot Cross-lingual Image Retrieval and Tagging

Pranav Aggarwal, Ritiz Tambi, Ajinkya Kale

专题命中 跨模态检索 :multi-modal(abstract)

Comments Presented at Workshop on Multilingual Search, in conjunction with 30th The Web Conference 2021. arXiv admin note: substantial text overlap with arXiv:2012.05107

详情

展开后加载摘要…

URL PDF HTML 收藏