多模态大模型 - arXivDaily 专题

2410.15387 2024-10-22 cs.IR 78%

Deep Class-guided Hashing for Multi-label Cross-modal Retrieval

Hao Chen, Lei Zhu, Xinghui Zhu

专题命中跨模态检索：cross-modal(title,abstract)

2410.11376 2024-10-16 cs.CE 78%

PhysioFormer: Integrating Multimodal Physiological Signals and Symbolic Regression for Explainable Affective State Prediction

Zhifeng Wang, Wanxuan Wu, Chunyan Zeng

专题命中跨模态检索：multimodal(title,abstract)

Comments 45 pages

2409.02965 2024-09-06 cs.SI cs.IR cs.LG 78%

Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations

Zhicheng Ren, Zhiping Xiao, Yizhou Sun

专题命中跨模态检索：multimodal(title,abstract)

2101.08316 2024-08-27 cs.LG 78%

Ensemble manifold based regularized multi-modal graph convolutional network for cognitive ability prediction

Gang Qu, Li Xiao, Wenxing Hu, Kun Zhang, Vince D. Calhoun, Yu-Ping Wang

专题命中跨模态检索：multi-modal(title,abstract)

2408.07773 2024-08-16 cs.LG 78%

MedTsLLM: Leveraging LLMs for Multimodal Medical Time Series Analysis

Nimeesha Chan, Felix Parker, William Bennett, Tianyi Wu, Mung Yao Jia, James Fackler, Kimia Ghobadi

专题命中跨模态检索：multimodal(title,abstract)

Comments published in Proceedings of Machine Learning Research, MLHC 2024

2408.00665 2024-08-02 cs.LG 78%

AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Models

Daqin Luo, Chengjian Feng, Yuxuan Nong, Yiqing Shen

专题命中跨模态检索：multimodal(title,abstract)

Comments Accpeted by ACMMM2024

2407.11696 2024-07-17 cs.LG physics.ao-ph 78%

Global atmospheric data assimilation with multi-modal masked autoencoders

Thomas J. Vandal, Kate Duffy, Daniel McDuff, Yoni Nachmany, Chris Hartshorn

专题命中跨模态检索：multi-modal(title,abstract)

Comments 24 pages, 9 figures, 6 tables

2407.04217 2024-07-08 cs.DB cs.IR 78%

An Interactive Multi-modal Query Answering System with Retrieval-Augmented Large Language Models

Mengzhao Wang, Haotian Wu, Xiangyu Ke, Yunjun Gao, Xiaoliang Xu, Lu Chen

专题命中跨模态检索：multi-modal(title,abstract)

Comments This demo paper has been accepted by VLDB 2024

2407.02238 2024-07-03 cs.DC cs.LG cs.PF 78%

MIREncoder: Multi-modal IR-based Pretrained Embeddings for Performance Optimizations

Akash Dutta, Ali Jannesari

专题命中跨模态检索：multi-modal(title,abstract)

Comments 12 pages, 6 figures, 9 tables, PACT '24 conference

2302.05342 2024-06-27 cs.LG 78%

Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL

Philipp Becker, Sebastian Mossburger, Fabian Otto, Gerhard Neumann

专题命中跨模态检索：multimodal(title,abstract)

Comments Published in "Reinforcement Learning Conference (RLC)", August 2024

2310.14037 2024-06-18 cs.IR 78%

MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module Plugin

Tianshuo Zhou, Sen Mei, Xinze Li, Zhenghao Liu, Chenyan Xiong, Zhiyuan Liu, Yu Gu, Ge Yu

专题命中跨模态检索：multi-modal(title,abstract)

2305.03972 2024-06-11 cs.IR 78%

Category-Oriented Representation Learning for Image to Multi-Modal Retrieval

Zida Cheng, Chen Ju, Shuai Xiao, Xu Chen, Zhonghua Zhai, Xiaoyi Zeng, Weilin Huang, Junchi Yan

专题命中跨模态检索：multi-modal(title,abstract)

2405.20668 2024-06-03 q-bio.BM cs.LG q-bio.QM 78%

Improving Paratope and Epitope Prediction by Multi-Modal Contrastive Learning and Interaction Informativeness Estimation

Zhiwei Wang, Yongkang Wang, Wen Zhang

专题命中跨模态检索：multi-modal(title,abstract)

Comments This paper is accepted by IJCAI 2024

2311.05956 2024-05-24 cs.IR cs.LG 78%

ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation

Yuting Liu, Enneng Yang, Yizhou Dang, Guibing Guo, Qiang Liu, Yuliang Liang, Linying Jiang, Xingwei Wang

专题命中跨模态检索：multimodal(title,abstract)

2312.16400 2024-04-19 cs.IR 78%

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

Zhiqiang Guo, Jianjun Li, Guohui Li, Chaoyang Wang, Si Shi, Bin Ruan

专题命中跨模态检索：multimodal(title,abstract)

Comments Accepted by AAAI2024

2404.06078 2024-04-10 cs.IR 78%

End-to-end training of Multimodal Model and ranking Model

Xiuqi Deng, Lu Xu, Xiyao Li, Jinkai Yu, Erpeng Xue, Zhongyuan Wang, Di Zhang, Zhaojie Liu, Guorui Zhou, Yang Song, Na Mou, Shen Jiang, Han Li

专题命中跨模态检索：multimodal(title,abstract)

Comments 9 pages, 8 figures

2403.18316 2024-03-28 cs.LG 78%

Multi-Modal Contrastive Learning for Online Clinical Time-Series Applications

Fabian Baldenweg, Manuel Burger, Gunnar Rätsch, Rita Kuznetsova

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted as a Workshop Paper at TS4H@ICLR2024

2403.09428 2024-03-27 cs.LG 78%

Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity

Zhuo Zhi, Ziquan Liu, Moe Elbadawi, Adam Daneshmend, Mine Orlu, Abdul Basit, Andreas Demosthenous, Miguel Rodrigues

专题命中跨模态检索：multimodal(title,abstract)

2403.16645 2024-03-26 cs.HC 78%

Virtual Co-Pilot: Multimodal Large Language Model-enabled Quick-access Procedures for Single Pilot Operations

Fan Li, Shanshan Feng, Yuqi Yan, Ching-Hung Lee, Yew Soon Ong

专题命中跨模态检索：multimodal(title,abstract)

Comments 10 pages,7 figures

2310.04971 2024-03-19 cs.LG 78%

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift

Yihao Xue, Siddharth Joshi, Dang Nguyen, Baharan Mirzasoleiman

专题命中跨模态检索：multi-modal(title)；multimodal(abstract)

2402.03635 2024-02-07 cs.IR 78%

Retrieval Augmented Cross-Modal Tag Recommendation in Software Q&A Sites

Sijin Lu, Pengyu Xu, Bing Liu, Hongjian Sun, Liping Jing, Jian Yu

专题命中跨模态检索：cross-modal(title,abstract)

2402.02357 2024-02-07 cs.LG stat.ME 78%

Multi-modal Causal Structure Learning and Root Cause Analysis

Lecheng Zheng, Zhengzhang Chen, Jingrui He, Haifeng Chen

专题命中跨模态检索：multi-modal(title,abstract)

Comments Accepted by the Web Conference 2024

2401.10464 2024-01-22 cs.HC 78%

PhotoScout: Synthesis-Powered Multi-Modal Image Search

Celeste Barnaby, Qiaochu Chen, Chenglong Wang, Isil Dillig

专题命中跨模态检索：multi-modal(title,abstract)

2312.16194 2023-12-29 physics.geo-ph 78%

Multimodal machine learning for 3-dimensional characterization of hidden groundwater and geothermal resources

Michael J. Friedel, Nicole Lautze, Erin Wallin, Roland Gritto, Alain Bonneville, Massimo Buscema, Steve Martel

专题命中跨模态检索：multimodal(title,abstract)

Comments 29 figures, 7 tables

2312.06397 2023-12-12 cs.DB cs.IR 78%

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Mengzhao Wang, Xiangyu Ke, Xiaoliang Xu, Lu Chen, Yunjun Gao, Pinpin Huang, Runkai Zhu

专题命中跨模态检索：multimodal(title,abstract)

Comments This paper has been accepted by ICDE 2024

2310.18951 2023-10-31 cs.IR 78%

A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graph

Zhihang Yu, Shu Wang, Yunqiang Zhu, Zhiqiang Zou

专题命中跨模态检索：multimodal(title,abstract)

2310.11612 2023-10-19 cs.LG 78%

Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

Yimu Wang, Xiangru Jian, Bo Xue

专题命中跨模态检索：cross-modal(title,abstract)

Comments Accepted by EMNLP 2023

2310.08270 2023-10-13 cs.RO 78%

Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction

Basant Sharma, Aditya Sharma, K. Madhava Krishna, Arun Kumar Singh

专题命中跨模态检索：multi-modal(title,abstract)

2310.01762 2023-10-04 cs.LG cs.DS math.ST stat.TH 78%

Sampling Multimodal Distributions with the Vanilla Score: Benefits of Data-Based Initialization

Frederic Koehler, Thuy-Duong Vuong

专题命中跨模态检索：multimodal(title,abstract)

2309.17037 2023-10-02 cs.IR 78%

Beyond Co-occurrence: Multi-modal Session-based Recommendation

Xiaokun Zhang, Bo Xu, Fenglong Ma, Chenliang Li, Liang Yang, Hongfei Lin

专题命中跨模态检索：multi-modal(title,abstract)

Comments This paper has been accepted by TKDE 2023

1. 跨模态检索 3454 篇

Deep Class-guided Hashing for Multi-label Cross-modal Retrieval

PhysioFormer: Integrating Multimodal Physiological Signals and Symbolic Regression for Explainable Affective State Prediction

Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations

Ensemble manifold based regularized multi-modal graph convolutional network for cognitive ability prediction

MedTsLLM: Leveraging LLMs for Multimodal Medical Time Series Analysis

AutoM3L: An Automated Multimodal Machine Learning Framework with Large Language Models

Global atmospheric data assimilation with multi-modal masked autoencoders

An Interactive Multi-modal Query Answering System with Retrieval-Augmented Large Language Models

MIREncoder: Multi-modal IR-based Pretrained Embeddings for Performance Optimizations

Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL

MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module Plugin

Category-Oriented Representation Learning for Image to Multi-Modal Retrieval

Improving Paratope and Epitope Prediction by Multi-Modal Contrastive Learning and Interaction Informativeness Estimation

ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

End-to-end training of Multimodal Model and ranking Model

Multi-Modal Contrastive Learning for Online Clinical Time-Series Applications

Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity

Virtual Co-Pilot: Multimodal Large Language Model-enabled Quick-access Procedures for Single Pilot Operations

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift

Retrieval Augmented Cross-Modal Tag Recommendation in Software Q&A Sites

Multi-modal Causal Structure Learning and Root Cause Analysis

PhotoScout: Synthesis-Powered Multi-Modal Image Search

Multimodal machine learning for 3-dimensional characterization of hidden groundwater and geothermal resources

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graph

Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

Hilbert Space Embedding-based Trajectory Optimization for Multi-Modal Uncertain Obstacle Trajectory Prediction

Sampling Multimodal Distributions with the Vanilla Score: Benefits of Data-Based Initialization

Beyond Co-occurrence: Multi-modal Session-based Recommendation