多模态大模型

Refining Contrastive Learning and Homography Relations for Multi-Modal Recommendation

Shouxing Ma, Yawen Zeng, Shiqing Wu, Guandong Xu

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments This paper has been accepted as a full paper at ACM MM 2025

M2IO-R1: An Efficient RL-Enhanced Reasoning Framework for Multimodal Retrieval Augmented Multimodal Generation

Zhiyou Xiao, Qinhan Yu, Binghui Li, Geng Chen, Chong Chen, Wentao Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

GUI-ReRank: Enhancing GUI Retrieval with Multi-Modal LLM-based Reranking

Kristian Kolthoff, Felix Kretzer, Christian Bartelt, Alexander Maedche, Simone Paolo Ponzetto

专题命中 跨模态检索 ：multi-modal(title)；MLLM(abstract)

CLIProv: A Contrastive Log-to-Intelligence Multimodal Approach for Threat Detection and Provenance Analysis

Jingwen Li, Ru Zhang, Jianyi Liu, Wanguo Zhao

专题命中 跨模态检索 ：multimodal(title,abstract)

Can We Reliably Predict the Fed's Next Move? A Multi-Modal Approach to U.S. Monetary Policy Forecasting

Fiona Xiao Jingyi, Lili Liu

机构 * National University of Singapore（新加坡国立大学） 纠错

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 9 pages, 15 figures

Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraints

Yash Sinha, Murari Mandal, Mohan Kankanhalli

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Extended Version, Accepted at AAAI 2025. 17 pages, 4 figures and 9 tables

Journal ref In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 12, pp. 12541-12549. 2025

Agent-based Condition Monitoring Assistance with Multimodal Industrial Database Retrieval Augmented Generation

Karl Löwenmark, Daniel Strömbergsson, Chang Liu, Marcus Liwicki, Fredrik Sandin

专题命中 跨模态检索 ：multimodal(title,abstract)

Needle: A Generative AI-Powered Multi-modal Database for Answering Complex Natural Language Queries

Mahdi Erfanian, Mohsen Dehghankar, Abolfazl Asudeh

专题命中 跨模态检索 ：multi-modal(title,abstract)

Wireless Agentic AI with Retrieval-Augmented Multimodal Semantic Perception

Guangyuan Liu, Yinqiu Liu, Ruichen Zhang, Hongyang Du, Dusit Niyato, Zehui Xiong, Sumei Sun, Abbas Jamalipour

专题命中 跨模态检索 ：multimodal(title,abstract)

Robust Multimodal Learning via Entropy-Gated Contrastive Fusion

Leon Chlon, Maggie Chlon, MarcAntonio M. Awada

专题命中 跨模态检索 ：multimodal(title,abstract)

Multi-modal contrastive learning adapts to intrinsic dimensions of shared latent variables

Yu Gui, Cong Ma, Zongming Ma

机构 * Department of Statistics, University of Chicago（芝加哥大学统计系） ； Department of Statistics and Data Science, Yale University（耶鲁大学统计学与数据科学系） 纠错

专题命中 跨模态检索 ：multi-modal(title,abstract)

KAP: MLLM-assisted OCR Text Enhancement for Hybrid Retrieval in Chinese Non-Narrative Documents

Hsin-Ling Hsu, Ping-Sheng Lin, Jing-Di Lin, Jengnan Tzeng

专题命中 跨模态检索 ：MLLM(title)；multimodal(abstract)

Quadratic Interest Network for Multimodal Click-Through Rate Prediction

Honghao Li, Hanwei Li, Jing Zhang, Yi Zhang, Ziniu Yu, Lei Sang, Yiwen Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphs

Yufei He, Yuan Sui, Xiaoxin He, Yue Liu, Yifei Sun, Bryan Hooi

机构 * National University of Singapore（新加坡国立大学） ； Zhejiang University（浙江大学） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments WWW 2025

Media Content Atlas: A Pipeline to Explore and Investigate Multidimensional Media Space using Multimodal LLMs

Merve Cerit, Eric Zelikman, Mu-Jung Cho, Thomas N. Robinson, Byron Reeves, Nilam Ram, Nick Haber

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted to CHI 2025, in press. See the project page at mediacontentatlas.github.io

PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals

Saurav R. Pandey, Aaqib Saeed, Harlin Lee

机构 * Department of Computer Science（计算机科学系） ； Department of Industrial Design（工业设计系） ； School of Data Science and Society（数据科学与社会学院） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)

Journal ref 2024 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), Houston, TX, USA, 2024, pp. 1-8

BBQRec: Behavior-Bind Quantization for Multi-Modal Sequential Recommendation

Kaiyuan Li, Rui Xiang, Yong Bai, Yongxiang Tang, Yanhua Cheng, Xialong Liu, Peng Jiang, Kun Gai

专题命中 跨模态检索 ：multi-modal(title,abstract)

Retrieval Augmented Generation with Multi-Modal LLM Framework for Wireless Environments

Muhammad Ahmed Mohsin, Ahsan Bilal, Sagnik Bhattacharya, John M. Cioffi

专题命中 跨模态检索 ：multi-modal(title)；multimodal(abstract)

Comments Accepted @ ICC 2025

PacketCLIP: Multi-Modal Embedding of Network Traffic and Language for Cybersecurity Reasoning

Ryozo Masukawa, Sanggeon Yun, Sungheon Jeong, Wenjun Huang, Yang Ni, Ian Bryant, Nathaniel D. Bastian, Mohsen Imani

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 7 pages, 7 figures

Quantum Multimodal Contrastive Learning Framework

Chi-Sheng Chen, Aidan Hung-Wen Tsai, Sheng-Chieh Huang

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments 15 pages

Weighted Point Set Embedding for Multimodal Contrastive Learning Toward Optimal Similarity Metric

Toshimitsu Uesaka, Taiji Suzuki, Yuhta Takida, Chieh-Hsin Lai, Naoki Murata, Yuki Mitsufuji

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments ICLR 2025 (Spotlight)

Challenges of Multi-Modal Coreset Selection for Depth Prediction

Viktor Moskvoretskii, Narek Alvandian

专题命中 跨模态检索 ：multi-modal(title)；multimodal(abstract)

Cross-Modal Search and Exploration of Greek Painted Pottery

Elisabeth Trinkl, Stephan Karl, Stefan Lengauer, Reinhold Preiner, Tobias Schreck

专题命中 跨模态检索 ：cross-modal(title)；multimodal(abstract)

Comments 14 pages, 10 figures, preprint for a book chapter, supplementary video available at https://youtu.be/x_Xg0vy3nJY

Journal ref The 3 Dimensions of Digitalised Archaeology: State-of-the-Art, Data Management and Current Challenges in Archaeological 3D-Documentation, Springer International Publishing, 2024

Multimodal semantic retrieval for product search

Dong Liu, Esther Lopez Ramos

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted at EReL@MIR WWW 2025

MQRLD: A Multimodal Data Retrieval Platform with Query-aware Feature Representation and Learned Index Based on Data Lake

Ming Sheng, Shuliang Wang, Yong Zhang, Kaige Wang, Jingyi Wang, Yi Luo, Rui Hao

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments 34 pages, 28 figures

STAIR: Manipulating Collaborative and Multimodal Information for E-Commerce Recommendation

Cong Xu, Yunhang He, Jun Wang, Wei Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted at AAAI 2025

Embedding-based Multimodal Learning on Pan-Squamous Cell Carcinomas for Improved Survival Outcomes

Asim Waqas, Aakash Tripathi, Paul Stewart, Mia Naeini, Matthew B. Schabath, Ghulam Rasool

专题命中 跨模态检索 ：multimodal(title,abstract)

On the Comparison between Multi-modal and Single-modal Contrastive Learning

Wei Huang, Andi Han, Yongqiang Chen, Yuan Cao, Zhiqiang Xu, Taiji Suzuki

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 51pages, 1 figure, 1 table

Journal ref NeurIPS 2024

Towards Cross-Modal Text-Molecule Retrieval with Better Modality Alignment

Jia Song, Wanru Zhuang, Yujie Lin, Liang Zhang, Chunyan Li, Jinsong Su, Song He, Xiaochen Bo

专题命中 跨模态检索 ：cross-modal(title,abstract)

Comments BIBM 2024 regular paper

Test-time Adaptation for Cross-modal Retrieval with Query Shift

Haobin Li, Peng Hu, Qianjun Zhang, Xi Peng, Xiting Liu, Mouxing Yang

专题命中 跨模态检索 ：cross-modal(title,abstract)

Comments 22 pages, 8 figures