多模态大模型

Attribute-driven Disentangled Representation Learning for Multimodal Recommendation

Zhenyang Li, Fan Liu, Yinwei Wei, Zhiyong Cheng, Liqiang Nie, Mohan Kankanhalli

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.MM

Comments ACM Multimedia 2024 Accepted

Journal ref In Proceedings of the 32st ACM International Conference on Multimedia (MM '24), 2024

Multimodal Detection of Bots on X (Twitter) using Transformers

Loukas Ilias, Ioannis Michail Kazelidis, Dimitris Askounis

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CL

Comments IEEE Transactions on Information Forensics and Security (Accepted)

A Unified Graph Transformer for Overcoming Isolations in Multi-modal Recommendation

Zixuan Yi, Iadh Ounis

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning

Haojian Huang, Xiaozhen Qiao, Zhuo Chen, Haodong Chen, Bingyu Li, Zhe Sun, Mulin Chen, Xuelong Li

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ACM MM 2024; 10 pages, 2 Tables, 9 Figures; Repo is available at: https://github.com/JethroJames/CREST

Accelerating Pre-training of Multimodal LLMs via Chain-of-Sight

Ziyuan Huang, Kaixiang Ji, Biao Gong, Zhiwu Qing, Qinglong Zhang, Kecheng Zheng, Jian Wang, Jingdong Chen, Ming Yang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Token-level Correlation-guided Compression for Efficient Multimodal Document Understanding

Renshan Zhang, Yibo Lyu, Rui Shao, Gongwei Chen, Weili Guan, Liqiang Nie

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

TaGAT: Topology-Aware Graph Attention Network For Multi-modal Retinal Image Fusion

Xin Tian, Nantheera Anantrasirichai, Lindsay Nicholson, Alin Achim

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments 11 pages, 2 figures, accepted by MICCAI 2024

GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal Recommendation

Guojiao Lin, Zhen Meng, Dongjie Wang, Qingqing Long, Yuanchun Zhou, Meng Xiao

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments 11 pages, accepted by CIKM 2024

MEDFuse: Multimodal EHR Data Fusion with Masked Lab-Test Modeling and Large Language Models

Thao Minh Nguyen Phan, Cong-Tinh Dao, Chenwei Wu, Jian-Zhe Wang, Shun Liu, Jun-En Ding, David Restrepo, Feng Liu, Fang-Ming Hung, Wen-Chih Peng

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CL

Credibility-Aware Multi-Modal Fusion Using Probabilistic Circuits

Sahil Sidheekh, Pranuthi Tenali, Saurabh Mathur, Erik Blasch, Kristian Kersting, Sriraam Natarajan

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

Distractors-Immune Representation Learning with Cross-modal Contrastive Regularization for Change Captioning

Yunbin Tu, Liang Li, Li Su, Chenggang Yan, Qingming Huang

专题命中 多模态训练与对齐 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

Multimodal Infusion Tuning for Large Models

Hao Sun, Yu Song, Xinyao Yu, Jiaqing Liu, Yen-Wei Chen, Lanfen Lin

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.MM

A Survey on Safe Multi-Modal Learning System

Tianyi Zhao, Liangliang Zhang, Yao Ma, Lu Cheng

专题命中 多模态训练与对齐 ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understanding

Ruihuang Li, Zhengqiang Zhang, Chenhang He, Zhiyuan Ma, Vishal M. Patel, Lei Zhang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

DSCENet: Dynamic Screening and Clinical-Enhanced Multimodal Fusion for MPNs Subtype Classification

Yuan Zhang, Yaolei Qi, Xiaoming Qi, Yongyue Wei, Guanyu Yang

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI2024

MMA-UNet: A Multi-Modal Asymmetric UNet Architecture for Infrared and Visible Image Fusion

Jingxue Huang, Xilai Li, Tianshu Tan, Xiaosong Li, Tao Ye

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Multi-Modal Prototypes for Open-World Semantic Segmentation

Yuhuan Yang, Chaofan Ma, Chen Ju, Fei Zhang, Jiangchao Yao, Ya Zhang, Yanfeng Wang

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments accepted in IJCV

TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Data

Siyi Du, Shaoming Zheng, Yinsong Wang, Wenjia Bai, Declan P. O'Regan, Chen Qin

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments 28 pages (including 9 pages of supplementary materials), accepted by ECCV 2024

LVLM-empowered Multi-modal Representation Learning for Visual Place Recognition

Teng Wang, Lingquan Meng, Lei Cheng, Changyin Sun

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Enhance the Robustness of Text-Centric Multimodal Alignments

Ting-Yu Yen, Yun-Da Tsai, Keng-Te Liao, Shou-De Lin

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CL

MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion

Jing Zou, Lanqing Liu, Qi Chen, Shujun Wang, Zhanli Hu, Xiaohan Xing, Jing Qin

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments 10 pages, 5 figure

Fine-grained Context and Multi-modal Alignment for Freehand 3D Ultrasound Reconstruction

Zhongnuo Yan, Xin Yang, Mingyuan Luo, Jiongquan Chen, Rusi Chen, Lian Liu, Dong Ni

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted at MICCAI 2024. This is the submitted manuscript and the preprint has not undergone peer review (when applicable) or any post-submission improvements or corrections

Autonomous Soundscape Augmentation with Multimodal Fusion of Visual and Participant-linked Inputs

Kenneth Ooi, Karn N. Watcharasupat, Bhan Lam, Zhen-Ting Ong, Woon-Seng Gan

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 eess.AS

Comments [v1] 5 pages, 2 figures. Submitted to 2023 IEEE International Conference on Acoustics, Speech and Signal Processing. [v2] 5 pages, 2 figures. Fixed incorrect author list in citation #30

Journal ref ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Jun. 2023, pp. 1-5

MMBee: Live Streaming Gift-Sending Recommendations via Multi-Modal Fusion and Behaviour Expansion

Jiaxin Deng, Shiyao Wang, Yuchen Wang, Jiansong Qi, Liqin Zhao, Guorui Zhou, Gaofeng Meng

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.AI

Comments Accepted at KDD 2024

MDF: A Dynamic Fusion Model for Multi-modal Fake News Detection

Hongzhen Lv, Wenzhong Yang, Fuyuan Wei, Jiaren Peng, Haokun Geng

专题命中 多模态训练与对齐 ：multi-modal(title,abstract)；分类 cs.MM

Multimodal Learning With Intraoperative CBCT & Variably Aligned Preoperative CT Data To Improve Segmentation

Maximilian E. Tschuchnig, Philipp Steininger, Michael Gadermayr

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments Submitted to SASHIMI2024 (MICCAI workshop)

Multimodal Prototyping for cancer survival prediction

Andrew H. Song, Richard J. Chen, Guillaume Jaume, Anurag J. Vaidya, Alexander S. Baras, Faisal Mahmood

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

Comments ICML 2024

MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning

Liang Peng, Songyue Cai, Zongqian Wu, Huifang Shang, Xiaofeng Zhu, Xiaoxiao Li

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.CV

MolFusion: Multimodal Fusion Learning for Molecular Representations via Multi-granularity Views

Muzhen Cai, Sendong Zhao, Haochun Wang, Yanrui Du, Zewen Qiang, Bing Qin, Ting Liu

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI

Comments 8 pages, 5 figures

Multimodal Physiological Signals Representation Learning via Multiscale Contrasting for Depression Recognition

Kai Shao, Rui Wang, Yixue Hao, Long Hu, Min Chen, Hans Arno Jacobsen

专题命中 多模态训练与对齐 ：multimodal(title,abstract)；分类 cs.AI