多模态大模型 - arXivDaily 专题

2406.18962 2025-02-28 cs.IR 78%

Multi-modal Food Recommendation using Clustering and Self-supervised Learning

Yixin Zhang, Xin Zhou, Qianwen Meng, Fanglin Zhu, Yonghui Xu, Zhiqi Shen, Lizhen Cui

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments Working paper

2502.16194 2025-02-25 eess.SP 78%

Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication

Yi Ma, Chunmei Xu, Zhenyu Liu, Siqi Zhang, Rahim Tafazolli

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments Accepted by IEEE ICMLCN 2025

2502.15993 2025-02-25 cs.SI 78%

Community Detection in Multimodal Data: A Similarity Network Perspective

Aidan Marnane, T. Ian Simpson

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

Comments 21 pages, 8 figures

2501.11916 2025-02-25 cs.IR 78%

Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations

Jin Li, Shoujin Wang, Qi Zhang, Shui Yu, Fang Chen

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by WWW 2025

2304.10740 2025-02-17 q-fin.GN cs.LG 78%

Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams

Mahsa Tavakoli, Rohitash Chandra, Fengrui Tian, Cristián Bravo

专题命中多模态训练与对齐：multi-modal(title,abstract)

Journal ref Applied Soft Computing, Volume 171, March 2025, 112771

2411.04708 2025-02-14 cs.LG 78%

Exploring Hierarchical Molecular Graph Representation in Multimodal LLMs

Chengxin Hu, Hao Li, Yihe Yuan, Jing Li, Ivor Tsang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 9 pages, 4 tables, 1 figure, paper under review

2502.05822 2025-02-11 cs.IR 78%

HCMRM: A High-Consistency Multimodal Relevance Model for Search Ads

Guobing Gan, Kaiming Gao, Li Wang, Shen Jiang, Peng Jiang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by WWW 2025 (Industry Track)

2501.06764 2025-01-27 cs.LG 78%

MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection

Kaiying Yan, Moyang Liu, Yukun Liu, Ruibo Fu, Zhengqi Wen, Jianhua Tao, Xuefei Liu, Guanjun Li

专题命中多模态训练与对齐：multimodal(title,abstract)

2405.16789 2025-01-22 cs.IR 78%

NoteLLM-2: Multimodal Large Representation Models for Recommendation

Chao Zhang, Haoxin Zhang, Shiwei Wu, Di Wu, Tong Xu, Xiangyu Zhao, Yan Gao, Yao Hu, Enhong Chen

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted by KDD'25 ADS track

2412.18437 2025-01-22 cs.LG 78%

MixMAS: A Framework for Sampling-Based Mixer Architecture Search for Multimodal Fusion and Learning

Abdelmadjid Chergui, Grigor Bezirganyan, Sana Sellami, Laure Berti-Équille, Sébastien Fournier

专题命中多模态训练与对齐：multimodal(title,abstract)

Journal ref 2024 IEEE International Conference on Big Data (BigData), Washington, DC, USA, 2024, pp. 3254-3257

2501.08267 2025-01-15 cs.IR cs.SI 78%

TriMod Fusion for Multimodal Named Entity Recognition in Social Media

Mosab Alfaqeeh

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted at CASCON

2412.08649 2024-12-18 q-bio.BM cs.LG 78%

Multi-modal Representation Learning Enables Accurate Protein Function Prediction in Low-Data Setting

Serbülent Ünsal, Sinem Özdemir, Bünyamin Kasap, M. Erşan Kalaycı, Kemal Turhan, Tunca Doğan, Aybar C. Acar

专题命中多模态训练与对齐：multi-modal(title)；multimodal(abstract)

2412.11747 2024-12-17 cs.IR 78%

Beyond Graph Convolution: Multimodal Recommendation with Topology-aware MLPs

Junjie Huang, Jiarui Qin, Yong Yu, Weinan Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments AAAI 2025. 11 pages, 9 figures

2402.01071 2024-12-03 cs.LG cs.CY cs.DB 78%

Chameleon: Foundation Models for Fairness-aware Multi-modal Data Augmentation to Enhance Coverage of Minorities

Mahdi Erfanian, H. V. Jagadish, Abolfazl Asudeh

专题命中多模态训练与对齐：multi-modal(title,abstract)

2411.15593 2024-11-26 cs.HC 78%

Medillustrator: Improving Retrospective Learning in Physicians' Continuous Medical Education via Multimodal Diagnostic Data Alignment and Representation

Yuansong Xu, Jiahe Dong, Yijie Fan, Yuheng Shao, Chang Jiang, Lixia Jin, Yuanwu Cao, Quan Li

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments To be appeard in Proceedings of Chinese CHI 2024

2403.07187 2024-11-26 cs.LG 78%

UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation

Junhong Shen, Tanya Marwah, Ameet Talwalkar

专题命中多模态训练与对齐：cross-modal(title,abstract)

Comments TMLR 2024; ICML 2024 AI for Science Workshop (Spotlight)

2410.00392 2024-11-22 eess.SY cs.AR cs.SY 78%

MERIT: Multimodal Wearable Vital Sign Waveform Monitoring

Yongyang Tang, Zhe Chen, Ang Li, Tianyue Zheng, Zheng Lin, Jia Xu, Pin Lv, Zhe Sun, Yue Gao

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 8 pages, 10 figures

2411.08664 2024-11-14 cs.LG cond-mat.mtrl-sci 78%

UniMat: Unifying Materials Embeddings through Multi-modal Learning

Janghoon Ock, Joseph Montoya, Daniel Schweigert, Linda Hung, Santosh K. Suram, Weike Ye

专题命中多模态训练与对齐：multi-modal(title,abstract)

2411.07043 2024-11-12 stat.ML cs.LG 78%

Unified Bayesian representation for high-dimensional multi-modal biomedical data for small-sample classification

Albert Belenguer-Llorens, Carlos Sevilla-Salcedo, Jussi Tohka, Vanessa Gómez-Verdejo

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 36 pages, 3 figures and 3 tables

2411.00725 2024-11-04 cs.LG 78%

Exploring Multi-Modality Dynamics: Insights and Challenges in Multimodal Fusion for Biomedical Tasks

Laura Wenderoth

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

2410.22558 2024-10-31 cs.LG eess.SP 78%

Unsupervised Multimodal Fusion of In-process Sensor Data for Advanced Manufacturing Process Monitoring

Matthew McKinney, Anthony Garland, Dale Cillessen, Jesse Adamczyk, Dan Bolintineanu, Michael Heiden, Elliott Fowler, Brad L. Boyce

专题命中多模态训练与对齐：multimodal(title,abstract)

2306.11963 2024-10-28 cs.IR 78%

A Survey of Multimodal Information Fusion for Smart Healthcare: Mapping the Journey from Data to Wisdom

Thanveer Shaik, Xiaohui Tao, Lin Li, Haoran Xie, Juan D. Velásquez

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments This work has been submitted to the ELSEVIER for possible publication

2410.17551 2024-10-24 cs.LG cs.RO 78%

Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensors

Bang You, Huaping Liu

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments 31 pages

Journal ref Neural Networks, 176(2024)

2401.07408 2024-10-15 cs.CE 78%

Multimodal Language and Graph Learning of Adsorption Configuration in Catalysis

Janghoon Ock, Srivathsan Badrinarayanan, Rishikesh Magar, Akshay Antony, Amir Barati Farimani

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)

Comments manuscript updated

2409.16627 2024-10-03 cs.IR 78%

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

Yueqi Wang, Zhenrui Yue, Huimin Zeng, Dong Wang, Julian McAuley

专题命中多模态训练与对齐：multimodal(title,abstract)

Comments Accepted to EMNLP 2024 Findings

2409.18462 2024-09-30 cs.LG q-bio.NC 78%

Latent Representation Learning for Multimodal Brain Activity Translation

Arman Afrasiyabi, Dhananjay Bhaskar, Erica L. Busch, Laurent Caplette, Rahul Singh, Guillaume Lajoie, Nicholas B. Turk-Browne, Smita Krishnaswamy

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.12481 2024-09-20 cs.CE 78%

A physics-enhanced multi-modal fused neural network for predicting contamination length interval in pipeline

Jian Du, Pengtao Niu, Jianqin Zheng, Qi Liao, Yongtu Liang

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 16 pages, 9 figures. This paper is one of the research outputs of the intelligent oil and gas pipeline in our team, which can be abbreviated as "DeepPipe". This paper have been submitted to the journal and is under review

2409.11906 2024-09-19 cs.RO 78%

Fusion in Context: A Multimodal Approach to Affective State Recognition

Youssef Mohamed, Severin Lemaignan, Arzu Guneysu, Patric Jensfelt, Christian Smith

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.11609 2024-09-19 cs.LG 78%

Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model

Derek Jollie, Jingmin Sun, Zecheng Zhang, Hayden Schaeffer

专题命中多模态训练与对齐：multimodal(title,abstract)

2409.10993 2024-09-18 cs.IR 78%

Multi-modal Generative Models in Recommendation System

Arnau Ramisa, Rene Vidal, Yashar Deldjoo, Zhankui He, Julian McAuley, Anton Korikov, Scott Sanner, Mahesh Sathiamoorthy, Atoosa Kasrizadeh, Silvia Milano, Francesco Ricci

专题命中多模态训练与对齐：multi-modal(title,abstract)

Comments 32 pages 5 figures

1. 多模态训练与对齐 6897 篇

Multi-modal Food Recommendation using Clustering and Self-supervised Learning

Importance-Aware Source-Channel Coding for Multi-Modal Task-Oriented Semantic Communication

Community Detection in Multimodal Data: A Similarity Network Perspective

Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendations

Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streams

Exploring Hierarchical Molecular Graph Representation in Multimodal LLMs

HCMRM: A High-Consistency Multimodal Relevance Model for Search Ads

MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection

NoteLLM-2: Multimodal Large Representation Models for Recommendation

MixMAS: A Framework for Sampling-Based Mixer Architecture Search for Multimodal Fusion and Learning

TriMod Fusion for Multimodal Named Entity Recognition in Social Media

Multi-modal Representation Learning Enables Accurate Protein Function Prediction in Low-Data Setting

Beyond Graph Convolution: Multimodal Recommendation with Topology-aware MLPs

Chameleon: Foundation Models for Fairness-aware Multi-modal Data Augmentation to Enhance Coverage of Minorities

Medillustrator: Improving Retrospective Learning in Physicians' Continuous Medical Education via Multimodal Diagnostic Data Alignment and Representation

UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation

MERIT: Multimodal Wearable Vital Sign Waveform Monitoring

UniMat: Unifying Materials Embeddings through Multi-modal Learning

Unified Bayesian representation for high-dimensional multi-modal biomedical data for small-sample classification

Exploring Multi-Modality Dynamics: Insights and Challenges in Multimodal Fusion for Biomedical Tasks

Unsupervised Multimodal Fusion of In-process Sensor Data for Advanced Manufacturing Process Monitoring

A Survey of Multimodal Information Fusion for Smart Healthcare: Mapping the Journey from Data to Wisdom

Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensors

Multimodal Language and Graph Learning of Adsorption Configuration in Catalysis

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation

Latent Representation Learning for Multimodal Brain Activity Translation

A physics-enhanced multi-modal fused neural network for predicting contamination length interval in pipeline

Fusion in Context: A Multimodal Approach to Affective State Recognition

Time-Series Forecasting, Knowledge Distillation, and Refinement within a Multimodal PDE Foundation Model

Multi-modal Generative Models in Recommendation System