多模态信息融合 - arXivDaily 专题

2304.02830 2024-03-12 math.OC cs.SY eess.SY 50%

A Mixing-Accelerated Primal-Dual Proximal Algorithm for Distributed Nonconvex Optimization

Zichong Ou, Chenyang Qiu, Dandan Wang, Jie Lu

专题命中融合架构与评测：information fusion(abstract)

Comments 8 pages, 2 figures, accepted by ACC2024

2403.03791 2024-03-07 cs.LG cs.AI 50%

KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs

Ruoqi Liu, Lingfei Wu, Ping Zhang

专题命中融合架构与评测：information fusion(abstract)

Comments AAAI 2024 Main Track

2402.17906 2024-02-29 cs.LG cs.SI 50%

Representation learning in multiplex graphs: Where and how to fuse information?

Piotr Bielak, Tomasz Kajdanowicz

专题命中融合架构与评测：information fusion(abstract)

2402.12183 2024-02-20 cs.AI 50%

MultiFIX: An XAI-friendly feature inducing approach to building models from multimodal data

Mafalda Malafaia, Thalea Schlender, Peter A. N. Bosman, Tanja Alderliesten

专题命中融合架构与评测：multimodal fusion(abstract)

Comments 8 pages, 9 figures

2402.07016 2024-02-13 cs.AI 50%

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

Yinghao Zhu, Changyu Ren, Shiyun Xie, Shukai Liu, Hangyuan Ji, Zixiang Wang, Tao Sun, Long He, Zhoujun Li, Xi Zhu, Chengwei Pan

专题命中融合架构与评测：multimodal fusion(abstract)

2402.01350 2024-02-13 cs.LG cs.DC 50%

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Liping Yi, Han Yu, Chao Ren, Heng Zhang, Gang Wang, Xiaoguang Liu, Xiaoxiao Li

专题命中融合架构与评测：information fusion(abstract)

2402.00491 2024-02-02 cs.AI cs.HC 50%

EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations

Aditya Bhattacharya, Simone Stumpf, Lucija Gosak, Gregor Stiglic, Katrien Verbert

专题命中融合架构与评测：hybrid fusion(abstract)

Comments This is a pre-print version only for early release. Please view the conference published version from ACM CHI 2024 to get the latest version of the paper

Journal ref Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA

2401.16960 2024-01-31 cs.CL cs.AI 50%

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Linyao Yang, Hongyang Chen, Xiao Wang, Jing Yang, Fei-Yue Wang, Han Liu

专题命中融合架构与评测：information fusion(abstract)

2401.13298 2024-01-25 cs.CL cs.AI 50%

Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models

Hongzhan Lin, Ziyang Luo, Wei Gao, Jing Ma, Bo Wang, Ruichao Yang

专题命中融合架构与评测：multimodal fusion(abstract)

Comments The first work towards explainable harmful meme detection by harnessing advanced LLMs

Journal ref The ACM Web Conference 2024

2401.00521 2024-01-02 cs.LG cs.AI stat.AP 50%

Multi-spatial Multi-temporal Air Quality Forecasting with Integrated Monitoring and Reanalysis Data

Yuxiao Hu, Qian Li, Xiaodan Shi, Jinyue Yan, Yuntian Chen

专题命中融合架构与评测：information fusion(abstract)

2310.09596 2023-12-27 cs.CL 50%

RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification

Junjie Ye, Jie Zhou, Junfeng Tian, Rui Wang, Qi Zhang, Tao Gui, Xuanjing Huang

专题命中融合架构与评测：multimodal fusion(abstract)

2312.14533 2023-12-25 cs.IR cs.AI cs.LG 50%

Multi-view user representation learning for user matching without personal information

Hongliu Cao, Ilias El Baamrani, Eoin Thomas

专题命中融合架构与评测：information fusion(abstract)

2205.00867 2023-12-14 cs.SI 50%

Capturing High-order Structures on Motif-based Graph Nerual Networks

Kejia Zhang

专题命中融合架构与评测：information fusion(abstract)

Comments some metric have problem

2312.06397 2023-12-12 cs.DB cs.IR 50%

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Mengzhao Wang, Xiangyu Ke, Xiaoliang Xu, Lu Chen, Yunjun Gao, Pinpin Huang, Runkai Zhu

专题命中融合架构与评测：hybrid fusion(abstract)

Comments This paper has been accepted by ICDE 2024

2312.05434 2023-12-12 cs.CL 50%

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Hongzhan Lin, Ziyang Luo, Jing Ma, Long Chen

专题命中融合架构与评测：multimodal fusion(abstract)

Comments The first work to alleviate the issue of superficial understanding for harmful meme detection by explicitly utilizing commonsense knowledge, from a fresh perspective on harnessing advanced Large Language Models

Journal ref The 2023 Conference on Empirical Methods in Natural Language Processing

2311.11009 2023-11-21 cs.CL 50%

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

Dongyuan Li, Yusong Wang, Kotaro Funakoshi, Manabu Okumura

专题命中融合架构与评测：multimodal fusion(abstract)

2308.08991 2023-11-21 cs.SE 50%

Who is the Real Hero? Measuring Developer Contribution via Multi-dimensional Data Integration

Yuqiang Sun, Zhengzi Xu, Chengwei Liu, Yiran Zhang, Yang Liu

专题命中融合架构与评测：information fusion(abstract)

2311.08134 2023-11-15 astro-ph.IM astro-ph.HE 50%

Applying hybrid clustering in pulsar candidate sifting with multi-modality for FAST survey

Zi-Yi You, Yun-Rong Pan, Zhi Ma, Li Zhang, Shuo Xiao, Dan-Dan Zhang, Shi-Jun Dang, Ru-Shuang Zhao, Pei Wang, Ai-Jun Dong, Jia-Tao Jiang, Ji-Bing Leng, Wei-An Li, Si-Yao Li

专题命中融合架构与评测：feature-level fusion(abstract)

2307.06775 2023-11-07 cs.LG cs.AI cs.CL cs.SI 50%

A Novel Site-Agnostic Multimodal Deep Learning Model to Identify Pro-Eating Disorder Content on Social Media

Jonathan Feldman

专题命中融合架构与评测：multimodal fusion(abstract)

2310.10179 2023-10-17 eess.AS cs.SD 50%

Advancing Audio Emotion and Intent Recognition with Large Pre-Trained Models and Bayesian Inference

Dejan Porjazovski, Yaroslav Getman, Tamás Grósz, Mikko Kurimo

专题命中融合架构与评测：multimodal fusion(abstract)

Comments Accepted at ACMM 2023

2305.01523 2023-10-17 cs.LG cs.AI cs.CE 50%

Towards Unified AI Drug Discovery with Multiple Knowledge Modalities

Yizhen Luo, Xing Yi Liu, Kai Yang, Kui Huang, Massimo Hong, Jiahuan Zhang, Yushuai Wu, Zaiqing Nie

专题命中融合架构与评测：multimodal fusion(abstract)

Comments 10 pages, 6 figures

2309.02911 2023-10-10 cs.LG 50%

A Multimodal Learning Framework for Comprehensive 3D Mineral Prospectivity Modeling with Jointly Learned Structure-Fluid Relationships

Yang Zheng, Hao Deng, Ruisheng Wang, Jingjie Wu

专题命中融合架构与评测：multimodal fusion(abstract)

Comments Upon careful review, it has come to our attention that inaccuracies exist in the formulation of the structure-fluid relationships, impacting the validity of the presented results

2310.02453 2023-10-05 cs.LG 50%

Dual-stage Flows-based Generative Modeling for Traceable Urban Planning

Xuanming Hu, Wei Fan, Dongjie Wang, Pengyang Wang, Yong Li, Yanjie Fu

专题命中融合架构与评测：information fusion(abstract)

2308.14063 2023-09-07 cs.SD eess.AS 50%

Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

Hejing Zhang, Jian Guan, Qiaoxi Zhu, Feiyang Xiao, Youde Liu

专题命中融合架构与评测：information fusion(abstract)

Comments Published in INTERSPEECH 2023

2308.04067 2023-08-15 cs.IR 50%

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

Wei Ji, Xiangyan Liu, An Zhang, Yinwei Wei, Yongxin Ni, Xiang Wang

专题命中融合架构与评测：information fusion(abstract)

Comments 11 pages, 7 figures, accepted in ACM MM 2023

2307.16026 2023-08-01 cs.LG cs.SI 50%

MUSE: Multi-View Contrastive Learning for Heterophilic Graphs

Mengyi Yuan, Minjie Chen, Xiang Li

专题命中融合架构与评测：information fusion(abstract)

2306.03645 2023-08-01 cs.CE 50%

Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loads

Junyan He, Seid Koric, Shashank Kushwaha, Jaewan Park, Diab Abueidda, Iwona Jasiuk

专题命中融合架构与评测：information fusion(abstract)

2307.14952 2023-07-28 cs.LG cs.DC cs.NI 50%

Network Fault-tolerant and Byzantine-resilient Social Learning via Collaborative Hierarchical Non-Bayesian Learning

Connor Mclaughlin, Matthew Ding, Denis Edogmus, Lili Su

专题命中融合架构与评测：information fusion(abstract)

Comments 11 pages, 1 figure

2306.15796 2023-06-29 cs.AI 50%

ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis

Yakun Yu, Mingjun Zhao, Shi-ang Qi, Feiran Sun, Baoxun Wang, Weidong Guo, Xiaoli Wang, Lei Yang, Di Niu

专题命中融合架构与评测：multimodal fusion(abstract)

Comments Accepted by ACL Findings 2023

2306.13957 2023-06-27 cs.LG q-bio.BM 50%

DiffDTM: A conditional structure-free framework for bioactive molecules generation targeted for dual proteins

Lei Huang, Zheng Yuan, Huihui Yan, Rong Sheng, Linjing Liu, Fuzhou Wang, Weidun Xie, Nanjun Chen, Fei Huang, Songfang Huang, Ka-Chun Wong, Yaoyun Zhang

专题命中融合架构与评测：information fusion(abstract)

1. 融合架构与评测 1409 篇

A Mixing-Accelerated Primal-Dual Proximal Algorithm for Distributed Nonconvex Optimization

KG-TREAT: Pre-training for Treatment Effect Estimation by Synergizing Patient Data with Knowledge Graphs

Representation learning in multiplex graphs: Where and how to fuse information?

MultiFIX: An XAI-friendly feature inducing approach to building models from multimodal data

REALM: RAG-Driven Enhancement of Multimodal Electronic Health Records Analysis via Large Language Models

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models

Multi-spatial Multi-temporal Air Quality Forecasting with Integrated Monitoring and Reanalysis Data

RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification

Multi-view user representation learning for user matching without personal information

Capturing High-order Structures on Motif-based Graph Nerual Networks

MUST: An Effective and Scalable Framework for Multimodal Search of Target Modality

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

Who is the Real Hero? Measuring Developer Contribution via Multi-dimensional Data Integration

Applying hybrid clustering in pulsar candidate sifting with multi-modality for FAST survey

A Novel Site-Agnostic Multimodal Deep Learning Model to Identify Pro-Eating Disorder Content on Social Media

Advancing Audio Emotion and Intent Recognition with Large Pre-Trained Models and Bayesian Inference

Towards Unified AI Drug Discovery with Multiple Knowledge Modalities

A Multimodal Learning Framework for Comprehensive 3D Mineral Prospectivity Modeling with Jointly Learned Structure-Fluid Relationships

Dual-stage Flows-based Generative Modeling for Traceable Urban Planning

Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

MUSE: Multi-View Contrastive Learning for Heterophilic Graphs

Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loads

Network Fault-tolerant and Byzantine-resilient Social Learning via Collaborative Hierarchical Non-Bayesian Learning

ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis

DiffDTM: A conditional structure-free framework for bioactive molecules generation targeted for dual proteins