多模态大模型 - arXivDaily 专题

2401.11252 2024-01-23 cs.LG cs.AI 79%

Automated Fusion of Multimodal Electronic Health Records for Better Medical Predictions

Suhan Cui, Jiaqi Wang, Yuan Zhong, Han Liu, Ting Wang, Fenglong Ma

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments Accepted by SDM 2024

2311.02332 2024-01-23 cs.LG cs.CV 79%

Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects

Elisa Warner, Joonsang Lee, William Hsu, Tanveer Syeda-Mahmood, Charles Kahn, Olivier Gevaert, Arvind Rao

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2401.10041 2024-01-19 cs.CV 79%

CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition

Jinzhi Zheng, Ruyi Ji, Libo Zhang, Yanjun Wu, Chen Zhao

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted to ICONIP 2023

2401.07854 2024-01-17 cs.CV 79%

$M^{2}$Fusion: Bayesian-based Multimodal Multi-level Fusion on Colorectal Cancer Microsatellite Instability Prediction

Quan Liu, Jiawen Yao, Lisha Yao, Xin Chen, Jingren Zhou, Le Lu, Ling Zhang, Zaiyi Liu, Yuankai Huo

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2401.07571 2024-01-17 cs.CV 79%

A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders

Guoxin Wang, Sheng Shi, Shan An, Fengmei Fan, Wenshu Ge, Qi Wang, Feng Yu, Zhiren Wang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE ICASSP 2024

2401.03082 2024-01-09 cs.AI 79%

UMIE: Unified Multimodal Information Extraction with Instruction Tuning

Lin Sun, Kai Zhang, Qingyuan Li, Renze Lou

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.AI

2401.01364 2024-01-04 q-bio.NC cs.AI cs.LG cs.NE 79%

Multi-Modal Cognitive Maps based on Neural Networks trained on Successor Representations

Paul Stoewer, Achim Schilling, Andreas Maier, Patrick Krauss

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

2304.08965 2024-01-03 cs.CV 79%

PointDC:Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clustering

Zisheng Chen, Hongbin Xu, Weitao Chen, Zhipeng Zhou, Haihong Xiao, Baigui Sun, Xuansong Xie, Wenxiong Kang

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by International Conference on Computer Vision (ICCV) 2023

2401.00268 2024-01-02 cs.CV 79%

COMMA: Co-Articulated Multi-Modal Learning

Lianyu Hu, Liqing Gao, Zekang Liu, Chi-Man Pun, Wei Feng

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to AAAI2024. Code is available at https://github.com/hulianyuyy/COMMA

2312.16797 2023-12-29 cs.CV 79%

Multi-Prompts Learning with Cross-Modal Alignment for Attribute-based Person Re-Identification

Yajing Zhai, Yawen Zeng, Zhiyong Huang, Zheng Qin, Xin Jin, Da Cao

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments AAAI 2024

2312.16279 2023-12-29 cs.CV 79%

Cloud-Device Collaborative Learning for Multimodal Large Language Models

Guanqun Wang, Jiaming Liu, Chenxuan Li, Junpeng Ma, Yuan Zhang, Xinyu Wei, Kevin Zhang, Maurice Chong, Ray Zhang, Yijiang Liu, Shanghang Zhang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2312.14410 2023-12-25 cs.CV 79%

A Multi-Stage Adaptive Feature Fusion Neural Network for Multimodal Gait Recognition

Shinan Zou, Jianbo Xiong, Chao Fan, Shiqi Yu, Jin Tang

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments This paper has been accepted by IJCB2023

Journal ref IJCB2023

2312.05777 2023-12-18 cs.CV 79%

Negative Pre-aware for Noisy Cross-modal Matching

Xu Zhang, Hao Li, Mang Ye

专题命中多模态训练与对齐：cross-modal(title,abstract)；分类 cs.CV

Comments 9 pages, 5 figures, conference

2312.08636 2023-12-15 cs.CV 79%

MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task Learning

Yi Xin, Junlong Du, Qiang Wang, Ke Yan, Shouhong Ding

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI2024

2312.08212 2023-12-14 cs.CV 79%

LAMM: Label Alignment for Multi-Modal Prompt Learning

Jingsheng Gao, Jiacheng Ruan, Suncheng Xiang, Zefang Yu, Ke Ji, Mingye Xie, Ting Liu, Yuzhuo Fu

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted at AAAI 2024 Main Conference

2312.05434 2023-12-12 cs.CL 79%

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Hongzhan Lin, Ziyang Luo, Jing Ma, Long Chen

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments The first work to alleviate the issue of superficial understanding for harmful meme detection by explicitly utilizing commonsense knowledge, from a fresh perspective on harnessing advanced Large Language Models

Journal ref The 2023 Conference on Empirical Methods in Natural Language Processing

2311.11312 2023-12-07 cs.CV 79%

Optimizing rgb-d semantic segmentation through multi-modal interaction and pooling attention

Shuai Zhang, Minghong Xie

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2312.02227 2023-12-06 cs.LG cs.CL 79%

Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based Contrastive Learning for Enhanced Fusion Representation

Cong-Duy Nguyen, Thong Nguyen, Duc Anh Vu, Luu Anh Tuan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

2312.00360 2023-12-05 cs.CV 79%

Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning

Shaohua Dong, Yunhe Feng, Qing Yang, Yan Huang, Dongfang Liu, Heng Fan

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 4 figures, 9 tables

2208.00339 2023-12-05 cs.MM 79%

GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversation

Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.MM

Comments Accepted by Neurocomputing

2311.18245 2023-12-01 eess.IV cs.CV 79%

Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans

Long Chen, Liben Chen, Binfeng Xu, Wenxin Zhang, Narges Razavian

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2311.17597 2023-12-01 cs.CV 79%

Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning

Yiwen Ye, Yutong Xie, Jianpeng Zhang, Ziyang Chen, Qi Wu, Yong Xia

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2309.01728 2023-12-01 cs.CV 79%

Generative-based Fusion Mechanism for Multi-Modal Tracking

Zhangyong Tang, Tianyang Xu, Xuefeng Zhu, Xiao-Jun Wu, Josef Kittler

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

2307.01121 2023-11-23 cs.RO cs.CV 79%

Artifacts Mapping: Multi-Modal Semantic Mapping for Object Detection and 3D Localization

Federico Rollo, Gennaro Raiola, Andrea Zunino, Nikolaos Tsagarakis, Arash Ajoudani

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to the 11th European Conference on Mobile Robots (ECMR) 2023

2311.11237 2023-11-21 cs.AI 79%

Implementation of AI Deep Learning Algorithm For Multi-Modal Sentiment Analysis

Jiazhen Wang

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.AI

2311.08032 2023-11-15 eess.IV cs.CV 79%

ELF: An End-to-end Local and Global Multimodal Fusion Framework for Glaucoma Grading

Wenyun Li, Chi-Man Pun

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

2311.07033 2023-11-14 eess.IV cs.CV 79%

TTMFN: Two-stream Transformer-based Multimodal Fusion Network for Survival Prediction

Ruiquan Ge, Xiangyang Hu, Rungen Huang, Gangyong Jia, Yaqi Wang, Renshu Gu, Changmiao Wang, Elazab Ahmed, Linyan Wang, Juan Ye, Ye Li

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2311.04058 2023-11-08 cs.CV 79%

mmFUSION: Multimodal Fusion for 3D Objects Detection

Javed Ahmad, Alessio Del Bue

专题命中多模态训练与对齐：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 10 pages,

2311.03713 2023-11-08 quant-ph cs.CV cs.LG 79%

Multimodal deep representation learning for quantum cross-platform verification

Yang Qian, Yuxuan Du, Zhenliang He, Min-hsiu Hsieh, Dacheng Tao

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

2310.18812 2023-10-31 cs.CV 79%

UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identification

Jennifer Crawford, Haoli Yin, Luke McDermott, Daniel Cummings

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CV

Comments Accepted NeurIPS 2023 UniReps, 9 pages, 4 tables

1. 多模态训练与对齐 6887 篇

Automated Fusion of Multimodal Electronic Health Records for Better Medical Predictions

Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects

CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition

$M^{2}$Fusion: Bayesian-based Multimodal Multi-level Fusion on Colorectal Cancer Microsatellite Instability Prediction

A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders

UMIE: Unified Multimodal Information Extraction with Instruction Tuning

Multi-Modal Cognitive Maps based on Neural Networks trained on Successor Representations

PointDC:Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clustering

COMMA: Co-Articulated Multi-Modal Learning

Multi-Prompts Learning with Cross-Modal Alignment for Attribute-based Person Re-Identification

Cloud-Device Collaborative Learning for Multimodal Large Language Models

A Multi-Stage Adaptive Feature Fusion Neural Network for Multimodal Gait Recognition

Negative Pre-aware for Noisy Cross-modal Matching

MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task Learning

LAMM: Label Alignment for Multi-Modal Prompt Learning

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

Optimizing rgb-d semantic segmentation through multi-modal interaction and pooling attention

Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based Contrastive Learning for Enhanced Fusion Representation

Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning

GraphMFT: A Graph Network based Multimodal Fusion Technique for Emotion Recognition in Conversation

Automatic Detection of Alzheimer's Disease with Multi-Modal Fusion of Clinical MRI Scans

Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning

Generative-based Fusion Mechanism for Multi-Modal Tracking

Artifacts Mapping: Multi-Modal Semantic Mapping for Object Detection and 3D Localization

Implementation of AI Deep Learning Algorithm For Multi-Modal Sentiment Analysis

ELF: An End-to-end Local and Global Multimodal Fusion Framework for Glaucoma Grading

TTMFN: Two-stream Transformer-based Multimodal Fusion Network for Survival Prediction

mmFUSION: Multimodal Fusion for 3D Objects Detection

Multimodal deep representation learning for quantum cross-platform verification

UniCat: Crafting a Stronger Fusion Baseline for Multimodal Re-Identification