多模态大模型 - arXivDaily 专题

2411.15182 2024-11-26 cs.LG cs.AI 79%

Forecasting Application Counts in Talent Acquisition Platforms: Harnessing Multimodal Signals using LMs

Md Ahsanul Kabir, Kareem Abdelfatah, Shushan He, Mohammed Korayem, Mohammad Al Hasan

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2411.14925 2024-11-25 cs.HC cs.AI 79%

Purrfessor: A Fine-tuned Multimodal LLaVA Diet Health Chatbot

Linqi Lu, Yifan Deng, Chuan Tian, Sijia Yang, Dhavan Shah

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 10 pages, 5 figures

2411.14795 2024-11-25 cs.CL 79%

De-biased Multimodal Electrocardiogram Analysis

Haitao Li, Ziyu Li, Yiheng Mao, Ziyi Liu, Zhoujian Sun, Zhengxing Huang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2411.06097 2024-11-19 cs.AI 79%

A Multimodal Adaptive Graph-based Intelligent Classification Model for Fake News

Jun-hao, Xu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 8 pages

2411.05395 2024-11-11 cs.CV 79%

AuthFormer: Adaptive Multimodal biometric authentication transformer for middle-aged and elderly people

Yang rui, Meng ling-tao, Zhang qiu-yu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2404.04821 2024-11-11 cs.SE cs.AI 79%

A Data-to-Product Multimodal Conceptual Framework to Achieve Automated Software Evolution for Context-rich Intelligent Applications

Songhui Yue

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Journal ref Innovations in Systems and Software Engineering, 2024

2411.04663 2024-11-08 cs.CV 79%

Explainable Search and Discovery of Visual Cultural Heritage Collections with Multimodal Large Language Models

Taylor Arnold, Lauren Tilton

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 16 pages, CHR 2024: Computational Humanities Research Conference, December 4 - 6, 2024, Aarhus University, Denmark

2411.04644 2024-11-08 cs.LG cs.AI 79%

wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signals

Jonathan F. Carter, Lionel Tarassenko

专题命中其他多模态：multi-modal(title)；cross-modal(abstract)；分类 cs.AI

Comments Accepted to Machine Learning for Health (ML4H) 2024

2411.02465 2024-11-06 cs.LG cs.AI stat.ML 79%

See it, Think it, Sorted: Large Multimodal Models are Few-shot Time Series Anomaly Analyzers

Jiaxin Zhuang, Leon Yan, Zhenwei Zhang, Ruiqi Wang, Jiawei Zhang, Yuantao Gu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments Under review

2410.24034 2024-11-01 cs.CV 79%

Handwriting Recognition in Historical Documents with Multimodal LLM

Lucian Li

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2410.23570 2024-11-01 cs.CV 79%

Phrase Decoupling Cross-Modal Hierarchical Matching and Progressive Position Correction for Visual Grounding

Minghong Xie, Mengzhao Wang, Huafeng Li, Yafei Zhang, Dapeng Tao, Zhengtao Yu

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments This work has been accepted by TMM

2410.20097 2024-10-29 cs.CV 79%

Generative Adversarial Patches for Physical Attacks on Cross-Modal Pedestrian Re-Identification

Yue Su, Hao Li, Maoguo Gong

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

2311.01908 2024-10-28 eess.IV cs.CV 79%

LLM-driven Multimodal Target Volume Contouring in Radiation Oncology

Yujin Oh, Sangjoon Park, Hwa Kyung Byun, Yeona Cho, Ik Jae Lee, Jin Sung Kim, Jong Chul Ye

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Published in Nature Communications, see https://www.nature.com/articles/s41467-024-53387-y

Journal ref Nat Commun 15, 9186 (2024)

2404.08295 2024-10-27 cs.AI cs.HC cs.LG cs.RO cs.SC 79%

Study of Emotion Concept Formation by Integrating Vision, Physiology, and Word Information using Multilayered Multimodal Latent Dirichlet Allocation

Kazuki Tsurumaki, Chie Hieida, Kazuki Miyazawa

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication. We would like to thank Professor Takayuki Nagai for useful discussions

2410.15833 2024-10-22 cs.CV 79%

LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training

Thomas Kreutz, Jens Lemke, Max Mühlhäuser, Alejandro Sanchez Guinea

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments Preprint, Paper has been accepted at IROS2024

2410.02219 2024-10-22 cs.IR cs.AI 79%

Multi-modal clothing recommendation model based on large model and VAE enhancement

Bingjie Huang, Qingyi Lu, Shuaishuai Huang, Xue-she Wang, Haowei Yang

专题命中其他多模态：multi-modal(title)；multimodal(abstract)；分类 cs.AI

2410.09454 2024-10-15 cs.CV cs.LG 79%

Skipping Computations in Multimodal LLMs

Mustafa Shukor, Matthieu Cord

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at NeurIPS 2024 Workshop RBFM. Code: https://github.com/mshukor/ima-lmms

2310.03986 2024-10-14 cs.CV cs.LG 79%

Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation

Md Kaykobad Reza, Ashley Prater-Bennette, M. Salman Asif

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 28 pages, 6 figures, 17 tables

2401.03609 2024-10-10 cs.LG cs.AI 79%

Multi-Modal Federated Learning for Cancer Staging over Non-IID Datasets with Unbalanced Modalities

Kasra Borazjani, Naji Khosravan, Leslie Ying, Seyyedali Hosseinalipour

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments Published in IEEE Transactions on Medical Imaging (TMI), DOI: https://doi.org/10.1109/TMI.2024.3450855

Journal ref IEEE Transactions on Medical Imaging, 2024

2410.03010 2024-10-10 cs.LG cs.CV 79%

MMP: Towards Robust Multi-Modal Learning with Masked Modality Projection

Niki Nezakati, Md Kaykobad Reza, Ameya Patil, Mashhour Solh, M. Salman Asif

专题命中其他多模态：multi-modal(title)；multimodal(abstract)；分类 cs.CV

2410.03321 2024-10-07 cs.CV 79%

Visual-O1: Understanding Ambiguous Instructions via Multi-modal Multi-turn Chain-of-thoughts Reasoning

Minheng Ni, Yutao Fan, Lei Zhang, Wangmeng Zuo

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2410.00363 2024-10-02 cs.CL 79%

Unleashing the Potentials of Likelihood Composition for Multi-modal Language Models

Shitian Zhao, Renrui Zhang, Xu Luo, Yan Wang, Shanghang Zhang, Peng Gao

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

2406.03843 2024-10-01 cs.HC cs.AI 79%

POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models

Jianben He, Xingbo Wang, Shiyi Liu, Guande Wu, Claudio Silva, Huamin Qu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 11 pages, 6 figures

2303.11192 2024-09-30 cs.CL 79%

Multimodal Shannon Game with Images

Vilém Zouhar, Sunit Bhattacharya, Ondřej Bojar

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2409.13929 2024-09-24 cs.AI 79%

Failures in Perspective-taking of Multimodal AI Systems

Bridget Leonard, Kristin Woodard, Scott O. Murray

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2409.08885 2024-09-16 cs.CV 79%

Interactive Masked Image Modeling for Multimodal Object Detection in Remote Sensing

Minh-Duc Vu, Zuheng Ming, Fangchen Feng, Bissmella Bahaduri, Anissa Mokraoui

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2409.05378 2024-09-10 cs.CV 79%

Memoryless Multimodal Anomaly Detection via Student-Teacher Network and Signed Distance Learning

Zhongbin Sun, Xiaolong Li, Yiran Li, Yue Ma

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 14 pages, 4 figures, 2 tables, to be published in PRCV-2024

2406.19097 2024-09-10 cs.CL 79%

Fairness and Bias in Multimodal AI: A Survey

Tosin Adewumi, Lama Alkhaled, Namrata Gurung, Goya van Boven, Irene Pagliai

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments 12 pages

2409.04473 2024-09-10 cs.LG cs.AI 79%

Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis

Xianbing Zhao, Lizhen Qu, Tao Feng, Jianfei Cai, Buzhou Tang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2409.01020 2024-09-04 cs.CV eess.IV 79%

Fed-MUnet: Multi-modal Federated Unet for Brain Tumor Segmentation

Ruojun Zhou, Lisha Qu, Lei Zhang, Ziming Li, Hongwei Yu, Bing Luo

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 6 pages, 3 figures, 2 tables. It was accepted by 2024 IEEE International Conference on E-health Networking, Application & Services (HealthCom)

1. 其他多模态 4868 篇

Forecasting Application Counts in Talent Acquisition Platforms: Harnessing Multimodal Signals using LMs

Purrfessor: A Fine-tuned Multimodal LLaVA Diet Health Chatbot

De-biased Multimodal Electrocardiogram Analysis

A Multimodal Adaptive Graph-based Intelligent Classification Model for Fake News

AuthFormer: Adaptive Multimodal biometric authentication transformer for middle-aged and elderly people

A Data-to-Product Multimodal Conceptual Framework to Achieve Automated Software Evolution for Context-rich Intelligent Applications

Explainable Search and Discovery of Visual Cultural Heritage Collections with Multimodal Large Language Models

wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signals

See it, Think it, Sorted: Large Multimodal Models are Few-shot Time Series Anomaly Analyzers

Handwriting Recognition in Historical Documents with Multimodal LLM

Phrase Decoupling Cross-Modal Hierarchical Matching and Progressive Position Correction for Visual Grounding

Generative Adversarial Patches for Physical Attacks on Cross-Modal Pedestrian Re-Identification

LLM-driven Multimodal Target Volume Contouring in Radiation Oncology

Study of Emotion Concept Formation by Integrating Vision, Physiology, and Word Information using Multilayered Multimodal Latent Dirichlet Allocation

LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training

Multi-modal clothing recommendation model based on large model and VAE enhancement

Skipping Computations in Multimodal LLMs

Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation

Multi-Modal Federated Learning for Cancer Staging over Non-IID Datasets with Unbalanced Modalities

MMP: Towards Robust Multi-Modal Learning with Masked Modality Projection

Visual-O1: Understanding Ambiguous Instructions via Multi-modal Multi-turn Chain-of-thoughts Reasoning

Unleashing the Potentials of Likelihood Composition for Multi-modal Language Models

POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models

Multimodal Shannon Game with Images

Failures in Perspective-taking of Multimodal AI Systems

Interactive Masked Image Modeling for Multimodal Object Detection in Remote Sensing

Memoryless Multimodal Anomaly Detection via Student-Teacher Network and Signed Distance Learning

Fairness and Bias in Multimodal AI: A Survey

Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysis

Fed-MUnet: Multi-modal Federated Unet for Brain Tumor Segmentation