多模态大模型 - arXivDaily 专题

2302.10908 2023-06-13 cs.LG cs.AI cs.CY 79%

Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment

Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez, Alfonso Ortega, Ainhoa Herrarte, Manuel Alcantara, Javier Ortega-Garcia

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments arXiv admin note: text overlap with arXiv:2004.07173

Journal ref SN COMPUT. SCI. 4, 434 (2023)

2103.00268 2023-06-07 cs.RO cs.CV cs.HC 79%

Text-driven object affordance for guiding grasp-type recognition in multimodal robot teaching

Naoki Wake, Daichi Saito, Kazuhiro Sasabuchi, Hideki Koike, Katsushi Ikeuchi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 11 figures. Last updated March 12, 2023 Accepted for publication in Machine Vision and Applications

2306.00379 2023-06-02 cs.CV cs.LG 79%

Large Scale Generative Multimodal Attribute Extraction for E-commerce Attributes

Anant Khandelwal, Happy Mittal, Shreyas Sunil Kulkarni, Deepak Gupta

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments ACL 2023 Industry Track, 8 Pages

2305.18576 2023-05-31 cs.CL 79%

TreeMAN: Tree-enhanced Multimodal Attention Network for ICD Coding

Zichen Liu, Xuyuan Liu, Yanlong Wen, Guoqing Zhao, Fen Xia, Xiaojie Yuan

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2305.16222 2023-05-26 eess.IV cs.CV cs.LG q-bio.NC 79%

Incomplete Multimodal Learning for Complex Brain Disorders Prediction

Reza Shirkavand, Liang Zhan, Heng Huang, Li Shen, Paul M. Thompson

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2305.15302 2023-05-25 cs.CV 79%

Multi-Modal Mutual Attention and Iterative Interaction for Referring Image Segmentation

Chang Liu, Henghui Ding, Yulun Zhang, Xudong Jiang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE TIP

2305.10827 2023-05-19 cs.HC cs.AI 79%

Expanding the Role of Affective Phenomena in Multimodal Interaction Research

Leena Mathur, Maja J Matarić, Louis-Philippe Morency

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 4 pages, 4 figures

2305.10169 2023-05-19 cs.MM 79%

Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt

Xiaocui Yang, Shi Feng, Daling Wang, Sun Qi, Wenfang Wu, Yifei Zhang, Pengfei Hong, Soujanya Poria

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

Comments 13 pages, 7 figures, 6 tables, ACL 2023 Long Paper (Findings)

2305.07790 2023-05-16 cond-mat.mtrl-sci cs.CV eess.IV 79%

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

Shoieb Ahmed Chowdhury, M. F. N. Taufique, Jing Wang, Marissa Masden, Madison Wenzlick, Ram Devanathan, Alan L Schemer-Kohrn, Keerti S Kappagantula

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.CV

2305.05992 2023-05-11 cs.CV 79%

MMoT: Mixture-of-Modality-Tokens Transformer for Composed Multimodal Conditional Image Synthesis

Jianbin Zheng, Daqing Liu, Chaoyue Wang, Minghui Hu, Zuopeng Yang, Changxing Ding, Dacheng Tao

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2305.03125 2023-05-08 cs.CV 79%

Multimodal Understanding Through Correlation Maximization and Minimization

Yifeng Shi, Marc Niethammer

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 15 pages

2305.01912 2023-05-04 cs.LG cs.AI physics.chem-ph 79%

MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Prediction

Liang Zeng, Lanqing Li, Jian Li

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.AI

2206.10571 2023-05-02 cs.CV 79%

Toward Unpaired Multi-modal Medical Image Segmentation via Learning Structured Semantic Consistency

Jie Yang, Ye Zhu, Chaoqun Wang, Zhen Li, Ruimao Zhang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments MIDL23

2303.18248 2023-04-03 cs.CV 79%

Towards Flexible Multi-modal Document Models

Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments To be published in CVPR2023 (highlight), project page: https://cyberagentailab.github.io/flex-dm

2301.04535 2023-04-03 cs.CL cs.SI 79%

Few-shot Learning for Cross-Target Stance Detection by Aggregating Multimodal Embeddings

Parisa Jamadi Khiabani, Arkaitz Zubiaga

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments To appear in IEEE Transactions on Computational Social Systems

2303.13659 2023-03-27 cs.CV 79%

Probability-based Global Cross-modal Upsampling for Pansharpening

Zeyu Zhu, Xiangyong Cao, Man Zhou, Junhao Huang, Deyu Meng

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments 10 pages, 5 figures

2303.09484 2023-03-17 cs.CV cs.LG 79%

A Novel Autoencoders-LSTM Model for Stroke Outcome Prediction using Multimodal MRI Data

Nima Hatami, Laura Mechtouff, David Rousseau, Tae-Hee Cho, Omer Eker, Yves Berthezene, Carole Frindel

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments The IEEE International Symposium on Biomedical Imaging (ISBI). arXiv admin note: text overlap with arXiv:2205.05545

2303.03369 2023-03-10 cs.CV 79%

Multimodal Prompting with Missing Modalities for Visual Recognition

Yi-Lun Lee, Yi-Hsuan Tsai, Wei-Chen Chiu, Chen-Yu Lee

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2023. Codes are available at https://github.com/YiLunLee/Missing_aware_prompts

2303.00369 2023-03-03 cs.CV eess.IV 79%

Indescribable Multi-modal Spatial Evaluator

Lingke Kong, X. Sharon Qi, Qijin Shen, Jiacheng Wang, Jingyi Zhang, Yanle Hu, Qichao Zhou

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2023

2302.14794 2023-03-01 cs.CV 79%

Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning

Ivona Najdenkoska, Xiantong Zhen, Marcel Worring

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments International Conference on Learning Representations 2023

2302.14239 2023-03-01 cs.CV 79%

Nonlinear Intensity, Scale and Rotation Invariant Matching for Multimodal Images

Zhongli Fan, Li Zhang, Yuxuan Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2302.11021 2023-02-23 cs.LG cs.AI q-bio.QM 79%

MVMTnet: A Multi-variate Multi-modal Transformer for Multi-class Classification of Cardiac Irregularities Using ECG Waveforms and Clinical Notes

Ankur Samanta, Mark Karlov, Meghna Ravikumar, Christian McIntosh Clarke, Jayakumar Rajadas, Kaveh Hassani

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments 18 pages, 11 figures, submitted to Artificial Intelligence in Medicine journal

2301.03045 2023-01-23 cs.CV 79%

Seamless Multimodal Biometrics for Continuous Personalised Wellbeing Monitoring

João Ribeiro Pinto

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Doctoral thesis presented and approved on the 21st of December 2022 to the University of Porto

1510.00331 2023-01-18 cs.RO cs.AI stat.ML 79%

Multimodal Hierarchical Dirichlet Process-based Active Perception

Tadahiro Taniguchi, Toshiaki Takano, Ryo Yoshino

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments submitted

Journal ref Front. Neurorobot. 12:22. 2018

2206.03336 2022-12-27 eess.IV cs.CV cs.LG 79%

Parotid Gland MRI Segmentation Based on Swin-Unet and Multimodal Images

Zi'an Xu, Yin Dai, Fayu Liu, Siqi Li, Sheng Liu, Lifu Shi, Jun Fu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2212.09162 2022-12-21 cs.LG cs.AI 79%

Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosis

Firas Khader, Gustav Mueller-Franzes, Tianci Wang, Tianyu Han, Soroosh Tayebi Arasteh, Christoph Haarburger, Johannes Stegmaier, Keno Bressem, Christiane Kuhl, Sven Nebelung, Jakob Nikolas Kather, Daniel Truhn

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2109.06969 2022-12-06 cs.CV 79%

Multi-modal Wound Classification using Wound Image and Location by Deep Neural Network

D. M. Anisuzzaman, Yash Patel, Behrouz Rostami, Jeffrey Niezgoda, Sandeep Gopalakrishnan, Zeyun Yu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 30 pages, 10 figures, 15 tables

Journal ref Sci Rep 12, 20057 (2022)

2211.13484 2022-11-28 cs.MM 79%

Robust-MSA: Understanding the Impact of Modality Noise on Multimodal Sentiment Analysis

Huisheng Mao, Baozheng Zhang, Hua Xu, Ziqi Yuan, Yihe Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

Comments Accept by AAAI 2023. Code is available at https://github.com/thuiar/Robust-MSA

2210.10392 2022-11-15 cs.CV 79%

Spatio-channel Attention Blocks for Cross-modal Crowd Counting

Youjia Zhang, Soyun Choi, Sungeun Hong

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted to ACCV 2022 (Oral). Code is available at https://github.com/vcllab/csca

2211.03615 2022-11-08 cs.LG cs.AI cs.DC eess.SP 79%

MAISON -- Multimodal AI-based Sensor platform for Older Individuals

Ali Abedi, Faranak Dayyani, Charlene Chu, Shehroz S. Khan

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

1. 其他多模态 4868 篇

Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment

Text-driven object affordance for guiding grasp-type recognition in multimodal robot teaching

Large Scale Generative Multimodal Attribute Extraction for E-commerce Attributes

TreeMAN: Tree-enhanced Multimodal Attention Network for ICD Coding

Incomplete Multimodal Learning for Complex Brain Disorders Prediction

Multi-Modal Mutual Attention and Iterative Interaction for Referring Image Segmentation

Expanding the Role of Affective Phenomena in Multimodal Interaction Research

Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt

Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy

MMoT: Mixture-of-Modality-Tokens Transformer for Composed Multimodal Conditional Image Synthesis

Multimodal Understanding Through Correlation Maximization and Minimization

MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Prediction

Toward Unpaired Multi-modal Medical Image Segmentation via Learning Structured Semantic Consistency

Towards Flexible Multi-modal Document Models

Few-shot Learning for Cross-Target Stance Detection by Aggregating Multimodal Embeddings

Probability-based Global Cross-modal Upsampling for Pansharpening

A Novel Autoencoders-LSTM Model for Stroke Outcome Prediction using Multimodal MRI Data

Multimodal Prompting with Missing Modalities for Visual Recognition

Indescribable Multi-modal Spatial Evaluator

Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning

Nonlinear Intensity, Scale and Rotation Invariant Matching for Multimodal Images

MVMTnet: A Multi-variate Multi-modal Transformer for Multi-class Classification of Cardiac Irregularities Using ECG Waveforms and Clinical Notes

Seamless Multimodal Biometrics for Continuous Personalised Wellbeing Monitoring

Multimodal Hierarchical Dirichlet Process-based Active Perception

Parotid Gland MRI Segmentation Based on Swin-Unet and Multimodal Images

Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosis

Multi-modal Wound Classification using Wound Image and Location by Deep Neural Network

Robust-MSA: Understanding the Impact of Modality Noise on Multimodal Sentiment Analysis

Spatio-channel Attention Blocks for Cross-modal Crowd Counting

MAISON -- Multimodal AI-based Sensor platform for Older Individuals