多模态大模型 - arXivDaily 专题

2312.03808 2023-12-08 cs.CV 79%

SurfaceAug: Closing the Gap in Multimodal Ground Truth Sampling

Ryan Rubel, Nathan Clark, Andrew Dudash

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Contains eight pages and three figures. A version of this document was submitted to CVPR 2024

2312.01573 2023-12-06 eess.IV cs.CV 79%

Survey on deep learning in multimodal medical imaging for cancer detection

Yan Tian, Zhaocheng Xu, Yujun Ma, Weiping Ding, Ruili Wang, Zhihong Gao, Guohua Cheng, Linyang He, Xuran Zhao

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Journal ref Neural Computing and Applications. 2023 Nov 29:1-6

2312.01789 2023-12-05 cs.CV 79%

Two-stage optimized unified adversarial patch for attacking visible-infrared cross-modal detectors in the physical world

Chengyin Hu, Weiwen Shi

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

2312.01671 2023-12-05 cs.CV 79%

Multimodality-guided Image Style Transfer using Cross-modal GAN Inversion

Hanyu Wang, Pengxiang Wu, Kevin Dela Rosa, Chen Wang, Abhinav Shrivastava

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments WACV 2024. Project website: https://hywang66.github.io/mmist/

2303.16412 2023-11-28 cond-mat.soft cond-mat.mtrl-sci cs.AI cs.LG 79%

A Comprehensive and Versatile Multimodal Deep Learning Approach for Predicting Diverse Properties of Advanced Materials

Shun Muroga, Yasuaki Miki, Kenji Hata

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 38 pages, 17 figures, 1 table

Journal ref Adv. Sci.,10, 24, 2302508 (2023)

2311.12856 2023-11-27 cond-mat.mtrl-sci cs.AI cs.LG 79%

Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer

Namkyeong Lee, Heewoong Noh, Sungwon Kim, Dongmin Hyun, Gyoung S. Na, Chanyoung Park

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments NeurIPS 2023. arXiv admin note: text overlap with arXiv:2303.07000

2210.13238 2023-11-21 q-bio.QM cs.CL cs.LG 79%

Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification

Andrey Sakhovskiy, Elena Tutubalina

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments This paper is accepted to Journal of Biomedical Informatics

Journal ref Journal of Biomedical Informatics, Volume 135, 2022, 104182, ISSN 1532-0464

2311.10791 2023-11-21 cs.MM cs.HC 79%

Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding

Hao Sun, Ziwei Niu, Xinyao Yu, Jiaqing Liu, Yen-Wei Chen, Lanfen Lin

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

2311.04364 2023-11-09 cs.CL cs.RO 79%

Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments

Danial Kamali, Parisa Kordjamshidi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2311.00924 2023-11-03 cs.RO cs.AI 79%

The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning

Carmelo Sferrazza, Younggyo Seo, Hao Liu, Youngwoon Lee, Pieter Abbeel

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2310.18263 2023-10-30 cs.CL cs.CY 79%

MalFake: A Multimodal Fake News Identification for Malayalam using Recurrent Neural Networks and VGG-16

Adhish S. Sujan, Ajitha. V, Aleena Benny, Amiya M. P., V. S. Anoop

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2310.12172 2023-10-25 cs.CL 79%

Overview of ImageArg-2023: The First Shared Task in Multimodal Argument Mining

Zhexiong Liu, Mohamed Elaraby, Yang Zhong, Diane Litman

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments In The 10th Argument Mining Workshop, held in conjunction with The Conference on Empirical Methods in Natural Language Processing (EMNLP), December 2023

2305.12212 2023-10-19 cs.CL 79%

Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledge

Jinyuan Li, Han Li, Zhuo Pan, Di Sun, Jiahao Wang, Wenkun Zhang, Gang Pan

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2023

2310.03017 2023-10-05 cs.CL 79%

Multimodal Question Answering for Unified Information Extraction

Yuxuan Sun, Kai Zhang, Yu Su

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments 24 pages, 2 figures

2309.16747 2023-10-02 cs.LG cs.AI 79%

Harnessing Diverse Data for Global Disaster Prediction: A Multimodal Framework

Gengyin Liu, Huaiyang Zhong

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2309.13247 2023-09-26 cs.CV 79%

Multi-modal Domain Adaptation for REG via Relation Transfer

Yifan Ding, Liqiang Wang, Boqing Gong

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2103.11247 2023-09-26 cs.CV cs.LG 79%

Attention-Based Multimodal Image Matching

Aviad Moreshet, Yosi Keller

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2309.11018 2023-09-21 cs.LG cs.CV cs.RO 79%

Conformalized Multimodal Uncertainty Regression and Reasoning

Domenico Parente, Nastaran Darabi, Alex C. Stutts, Theja Tulabandhula, Amit Ranjan Trivedi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2308.04091 2023-09-19 cs.CV 79%

From Unimodal to Multimodal: improving sEMG-Based Pattern Recognition via deep generative models

Wentao Wei, Linyan Ren

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2309.04478 2023-09-12 cond-mat.mtrl-sci cs.AI cs.LG 79%

Multimodal machine learning for materials science: composition-structure bimodal learning for experimentally measured properties

Sheng Gong, Shuo Wang, Taishan Zhu, Yang Shao-Horn, Jeffrey C. Grossman

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2309.03177 2023-09-07 eess.SY cs.CV cs.LG cs.RO cs.SY 79%

3D Object Positioning Using Differentiable Multimodal Learning

Sean Zanyk-McLean, Krishna Kumar, Paul Navratil

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments 7 pages, 8 figures

2306.17125 2023-09-07 cs.IR cs.MM 79%

Ducho: A Unified Framework for the Extraction of Multimodal Features in Recommendation

Daniele Malitesta, Giuseppe Gassi, Claudio Pomo, Tommaso Di Noia

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

2211.06924 2023-08-24 cs.IR cs.MM 79%

A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation

Xin Zhou, Zhiqi Shen

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

Comments Accepted to ACM Multimedia (MM) 2023

2308.01994 2023-08-07 eess.IV cs.CV cs.LG 79%

Explainable unsupervised multi-modal image registration using deep networks

Chengjia Wang, Giorgos Papanastasiou

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2306.01312 2023-08-01 cs.CL 79%

Syntax-aware Hybrid prompt model for Few-shot multi-modal sentiment analysis

Zikai Zhou, Haisong Feng, Baiyou Qiao, Gang Wu, Donghong Han

专题命中其他多模态：multi-modal(title)；multimodal(abstract)；分类 cs.CL

2307.04639 2023-07-20 cs.LG cs.CV 79%

Multimodal brain age estimation using interpretable adaptive population-graph learning

Kyriaki-Margarita Bintsi, Vasileios Baltatzis, Rolandos Alexandros Potamias, Alexander Hammers, Daniel Rueckert

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at MICCAI 2023

2001.07575 2023-07-19 eess.IV cs.CV cs.LG 79%

Multimodal Deep Unfolding for Guided Image Super-Resolution

Iman Marivani, Evaggelia Tsiligianni, Bruno Cornelis, Nikos Deligiannis

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2307.05158 2023-07-12 cs.CV 79%

A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings

Anshul Gupta, Samy Tafasca, Jean-Marc Odobez

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments In the proceedings of the GAZE workshop at CVPR 2022

2307.03786 2023-07-11 cs.CV 79%

Context-aware Pedestrian Trajectory Prediction with Multimodal Transformer

Haleh Damirchi, Michael Greenspan, Ali Etemad

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2306.14895 2023-06-27 cs.CV 79%

Large Multimodal Models: Notes on CVPR 2023 Tutorial

Chunyuan Li

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 27 pages, 24 figures; Tutorial website: https://vlp-tutorial.github.io/

1. 其他多模态 4868 篇

SurfaceAug: Closing the Gap in Multimodal Ground Truth Sampling

Survey on deep learning in multimodal medical imaging for cancer detection

Two-stage optimized unified adversarial patch for attacking visible-infrared cross-modal detectors in the physical world

Multimodality-guided Image Style Transfer using Cross-modal GAN Inversion

A Comprehensive and Versatile Multimodal Deep Learning Approach for Predicting Diverse Properties of Advanced Materials

Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer

Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification

Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding

Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments

The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning

MalFake: A Multimodal Fake News Identification for Malayalam using Recurrent Neural Networks and VGG-16

Overview of ImageArg-2023: The First Shared Task in Multimodal Argument Mining

Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledge

Multimodal Question Answering for Unified Information Extraction

Harnessing Diverse Data for Global Disaster Prediction: A Multimodal Framework

Multi-modal Domain Adaptation for REG via Relation Transfer

Attention-Based Multimodal Image Matching

Conformalized Multimodal Uncertainty Regression and Reasoning

From Unimodal to Multimodal: improving sEMG-Based Pattern Recognition via deep generative models

Multimodal machine learning for materials science: composition-structure bimodal learning for experimentally measured properties

3D Object Positioning Using Differentiable Multimodal Learning

Ducho: A Unified Framework for the Extraction of Multimodal Features in Recommendation

A Tale of Two Graphs: Freezing and Denoising Graph Structures for Multimodal Recommendation

Explainable unsupervised multi-modal image registration using deep networks

Syntax-aware Hybrid prompt model for Few-shot multi-modal sentiment analysis

Multimodal brain age estimation using interpretable adaptive population-graph learning

Multimodal Deep Unfolding for Guided Image Super-Resolution

A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings

Context-aware Pedestrian Trajectory Prediction with Multimodal Transformer

Large Multimodal Models: Notes on CVPR 2023 Tutorial