多模态大模型 - arXivDaily 专题

2211.01889 2022-11-04 cs.CL 79%

When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and its Intensity

Khalid Alnajjar, Mika Hämäläinen, Jörg Tiedemann, Jorma Laaksonen, Mikko Kurimo

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments Outstanding paper award in COLING 2022

2210.13721 2022-10-26 eess.IV cs.CV cs.LG 79%

Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

Yanwu Yang, Xutao Guo, Zhikai Chang, Chenfei Ye, Yang Xiang, Ting Ma

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2210.10652 2022-10-20 cs.IR cs.LG cs.MM 79%

Multi-Modal Recommendation System with Auxiliary Information

Mufhumudzi Muthivhi, Terence L. van Zyl, Hairong Wang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.MM

Comments 15 pages, 3 figures, 3 tables, to be published in the SACAIR CCIS Springer proceedings volume

2204.04218 2022-10-13 eess.IV cs.CV cs.LG 79%

Multimodal Multi-Head Convolutional Attention with Various Kernel Sizes for Medical Image Super-Resolution

Mariana-Iuliana Georgescu, Radu Tudor Ionescu, Andreea-Iuliana Miron, Olivian Savencu, Nicolae-Catalin Ristea, Nicolae Verga, Fahad Shahbaz Khan

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at WACV 2023 (main paper + supplementary)

2210.03428 2022-10-10 cs.CV 79%

Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality

Haozhe Chi, Minghua Yang, Junhao Zhu, Guanhong Wang, Gaoang Wang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2201.10305 2022-10-07 eess.IV cs.CV cs.LG 79%

Mutual information neural estimation for unsupervised multi-modal registration of brain images

Gerard Snaauw, Michele Sasdelli, Gabriel Maicas, Stephan Lau, Johan Verjans, Mark Jenkinson, Gustavo Carneiro

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 4 pages, 4 figures, 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), oral presentation

Journal ref 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022, pp. 3510-3513

2209.09552 2022-09-21 cs.CV eess.IV 79%

Cross-modal Learning for Image-Guided Point Cloud Shape Completion

Emanuele Aiello, Diego Valsesia, Enrico Magli

专题命中其他多模态：cross-modal(title)；multimodal(abstract)；分类 cs.CV

Comments NeurIPS 2022

2202.05306 2022-09-20 cs.LG cs.CV 79%

Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks

Nan Wu, Stanisław Jastrzębski, Kyunghyun Cho, Krzysztof J. Geras

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2209.02215 2022-09-07 cs.CL 79%

Reference Resolution and Context Change in Multimodal Situated Dialogue for Exploring Data Visualizations

Abhinav Kumar, Barbara Di Eugenio, Abari Bhattacharya, Jillian Aurisano, Andrew Johnson

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2208.12781 2022-08-29 cs.CV 79%

Learning Multi-Modal Brain Tumor Segmentation from Privileged Semi-Paired MRI Images with Curriculum Disentanglement Learning

Zecheng Liu, Jia Wei, Rui Li

专题命中其他多模态：multi-modal(title)；multimodal(abstract)；分类 cs.CV

Comments 8 pages, 10 figures

2208.07307 2022-08-16 cs.RO cs.AI cs.LG 79%

Towards Robust On-Ramp Merging via Augmented Multimodal Reinforcement Learning

Gaurav Bagwe, Jian Li, Xiaoyong Yuan, Lan Zhang

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.AI

Comments 8 pages, 5 figures

2111.15263 2022-08-16 cs.CV 79%

Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Features

Byeonghu Na, Yoonsik Kim, Sungrae Park

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication at ECCV 2022

2109.14549 2022-07-26 cs.RO cs.CV cs.LG 79%

Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization

Chieko Sarah Imai, Minghao Zhang, Yuchen Zhang, Marcin Kierebinski, Ruihan Yang, Yuzhe Qin, Xiaolong Wang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments IROS 2022, Project page: https://mehooz.github.io/mmdr-wild/

2103.08862 2022-07-26 cs.CL 79%

Gumbel-Attention for Multi-modal Machine Translation

Pengbo Liu, Hailong Cao, Tiejun Zhao

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

2207.09805 2022-07-21 cs.CV 79%

Multimodal Transformer for Automatic 3D Annotation and Object Detection

Chang Liu, Xiaoyan Qian, Binxiao Huang, Xiaojuan Qi, Edmund Lam, Siew-Chong Tan, Ngai Wong

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 14 pages, 4 figures

2207.09156 2022-07-20 cs.CV 79%

Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution

Xiaoyu Dong, Naoto Yokoya, Longguang Wang, Tatsumi Uezato

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments ECCV 2022

2207.08104 2022-07-19 cs.CL cs.LG 79%

A Multibias-mitigated and Sentiment Knowledge Enriched Transformer for Debiasing in Multimodal Conversational Emotion Recognition

Jinglin Wang, Fang Ma, Yazhou Zhang, Dawei Song

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments 10 pages, 5 figures, accepted to NLPCC 2022

2207.04624 2022-07-12 cs.CV 79%

Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting

Dooseop Choi, KyoungWook Min

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments ECCV2022

2101.07681 2022-06-22 cs.CV 79%

Hyperspectral Image Denoising via Multi-modal and Double-weighted Tensor Nuclear Norm

Sheng Liu, Xiaozhen Xie, Wenfeng Kong

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2106.12489

2206.03737 2022-06-09 cs.MM cs.HC 79%

Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction

Anqi Wang, Ze Gao, Lik-Hang Lee, Tristan Braud, Pan Hui

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

Comments 7 pages, 5 figures

2205.11096 2022-05-24 eess.IV cs.CV cs.LG 79%

FedNorm: Modality-Based Normalization in Federated Learning for Multi-Modal Liver Segmentation

Tobias Bernecker, Annette Peters, Christopher L. Schlett, Fabian Bamberg, Fabian Theis, Daniel Rueckert, Jakob Weiß, Shadi Albarqouni

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Under Review

2205.10902 2022-05-24 cs.CL 79%

The Case for Perspective in Multimodal Datasets

Marcelo Viridiano, Tiago Timponi Torrent, Oliver Czulo, Arthur Lorenzi Almeida, Ely Edison da Silva Matos, Frederico Belcavello

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments Accepted submission for the 1st Workshop on Perspectivist Approaches to NLP (NLPerspectives)

2106.14248 2022-05-12 eess.IV cs.CV 79%

Multi-Modal Transformer for Accelerated MR Imaging

Chun-Mei Feng, Yunlu Yan, Geng Chen, Yong Xu, Ling Shao, Huazhu Fu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments https://github.com/chunmeifeng/MTrans

2203.05707 2022-04-25 cs.LG cs.AI eess.IV q-bio.GN 79%

Machine Learning Based Multimodal Neuroimaging Genomics Dementia Score for Predicting Future Conversion to Alzheimer's Disease

Ghazal Mirabnahrazam, Da Ma, Sieun Lee, Karteek Popuri, Hyunwoo Lee, Jiguo Cao, Lei Wang, James E Galvin, Mirza Faisal Beg, the Alzheimer's Disease Neuroimaging Initiative

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Journal ref J Alzheimers Dis 1 Jan. (2022) 1-21

2204.05994 2022-04-13 cs.CR cs.CV 79%

Malceiver: Perceiver with Hierarchical and Multi-modal Features for Android Malware Detection

Niall McLaughlin

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 13 pages, 2 figures

2204.01734 2022-04-07 cs.CV cs.SI 79%

On Explaining Multimodal Hateful Meme Detection Models

Ming Shan Hee, Roy Ka-Wei Lee, Wen-Haw Chong

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2201.05545 2022-04-07 cs.CV 79%

Multimodal registration of FISH and nanoSIMS images using convolutional neural network models

Xiaojia He, Christof Meile, Suchendra M. Bhandarkar

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2107.01189 2022-04-07 cs.CV cs.LG 79%

NTIRE 2021 Multi-modal Aerial View Object Classification Challenge

Jerrick Liu, Nathan Inkawhich, Oliver Nina, Radu Timofte, Sahil Jain, Bob Lee, Yuru Duan, Wei Wei, Lei Zhang, Songzheng Xu, Yuxuan Sun, Jiaqi Tang, Xueli Geng, Mengru Ma, Gongzhe Li, Xueli Geng, Huanqia Cai, Chengxue Cai, Sol Cummings, Casian Miron, Alexandru Pasarica, Cheng-Yen Yang, Hung-Min Hsu, Jiarui Cai, Jie Mei, Chia-Ying Yeh, Jenq-Neng Hwang, Michael Xin, Zhongkai Shangguan, Zihe Zheng, Xu Yifei, Lehan Yang, Kele Xu, Min Feng

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments The paper needs to be withdrawn since it did not properly go through the public release process. We will soon release a new version to replace this one

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2021, 588-595

2203.15700 2022-03-30 cs.CV 79%

MAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generator

Chang Liu, Xiaoyan Qian, Xiaojuan Qi, Edmund Y. Lam, Siew-Chong Tan, Ngai Wong

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 6 pages, 4 figures, accepted by ICPR 2022

2203.10640 2022-03-22 cs.CV eess.IV physics.ao-ph 79%

Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fields

Ronan Fablet, Bertrand Chapron

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

1. 其他多模态 4868 篇

When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and its Intensity

Multi-modal Dynamic Graph Network: Coupling Structural and Functional Connectome for Disease Diagnosis and Classification

Multi-Modal Recommendation System with Auxiliary Information

Multimodal Multi-Head Convolutional Attention with Various Kernel Sizes for Medical Image Super-Resolution

Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality

Mutual information neural estimation for unsupervised multi-modal registration of brain images

Cross-modal Learning for Image-Guided Point Cloud Shape Completion

Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks

Reference Resolution and Context Change in Multimodal Situated Dialogue for Exploring Data Visualizations

Learning Multi-Modal Brain Tumor Segmentation from Privileged Semi-Paired MRI Images with Curriculum Disentanglement Learning

Towards Robust On-Ramp Merging via Augmented Multimodal Reinforcement Learning

Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Features

Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization

Gumbel-Attention for Multi-modal Machine Translation

Multimodal Transformer for Automatic 3D Annotation and Object Detection

Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution

A Multibias-mitigated and Sentiment Knowledge Enriched Transformer for Debiasing in Multimodal Conversational Emotion Recognition

Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting

Hyperspectral Image Denoising via Multi-modal and Double-weighted Tensor Nuclear Norm

Decentralized, not Dehumanized in the Metaverse: Bringing Utility to NFTs through Multimodal Interaction

FedNorm: Modality-Based Normalization in Federated Learning for Multi-Modal Liver Segmentation

The Case for Perspective in Multimodal Datasets

Multi-Modal Transformer for Accelerated MR Imaging

Machine Learning Based Multimodal Neuroimaging Genomics Dementia Score for Predicting Future Conversion to Alzheimer's Disease

Malceiver: Perceiver with Hierarchical and Multi-modal Features for Android Malware Detection

On Explaining Multimodal Hateful Meme Detection Models

Multimodal registration of FISH and nanoSIMS images using convolutional neural network models

NTIRE 2021 Multi-modal Aerial View Object Classification Challenge

MAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generator

Multimodal learning-based inversion models for the space-time reconstruction of satellite-derived geophysical fields