多模态大模型 - arXivDaily 专题

2208.02532 2022-08-05 cs.CL 79%

Prompt Tuning for Generative Multimodal Pretrained Models

Hao Yang, Junyang Lin, An Yang, Peng Wang, Chang Zhou, Hongxia Yang

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments Work in progress

2207.14656 2022-08-01 cs.CV cs.LG 79%

Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesia

Bella Septina Ika Hartanti, Valentino Vito, Aniati Murni Arymurthy, Andie Setiyoko

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

2207.14428 2022-08-01 cs.CV 79%

Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrieval

Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at ACM MM 2022

2207.12650 2022-07-27 cs.CV cs.IR 79%

Asymmetric Scalable Cross-modal Hashing

Wenyun Li, Chi-Man Pun

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2207.01987 2022-07-06 cs.CV 79%

Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learning

Yuheng Lu, Chenfeng Xu, Xiaobao Wei, Xiaodong Xie, Masayoshi Tomizuka, Kurt Keutzer, Shanghang Zhang

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2206.02770 2022-06-07 cs.CV 79%

Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts

Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

2206.02343 2022-06-07 cs.CV 79%

Contrastive Graph Multimodal Model for Text Classification in Videos

Ye Liu, Changchong Lu, Chen Lin, Di Yin, Bo Ren

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

2204.13656 2022-04-29 cs.CV 79%

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

Zekang Chen, Jia Wei, Rui Li

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted in IJCAI 2022

2204.10931 2022-04-26 cs.CL 79%

MCSE: Multimodal Contrastive Learning of Sentence Embeddings

Miaoran Zhang, Marius Mosbach, David Ifeoluwa Adelani, Michael A. Hedderich, Dietrich Klakow

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by NAACL 2022 main conference (short paper), 11 pages

2204.08707 2022-04-20 cs.CV 79%

Unsupervised Contrastive Hashing for Cross-Modal Retrieval in Remote Sensing

Georgii Mikriukov, Mahdyar Ravanbakhsh, Begüm Demir

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments Our code is publicly available at https://git.tu-berlin.de/rsim/duch. arXiv admin note: substantial text overlap with arXiv:2201.08125

2204.05845 2022-04-13 cs.CV cs.LG 79%

Probabilistic Compositional Embeddings for Multimodal Image Retrieval

Andrei Neculai, Yanbei Chen, Zeynep Akata

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments CVPR2022 MULA workshop

2110.03290 2022-04-04 cs.CV 79%

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

Gaojian Wang, Qian Jiang, Xin Jin, Wei Li, Xiaohui Cui

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments 20 pages, 12 figures

2203.00680 2022-03-25 cs.CV 79%

CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding

Mohamed Afham, Isuru Dissanayake, Dinithi Dissanayake, Amaya Dharmasiri, Kanchana Thilakarathna, Ranga Rodrigo

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments CVPR 2022

2109.04260 2022-03-25 cs.MM cs.LG 79%

Online Enhanced Semantic Hashing: Towards Effective and Efficient Retrieval for Streaming Multi-Modal Data

Xiao-Ming Wu, Xin Luo, Yu-Wei Zhan, Chen-Lu Ding, Zhen-Duo Chen, Xin-Shun Xu

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.MM

Comments 9 pages, 5 figures

2103.14103 2022-03-22 cs.CV cs.LG 79%

Discriminative Semantic Transitive Consistency for Cross-Modal Learning

Kranti Kumar Parida, Gaurav Sharma

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2203.06920 2022-03-15 eess.IV cs.CV 79%

DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network

Ziqi Huang, Li Lin, Pujin Cheng, Kai Pan, Xiaoying Tang

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments 10 pages, 2 figures

2203.01153 2022-03-03 cs.RO cs.AI 79%

InsertionNet 2.0: Minimal Contact Multi-Step Insertion Using Multimodal Multiview Sensory Input

Oren Spector, Vladimir Tchuiev, Dotan Di Castro

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.AI

Comments Accepted to ICRA 2022, InsertionNet 1.0 : https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=9420246

2202.10232 2022-02-22 cs.IR cs.CV cs.LG 79%

Efficient Cross-Modal Retrieval via Deep Binary Hashing and Quantization

Yang Shi, Young-joo Chung

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at BMVC 2021

Journal ref BMVC 2021

2108.11656 2022-02-15 cs.CL cs.IR 79%

AR-BERT: Aspect-relation enhanced Aspect-level Sentiment Classification with Multi-modal Explanations

Sk Mainul Islam, Sourangshu Bhattacharya

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted at: The Webconf 2022

2202.05465 2022-02-14 cs.CV 79%

WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrieval

Guanglong Xu, Zhensheng Hu, Jia Cai

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2202.03587 2022-02-09 eess.AS cs.SD eess.SP 79%

CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations

Vin Sachidananda, Shao-Yen Tseng, Erik Marchi, Sachin Kajarekar, Panayiotis Georgiou

专题命中跨模态检索：multimodal(title,abstract)；分类 eess.AS

2201.06779 2022-01-19 cs.AI 79%

Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records

Shuai Niu, Qing Yin, Yunya Song, Yike Guo, Xian Yang

专题命中跨模态检索：multimodal(title)；multi-modal(abstract)；分类 cs.AI

2201.06734 2022-01-19 cs.CV 79%

Cross-modal Contrastive Distillation for Instructional Activity Anticipation

Zhengyuan Yang, Jingen Liu, Jing Huang, Xiaodong He, Tao Mei, Chenliang Xu, Jiebo Luo

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2112.01131 2021-12-29 cs.MM cs.CY cs.LG cs.SI 79%

FNR: A Similarity and Transformer-Based Approach to Detect Multi-Modal Fake News in Social Media

Faeze Ghorbanpour, Maryam Ramezani, Mohammad A. Fazli, Hamid R. Rabiee

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.MM

Comments 10 pages, 11 figures, 4 tables and 20 references

2112.10384 2021-12-21 cs.LG cs.CV 79%

Multimodal Adversarially Learned Inference with Factorized Discriminators

Wenxue Chen, Jianke Zhu

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 6 figures

2112.05827 2021-12-14 cs.CV cs.LG 79%

Quality-Aware Multimodal Biometric Recognition

Sobhan Soleymani, Ali Dabouei, Fariborz Taherkhani, Seyed Mehdi Iranmanesh, Jeremy Dawson, Nasser M. Nasrabadi

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments IEEE Transactions on Biometrics, Behavior, and Identity Science

2112.04182 2021-12-09 cs.CV 79%

Unimodal Face Classification with Multimodal Training

Wenbin Teng, Chongyang Bai

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE International Conference On Automatic Face and Gesture Recognition 2021

2110.12812 2021-10-26 cs.CV cs.LG 79%

Domain Adaptation in Multi-View Embedding for Cross-Modal Video Retrieval

Jonathan Munro, Michael Wray, Diane Larlus, Gabriela Csurka, Dima Damen

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments 15 pages

2110.11601 2021-10-26 cs.CV 79%

Multimodal Semi-Supervised Learning for 3D Objects

Zhimin Chen, Longlong Jing, Yang Liang, YingLi Tian, Bing Li

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments BMVC 2021 poster

2109.12750 2021-10-20 cs.LG cs.AI cs.RO 79%

Learning Multimodal Rewards from Rankings

Vivek Myers, Erdem Bıyık, Nima Anari, Dorsa Sadigh

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.AI

Comments 17 pages, 12 figures, 2 tables. Published at Conference on Robot Learning (CoRL) 2021

1. 跨模态检索 3450 篇

Prompt Tuning for Generative Multimodal Pretrained Models

Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesia

Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrieval

Asymmetric Scalable Cross-modal Hashing

Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learning

Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts

Contrastive Graph Multimodal Model for Text Classification in Videos

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

MCSE: Multimodal Contrastive Learning of Sentence Embeddings

Unsupervised Contrastive Hashing for Cross-Modal Retrieval in Remote Sensing

Probabilistic Compositional Embeddings for Multimodal Image Retrieval

MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection

CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding

Online Enhanced Semantic Hashing: Towards Effective and Efficient Retrieval for Streaming Multi-Modal Data

Discriminative Semantic Transitive Consistency for Cross-Modal Learning

DS3-Net: Difficulty-perceived Common-to-T1ce Semi-Supervised Multimodal MRI Synthesis Network

InsertionNet 2.0: Minimal Contact Multi-Step Insertion Using Multimodal Multiview Sensory Input

Efficient Cross-Modal Retrieval via Deep Binary Hashing and Quantization

AR-BERT: Aspect-relation enhanced Aspect-level Sentiment Classification with Multi-modal Explanations

WAD-CMSN: Wasserstein Distance based Cross-Modal Semantic Network for Zero-Shot Sketch-Based Image Retrieval

CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations

Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records

Cross-modal Contrastive Distillation for Instructional Activity Anticipation

FNR: A Similarity and Transformer-Based Approach to Detect Multi-Modal Fake News in Social Media

Multimodal Adversarially Learned Inference with Factorized Discriminators

Quality-Aware Multimodal Biometric Recognition

Unimodal Face Classification with Multimodal Training

Domain Adaptation in Multi-View Embedding for Cross-Modal Video Retrieval

Multimodal Semi-Supervised Learning for 3D Objects

Learning Multimodal Rewards from Rankings