多模态大模型 - arXivDaily 专题

2008.03561 2020-08-11 cs.CV 79%

Cross-modal Center Loss

Longlong Jing, Elahe Vahdani, Jiaxing Tan, Yingli Tian

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

2007.11067 2020-07-23 cs.CV 79%

Self-supervised Feature Learning via Exploiting Multi-modal Data for Retinal Disease Diagnosis

Xiaomeng Li, Mengyu Jia, Md Tauhidul Islam, Lequan Yu, Lei Xing

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE Transactions on Medical Imaging, code is at https://github.com/xmengli999/self_supervised

2007.02503 2020-07-07 cs.CV 79%

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang, Meng Wang, Tat-Seng Chua

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted For 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2020)

1912.10314 2020-07-06 cs.CV 79%

Multimodal Prediction based on Graph Representations

Icaro Cavalcante Dourado, Salvatore Tabbone, Ricardo da Silva Torres

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

2006.08765 2020-06-17 cs.LG cs.AI 79%

COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial Matching

Junyi Gao, Cao Xiao, Lucas M. Glass, Jimeng Sun

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.AI

Comments Accepted by KDD'20

2005.09801 2020-06-01 cs.IR cs.CV cs.LG eess.IV 79%

FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval

Dehong Gao, Linbo Jin, Ben Chen, Minghui Qiu, Peng Li, Yi Wei, Yi Hu, Hao Wang

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments 10 pages, to be published in SIGIR20 Industry Track

2004.08299 2020-04-20 cs.CL cs.LG 79%

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Kyomin Jung

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments Presented at DSTC Workshop @ AAAI 2020

2004.03378 2020-04-08 cs.CV 79%

Error-Corrected Margin-Based Deep Cross-Modal Hashing for Facial Image Retrieval

Fariborz Taherkhani, Veeru Talreja, Matthew C. Valenti, Nasser M. Nasrabadi

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2020

2004.00280 2020-04-02 cs.CV 79%

Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing

Hengtong Hu, Lingxi Xie, Richang Hong, Qi Tian

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments This paper has been accepted for CVPR2020

2003.13962 2020-04-01 cs.CV 79%

Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Difei Gao, Ke Li, Ruiping Wang, Shiguang Shan, Xilin Chen

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments Published as a CVPR2020 paper

2003.01607 2020-03-04 cs.CV 79%

Deep Multi-Modal Sets

Austin Reiter, Menglin Jia, Pu Yang, Ser-Nam Lim

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments 10 pages, 3 figures, 2 tables

2002.00677 2020-02-04 cs.CV 79%

A Novel Incremental Cross-Modal Hashing Approach

Devraj Mandal, Soma Biswas

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments 20 pages, 3 figures, 5 tables

2001.11101 2020-01-31 cs.LG cs.CV stat.ML 79%

Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding

Zhecheng Wang, Haoyuan Li, Ram Rajagopal

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

Comments To appear in Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20)

2001.04625 2020-01-15 cs.IR cs.CV cs.LG 79%

Asymmetric Correlation Quantization Hashing for Cross-modal Retrieval

Lu Wang, Jie Yang

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments 12 pages

1910.10542 2019-10-24 eess.IV cs.CV 79%

Deep generative model-driven multimodal prostate segmentation in radiotherapy

Kibrom Berihu Girum, Gilles Créhange, Raabid Hussain, Paul Michael Walker, Alain Lalande

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, camera ready paper, accepted for Artificial Intelligence in Radiation Therapy (AIRT), in conjunction with MICCAI 2019

1909.05506 2019-09-13 cs.CV 79%

CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval

Zihao Wang, Xihui Liu, Hongsheng Li, Lu Sheng, Junjie Yan, Xiaogang Wang, Jing Shao

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICCV 2019

1908.11125 2019-08-30 cs.CL 79%

Probing Representations Learned by Multimodal Recurrent and Transformer Models

Jindřich Libovický, Pranava Madhyastha

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments 8 pages, 2 figures

1906.06620 2019-06-18 cs.LG cs.CV cs.IR stat.ML 79%

Joint Visual-Textual Embedding for Multimodal Style Search

Gil Sadeh, Lior Fritz, Gabi Shalev, Eduard Oks

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

1905.12884 2019-05-31 cs.CL cs.HC 79%

M-GWAP: An Online and Multimodal Game With A Purpose in WordPress for Mental States Annotation

Fabio Paolizzo

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments 2 figures, 4 tables. The research is supported by the EU through the MUSICAL-MOODS project funded by the Marie Sklodowska-Curie Actions Individual Fellowships Global Fellowships (MSCA-IF-GF) of the Horizon 2020 Programme H2020/2014-2020, REA grant agreement n.659434

1905.11139 2019-05-28 cs.CV cs.IR 79%

Label Prediction Framework for Semi-Supervised Cross-Modal Retrieval

Devraj Mandal, Pramod Rao, Soma Biswas

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

Comments 12 pages, 3 tables, 2 figures, 1 algorithm flowchart

1811.00357 2019-05-17 cs.CL 79%

Latent Variable Model for Multi-modal Translation

Iacer Calixto, Miguel Rios, Wilker Aziz

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CL

Comments Paper accepted at ACL 2019. Contains 8 pages (11 including references, 13 including appendix), 6 figures

1904.13325 2019-05-16 cs.IR cs.MM 79%

Effective and Efficient Indexing in Cross-Modal Hashing-Based Datasets

Sarawut Markchit, Chih-Yi Chiu

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.MM

1905.02430 2019-05-08 cs.IR cs.CL cs.SI 79%

Interactive Search and Exploration in Online Discussion Forums Using Multimodal Embeddings

Iva Gornishka, Stevan Rudinac, Marcel Worring

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

1905.01304 2019-05-07 cs.LG cs.MM stat.ML 79%

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Tao Yao, Xiangwei Kong, Lianshan Yan, Wenjing Tang, Qi Tian

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.MM

1904.10615 2019-04-25 cs.CV 79%

Understanding Art through Multi-Modal Retrieval in Paintings

Noa Garcia, Benjamin Renoust, Yuta Nakashima

专题命中跨模态检索：multi-modal(title,abstract)；分类 cs.CV

1904.08042 2019-04-18 cs.MM cs.IR 79%

Adversarial Cross-Modal Retrieval via Learning and Transferring Single-Modal Similarities

Xin Wen, Zhizhong Han, Xinyu Yin, Yu-Shen Liu

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.MM

1904.07488 2019-04-17 cs.CV 79%

Shared Predictive Cross-Modal Deep Quantization

Erkun Yang, Cheng Deng, Chao Li, Wei Liu, Jie Li, Dacheng Tao

专题命中跨模态检索：cross-modal(title,abstract)；分类 cs.CV

1904.00639 2019-04-02 cs.CL 79%

Multimodal Machine Translation with Embedding Prediction

Tosho Hirasawa, Hayahide Yamagishi, Yukio Matsumura, Mamoru Komachi

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CL

Comments 6 pages; NAACL 2019 Student Research Workshop

1902.08888 2019-02-26 cs.LG cs.CV stat.ML 79%

Medical Multimodal Classifiers Under Scarce Data Condition

Faik Aydin, Maggie Zhang, Michelle Ananda-Rajah, Gholamreza Haffari

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

1801.03002 2019-02-21 cs.CV 79%

DeepStyle: Multimodal Search Engine for Fashion and Interior Design

Ivona Tautkute, Tomasz Trzcinski, Aleksander Skorupa, Lukasz Brocki, Krzysztof Marasek

专题命中跨模态检索：multimodal(title,abstract)；分类 cs.CV

Comments Copyright held by IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref IEEE Access 2019

1. 跨模态检索 3450 篇

Cross-modal Center Loss

Self-supervised Feature Learning via Exploiting Multi-modal Data for Retinal Disease Diagnosis

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

Multimodal Prediction based on Graph Representations

COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial Matching

FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrieval

DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator

Error-Corrected Margin-Based Deep Cross-Modal Hashing for Facial Image Retrieval

Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing

Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text

Deep Multi-Modal Sets

A Novel Incremental Cross-Modal Hashing Approach

Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding

Asymmetric Correlation Quantization Hashing for Cross-modal Retrieval

Deep generative model-driven multimodal prostate segmentation in radiotherapy

CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval

Probing Representations Learned by Multimodal Recurrent and Transformer Models

Joint Visual-Textual Embedding for Multimodal Style Search

M-GWAP: An Online and Multimodal Game With A Purpose in WordPress for Mental States Annotation

Label Prediction Framework for Semi-Supervised Cross-Modal Retrieval

Latent Variable Model for Multi-modal Translation

Effective and Efficient Indexing in Cross-Modal Hashing-Based Datasets

Interactive Search and Exploration in Online Discussion Forums Using Multimodal Embeddings

Efficient Discrete Supervised Hashing for Large-scale Cross-modal Retrieval

Understanding Art through Multi-Modal Retrieval in Paintings

Adversarial Cross-Modal Retrieval via Learning and Transferring Single-Modal Similarities

Shared Predictive Cross-Modal Deep Quantization

Multimodal Machine Translation with Embedding Prediction

Medical Multimodal Classifiers Under Scarce Data Condition

DeepStyle: Multimodal Search Engine for Fashion and Interior Design