多模态大模型

Deep Learning Techniques for Future Intelligent Cross-Media Retrieval

Sadaqat ur Rehman, Muhammad Waqas, Shanshan Tu, Anis Koubaa, Obaid ur Rehman, Jawad Ahmad, Muhammad Hanif, Zhu Han

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:1804.09539 by other authors

Attributed Sequence Embedding

Zhongfang Zhuang, Xiangnan Kong, Elke Rundensteiner, Jihane Zouaoui, Aditya Arora

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments Accepted by IEEE Big Data 2019

A Bag of Visual Words Model for Medical Image Retrieval

Sowmya Kamath S, Karthik K

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments In the proceedings of the 7th International Engineering Symposium (IES 2018), Kumamoto University, Kumamoto, Japan, Mar 7-9, 2018

Multi-view Orthonormalized Partial Least Squares: Regularizations and Deep Extensions

Li Wang, Ren-Cang Li, Wen-Wei

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Location Sensitive Image Retrieval and Tagging

Raul Gomez, Jaume Gibert, Lluis Gomez, Dimosthenis Karatzas

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Journal ref ECCV 2020

Learning Colour Representations of Search Queries

Paridhi Maheshwari, Manoj Ghuhan, Vishwa Vinay

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted as a full paper at SIGIR 2020

Self-supervised Modal and View Invariant Feature Learning

Longlong Jing, Yucheng Chen, Ling Zhang, Mingyi He, Yingli Tian

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

T-VSE: Transformer-Based Visual Semantic Embedding

Muhammet Bastan, Arnau Ramisa, Mehmet Tek

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments To appear: CVPR 2020 Workshop on Computer Vision for Fashion, Art and Design (CVFAD 2020)

Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval

Ayan Kumar Bhunia, Yongxin Yang, Timothy M. Hospedales, Tao Xiang, Yi-Zhe Song

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2020 [Oral Presentation] Code: https://github.com/AyanKumarBhunia/on-the-fly-FGSBIR

Quality Guided Sketch-to-Photo Image Synthesis

Uche Osahor, Hadi Kazemi, Ali Dabouei, Nasser Nasrabadi

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments 10 pages, 9 figures

Cross-View Image Retrieval -- Ground to Aerial Image Retrieval through Deep Learning

Numan Khurshid, Talha Hanif, Mohbat Tharani, Murtaza Taj

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments International Conference on Neural Information Processing (ICONIP-2019)

CLAREL: Classification via retrieval loss for zero-shot learning

Boris N. Oreshkin, Negar Rostamzadeh, Pedro O. Pinheiro, Christopher Pal

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

CurlingNet: Compositional Learning between Images and Text for Fashion IQ Data

Youngjae Yu, Seunghwan Lee, Yuncheol Choi, Gunhee Kim

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments 4 pages, 4 figures, ICCV 2019 Linguistics Meets image and video retrieval workshop, Fashion IQ challenge

Matching Neuromorphic Events and Color Images via Adversarial Learning

Fang Xu, Shijie Lin, Wen Yang, Lei Yu, Dengxin Dai, Gui-song Xia

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

A Unified System for Aggression Identification in English Code-Mixed and Uni-Lingual Texts

Anant Khandelwal, Niraj Kumar

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments 10 pages, 5 Figures, 6 Tables, accepted at CoDS-COMAD 2020

Fine-grained Image Classification and Retrieval by Combining Visual and Locally Pooled Textual Features

Andres Mafla, Sounak Dey, Ali Furkan Biten, Lluis Gomez, Dimosthenis Karatzas

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments Winter Conference on Applications of Computer Vision (WACV 2020) Accepted paper

Macaw: An Extensible Conversational Information Seeking Platform

Hamed Zamani, Nick Craswell

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Self-Attention and Ingredient-Attention Based Model for Recipe Retrieval from Image Queries

Matthias Fontanellaz, Stergios Christodoulidis, Stavroula Mougiakakou

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments MADiMa 2019,5th International Workshop on Multimedia Assisted Dietary Management

Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentation

Reuben Dorent, Samuel Joutard, Marc Modat, Sébastien Ourselin, Tom Vercauteren

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at MICCAI 2019

Semantic Adversarial Network for Zero-Shot Sketch-Based Image Retrieval

Xinxun Xu, Hao Wang, Leida Li, Cheng Deng

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments There is a big problem with the paper and I hope it can be retracted

Learning semantic sentence representations from visually grounded language without lexical knowledge

Danny Merkx, Stefan Frank

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Journal ref Natural Language Engineering, Volume 25 - Issue 4 - July 2019

Do Cross Modal Systems Leverage Semantic Relationships?

Shah Nawaz, Muhammad Kamran Janjua, Ignazio Gallo, Arif Mahmood, Alessandro Calefati, Faisal Shafait

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to cross modal learning in real world in conjunction with ICCV 2019. arXiv admin note: text overlap with arXiv:1807.07364

SMIT: Stochastic Multi-Label Image-to-Image Translation

Andrés Romero, Pablo Arbeláez, Luc Van Gool, Radu Timofte

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments ICCV Workshops, 2019

Semi Supervised Phrase Localization in a Bidirectional Caption-Image Retrieval Framework

Deepan Das, Noor Mohammed Ghouse, Shashank Verma, Yin Li

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddings

Jing Han, Zixing Zhang, Zhao Ren, Björn Schuller

专题命中 跨模态检索 ：multimodal(abstract)；分类 eess.AS

Multisensory Learning Framework for Robot Drumming

A. Barsky, C. Zito, H. Mori, T. Ogata, J. L. Wyatt

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Extended abstract

Journal ref Workshop on Crossmodal Learning for Intelligent Robotics 2nd Edition. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018

Fusion vectors: Embedding Graph Fusions for Efficient Unsupervised Rank Aggregation

Icaro Cavalcante Dourado, Ricardo da Silva Torres

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Translate-to-Recognize Networks for RGB-D Scene Recognition

Dapeng Du, Limin Wang, Huiling Wang, Kai Zhao, Gangshan Wu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2019. Project: https://ownstyledu.github.io/Translate-to-Recognize-Networks/

Context-Aware Embeddings for Automatic Art Analysis

Noa Garcia, Benjamin Renoust, Yuta Nakashima

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

SoDeep: a Sorting Deep net to learn ranking loss surrogates

Martin Engilberge, Louis Chevallier, Patrick Pérez, Matthieu Cord

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2019