多模态大模型

A Survey on Deep Hashing Methods

Xiao Luo, Haixin Wang, Daqing Wu, Chong Chen, Minghua Deng, Jianqiang Huang, Xian-Sheng Hua

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ACM Transactions on Knowledge Discovery from Data (TKDD)

Cross Modal Retrieval with Querybank Normalisation

Simion-Vlad Bogolin, Ioana Croitoru, Hailin Jin, Yang Liu, Samuel Albanie

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at CVPR 2022

How to Register a Live onto a Liver ? Partial Matching in the Space of Varifolds

Pierre-Louis Antonsanti, Thomas Benseghir, Vincent Jugnon, Mario Ghosn, Perrine Chassat, Irène Kaltenmark, Joan Glaunès

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments 30 pages, 11 figures, Special Issue: Information Processing in Medical Imaging (IPMI) 2021, Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://www.melba-journal.org

Journal ref Journal of Machine Learning for Biomedical Imaging (MELBA) 2022

Probabilistic Implicit Scene Completion

Dongsu Zhang, Changwoon Choi, Inbum Park, Young Min Kim

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to ICLR 2022 as spotlight, code available at https://github.com/96lives/gca

InstaFormer: Instance-Aware Image-to-Image Translation with Transformer

Soohyun Kim, Jongbeom Baek, Jihye Park, Gyeongnyeon Kim, Seungryong Kim

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2022

Learning Program Representations for Food Images and Cooking Recipes

Dim P. Papadopoulos, Enrique Mora, Nadiia Chepurko, Kuan Wei Huang, Ferda Ofli, Antonio Torralba

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2022 oral

Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model

Benzhi Wang, Meiyu Liang, Feifei Kou, Mingying Xu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.AI

Partially Does It: Towards Scene-Level FG-SBIR with Partial Input

Pinaki Nath Chowdhury, Ayan Kumar Bhunia, Viswanatha Reddy Gajjala, Aneeshan Sain, Tao Xiang, Yi-Zhe Song

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted in CVPR 2022

Sketch3T: Test-Time Training for Zero-Shot SBIR

Aneeshan Sain, Ayan Kumar Bhunia, Vaishnav Potlapalli, Pinaki Nath Chowdhury, Tao Xiang, Yi-Zhe Song

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments 10 pages, 5 figures. Accepted in CVPR 2022

Compound Domain Generalization via Meta-Knowledge Encoding

Chaoqi Chen, Jiongcheng Li, Xiaoguang Han, Xiaoqing Liu, Yizhou Yu

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2022

Latent Structure Mining with Contrastive Modality Fusion for Multimedia Recommendation

Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Mengqi Zhang, Shu Wu, Liang Wang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.MM

Comments 14 pages; in submission to IEEE TKDE

Learning video retrieval models with relevance-aware online mining

Alex Falcon, Giuseppe Serra, Oswald Lanz

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at 21st International Conference on Image Analysis and Processing (ICIAP 2021)

Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm

Yangguang Li, Feng Liang, Lichen Zhao, Yufeng Cui, Wanli Ouyang, Jing Shao, Fengwei Yu, Junjie Yan

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments 17 pages, 10 figures

HINT: Hierarchical Interaction Network for Trial Outcome Prediction Leveraging Web Data

Tianfan Fu, Kexin Huang, Cao Xiao, Lucas M. Glass, Jimeng Sun

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Barlow constrained optimization for Visual Question Answering

Abhishek Jha, Badri N. Patro, Luc Van Gool, Tinne Tuytelaars

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks

Chanyong Jung, Gihyun Kwon, Jong Chul Ye

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments CVPR 2022

A Meta-embedding-based Ensemble Approach for ICD Coding Prediction

Pavithra Rajendran, Alexandros Zenonos, Josh Spear, Rebecca Pope

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Learning Deep Semantic Model for Code Search using CodeSearchNet Corpus

Chen Wu, Ming Yan

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Contrastive Representation Distillation

Yonglong Tian, Dilip Krishnan, Phillip Isola

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments ICLR 2020. Project Page: http://hobbitlong.github.io/CRD/, Code: http://github.com/HobbitLong/RepDistiller. Typo fixed in the newest version

SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations

Zhenyu Li, Zehui Chen, Ang Li, Liangji Fang, Qinhong Jiang, Xianming Liu, Junjun Jiang, Bolei Zhou, Hang Zhao

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to 36th AAAI Conference on Artificial Intelligence (AAAI 2022)

Margin Preserving Self-paced Contrastive Learning Towards Domain Adaptation for Medical Image Segmentation

Zhizhe Liu, Zhenfeng Zhu, Shuai Zheng, Yang Liu, Jiayu Zhou, Yao Zhao

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments This manuscript has been accepted by by IEEE JBHI and the code is available in https://github.com/TFboys-lzz/MPSCL

Robust Contrastive Learning against Noisy Views

Ching-Yao Chuang, R Devon Hjelm, Xin Wang, Vibhav Vineet, Neel Joshi, Antonio Torralba, Stefanie Jegelka, Yale Song

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images

Ali Hatamizadeh, Vishwesh Nath, Yucheng Tang, Dong Yang, Holger Roth, Daguang Xu

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments 13 pages, 3 figures

Extending CLIP for Category-to-image Retrieval in E-commerce

Mariya Hendriksen, Maurits Bleeker, Svitlana Vakulenko, Nanne van Noord, Ernst Kuiper, Maarten de Rijke

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.MM

Comments 15 pages, accepted as a full paper at ECIR 2022

Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model

Jiangning Zhang, Chao Xu, Jian Li, Wenzhou Chen, Yabiao Wang, Ying Tai, Shuo Chen, Chengjie Wang, Feiyue Huang, Yong Liu

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

GROWL: Group Detection With Link Prediction

Viktor Schmuck, Oya Celiktutan

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

RTIC: Residual Learning for Text and Image Composition using Graph Convolutional Network

Minchul Shin, Yoonjae Cho, Byungsoo Ko, Geonmo Gu

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environments

Henry Howard-Jenkins, Jose-Raul Ruiz-Sarmiento, Victor Adrian Prisacariu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments As presented at the International Conference on Computer Vision (ICCV) 2021

Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network

Lianghao Xia, Chao Huang, Yong Xu, Peng Dai, Bo Zhang, Liefeng Bo

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Comments Published as a full paper at SIGIR 2020

Survey of Visual-Semantic Embedding Methods for Zero-Shot Image Retrieval

Kazuya Ueki

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments Accepted by 20th IEEE International Conference on Machine Learning and Applications (ICMLA2021)