多模态大模型 - arXivDaily 专题

2210.11204 2022-10-21 cs.CV 57%

PalGAN: Image Colorization with Palette Generative Adversarial Networks

Yi Wang, Menghan Xia, Lu Qi, Jing Shao, Yu Qiao

专题命中跨模态检索：multimodal(abstract)；分类 cs.CV

Comments Accepted at ECCV 2022

2205.05507 2022-10-07 cs.CV 57%

TextMatcher: Cross-Attentional Neural Network to Compare Image and Text

Valentina Arrigoni, Luisa Repele, Dario Marino Saccavino

专题命中跨模态检索：multimodal(abstract)；分类 cs.CV

Comments Accepted at the 25th International Conference on Discovery Science 2022, 15 pages

2203.04013 2022-10-05 eess.IV cs.CV 57%

Mutual Contrastive Low-rank Learning to Disentangle Whole Slide Image Representations for Glioma Grading

Lipei Zhang, Yiran Wei, Ying Fu, Stephen Price, Carola-Bibiane Schönlieb, Chao Li

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments 14 pages, 4 figures, 3 tables; This paper was accepted by BMVC 2022

2209.14644 2022-09-30 cs.LG cs.CV 57%

Increasing Model Generalizability for Unsupervised Domain Adaptation

Mohammad Rostami

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments Presented 2022 Conference on Lifelong Learning Agents

2207.07285 2022-09-23 cs.CV 57%

X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan, Ji Zhang, Rongrong Ji

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments 13 pages, 6 figures, ACMMM22

2209.10304 2022-09-22 cs.CV 57%

I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification

Muhammad Ferjad Naeem, Yongqin Xian, Luc Van Gool, Federico Tombari

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments 36th Conference on Neural Information Processing Systems (NeurIPS 2022)

2209.09433 2022-09-21 cs.CL 57%

Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings

Yiren Jian, Chongyang Gao, Soroush Vosoughi

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CL

Comments Accepted to NeurIPS 2022

2209.07996 2022-09-19 cs.RO cs.AI 57%

SoLo T-DIRL: Socially-Aware Dynamic Local Planner based on Trajectory-Ranked Deep Inverse Reinforcement Learning

Yifan Xu, Theodor Chakhachiro, Tribhi Kathuria, Maani Ghaffari

专题命中跨模态检索：multi-modal(abstract)；分类 cs.AI

2209.01517 2022-09-07 cs.CV 57%

Joint Prediction of Meningioma Grade and Brain Invasion via Task-Aware Contrastive Learning

Tianling Liu, Wennan Liu, Lequan Yu, Liang Wan, Tong Han, Lei Zhu

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments Accepted by MICCAI2022

2209.01152 2022-09-05 cs.CV 57%

A Novel Approach for Pill-Prescription Matching with GNN Assistance and Contrastive Learning

Trung Thanh Nguyen, Hoang Dang Nguyen, Thanh Hung Nguyen, Huy Hieu Pham, Ichiro Ide, Phi Le Nguyen

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments Accepted for publication and presentation at the 19th Pacific Rim International Conference on Artificial Intelligence (PRICAI 2022)

2208.12238 2022-08-26 cs.HC cs.AI cs.LG 57%

Supervised Contrastive Learning for Affect Modelling

Kosmas Pinitas, Konstantinos Makantasis, Antonios Liapis, Georgios N. Yannakakis

专题命中跨模态检索：multimodal(abstract)；分类 cs.AI

Comments This paper was accepted to ICMI 2022

2110.15087 2022-08-09 cs.LG cs.AI cs.SI 57%

MOOMIN: Deep Molecular Omics Network for Anti-Cancer Drug Combination Therapy

Benedek Rozemberczki, Anna Gogleva, Sebastian Nilsson, Gavin Edwards, Andriy Nikolov, Eliseo Papa

专题命中跨模态检索：multimodal(abstract)；分类 cs.AI

2110.01209 2022-08-02 cs.CV 57%

Learning Structural Representations for Recipe Generation and Food Retrieval

Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments Accepted at IEEE Transactions on Pattern Analysis and Machine Intelligence. arXiv admin note: substantial text overlap with arXiv:2009.00944

2207.13038 2022-07-27 cs.CV 57%

Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models

Robin Rombach, Andreas Blattmann, Björn Ommer

专题命中跨模态检索：multimodal(abstract)；分类 cs.CV

Comments 4 pages

2106.09703 2022-07-21 cs.CV 57%

MaCLR: Motion-aware Contrastive Learning of Representations for Videos

Fanyi Xiao, Joseph Tighe, Davide Modolo

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments ECCV 2022

2107.14204 2022-07-19 cs.CV 57%

Personalized Trajectory Prediction via Distribution Discrimination

Guangyi Chen, Junlong Li, Nuoxing Zhou, Liangliang Ren, Jiwen Lu

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments Accepted to ICCV 2021. Code: https://github.com/CHENGY12/DisDis

2205.07869 2022-07-06 eess.SP cs.AI cs.LG 57%

Near out-of-distribution detection for low-resolution radar micro-Doppler signatures

Martin Bauw, Santiago Velasco-Forero, Jesus Angulo, Claude Adnet, Olivier Airiau

专题命中跨模态检索：multimodal(abstract)；分类 cs.AI

2207.00750 2022-07-05 cs.AI cs.IR 57%

GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce

Chao Yang, Ru He, Fangquan Lin, Suoyuan Song, Jingqiao Zhang, Cheng Yang

专题命中跨模态检索：multi-modal(abstract)；分类 cs.AI

Comments 10 pages, 3 figures

2206.12071 2022-06-27 cs.CV 57%

Contrastive Learning of Features between Images and LiDAR

Peng Jiang, Srikanth Saripalli

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments accepted in CASE2022

2206.10879 2022-06-23 cs.CV 57%

Symmetric Network with Spatial Relationship Modeling for Natural Language-based Vehicle Retrieval

Chuyang Zhao, Haobo Chen, Wenyuan Zhang, Junru Chen, Sipeng Zhang, Yadong Li, Boxun Li

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments 8 pages, 3 figures, publised to CVPRW

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022: 3226-3233

2206.08172 2022-06-17 cs.CV 57%

RefCrowd: Grounding the Target in Crowd with Referring Expressions

Heqian Qiu, Hongliang Li, Taijin Zhao, Lanxiao Wang, Qingbo Wu, Fanman Meng

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

2103.04789 2022-06-08 cs.CV 57%

Look, Cast and Mold: Learning 3D Shape Manifold from Single-view Synthetic Data

Qianyu Feng, Yawei Luo, Keyang Luo, Yi Yang

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments this work is no longer under development

2205.03891 2022-05-10 cs.CV 57%

Cross-lingual Adaptation for Recipe Retrieval with Mixup

Bin Zhu, Chong-Wah Ngo, Jingjing Chen, Wing-Kwong Chan

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments Accepted by ICMR2022

2204.08209 2022-05-10 cs.CV 57%

OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval

Yunhao Du, Binyu Zhang, Xiangning Ruan, Fei Su, Zhicheng Zhao, Hong Chen

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2022 Workshop

2003.09869 2022-05-09 cs.CV 57%

Progressive Domain-Independent Feature Decomposition Network for Zero-Shot Sketch-Based Image Retrieval

Xinxun Xu, Muli Yang, Yanhua Yang, Hao Wang

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

2112.08614 2022-05-06 cs.CL 57%

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

专题命中跨模态检索：multimodal(abstract)；分类 cs.CL

Comments Accepted by NAACL 2022

2112.06147 2022-04-27 cs.CV 57%

Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification

Lin Wan, Qianyan Jing, Zongyuan Sun, Chuang Zhang, Zhihang Li, Yehansen Chen

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments 13 pages, 8 figures

2204.11004 2022-04-26 cs.CV 57%

Training and challenging models for text-guided fashion image retrieval

Eric Dodds, Jack Culpepper, Gaurav Srivastava

专题命中跨模态检索：multimodal(abstract)；分类 cs.CV

2003.03369 2022-04-26 cs.CV 57%

A Survey on Deep Hashing Methods

Xiao Luo, Haixin Wang, Daqing Wu, Chong Chen, Minghua Deng, Jianqiang Huang, Xian-Sheng Hua

专题命中跨模态检索：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ACM Transactions on Knowledge Discovery from Data (TKDD)

2112.12777 2022-04-20 cs.CV 57%

Cross Modal Retrieval with Querybank Normalisation

Simion-Vlad Bogolin, Ioana Croitoru, Hailin Jin, Yang Liu, Samuel Albanie

专题命中跨模态检索：cross-modal(abstract)；分类 cs.CV

Comments Accepted at CVPR 2022

1. 跨模态检索 3457 篇

PalGAN: Image Colorization with Palette Generative Adversarial Networks

TextMatcher: Cross-Attentional Neural Network to Compare Image and Text

Mutual Contrastive Low-rank Learning to Disentangle Whole Slide Image Representations for Glioma Grading

Increasing Model Generalizability for Unsupervised Domain Adaptation

X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

I2DFormer: Learning Image to Document Attention for Zero-Shot Image Classification

Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings

SoLo T-DIRL: Socially-Aware Dynamic Local Planner based on Trajectory-Ranked Deep Inverse Reinforcement Learning

Joint Prediction of Meningioma Grade and Brain Invasion via Task-Aware Contrastive Learning

A Novel Approach for Pill-Prescription Matching with GNN Assistance and Contrastive Learning

Supervised Contrastive Learning for Affect Modelling

MOOMIN: Deep Molecular Omics Network for Anti-Cancer Drug Combination Therapy

Learning Structural Representations for Recipe Generation and Food Retrieval

Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Models

MaCLR: Motion-aware Contrastive Learning of Representations for Videos

Personalized Trajectory Prediction via Distribution Discrimination

Near out-of-distribution detection for low-resolution radar micro-Doppler signatures

GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce

Contrastive Learning of Features between Images and LiDAR

Symmetric Network with Spatial Relationship Modeling for Natural Language-based Vehicle Retrieval

RefCrowd: Grounding the Target in Crowd with Referring Expressions

Look, Cast and Mold: Learning 3D Shape Manifold from Single-view Synthetic Data

Cross-lingual Adaptation for Recipe Retrieval with Mixup

OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval

Progressive Domain-Independent Feature Decomposition Network for Zero-Shot Sketch-Based Image Retrieval

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification

Training and challenging models for text-guided fashion image retrieval

A Survey on Deep Hashing Methods

Cross Modal Retrieval with Querybank Normalisation