多模态大模型

Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering

Chengxiang Yin, Zhengping Che, Kun Wu, Zhiyuan Xu, Jian Tang

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Expediting Contrastive Language-Image Pretraining via Self-distilled Encoders

Bumsoo Kim, Jinhyung Kim, Yeonsik Jo, Seung Hwan Kim

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments AAAI 2024

CLIM: Contrastive Language-Image Mosaic for Region Representation

Size Wu, Wenwei Zhang, Lumin Xu, Sheng Jin, Wentao Liu, Chen Change Loy

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Urban Region Embedding via Multi-View Contrastive Prediction

Zechen Li, Weiming Huang, Kai Zhao, Min Yang, Yongshun Gong, Meng Chen

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

MONET: Modality-Embracing Graph Convolutional Network and Target-Aware Attention for Multimedia Recommendation

Yungi Kim, Taeri Kim, Won-Yong Shin, Sang-Wook Kim

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Comments Accepted by WSDM 2024

Survey on Memory-Augmented Neural Networks: Cognitive Insights to AI Applications

Savya Khosla, Zhen Zhu, Yifei He

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.AI

Speaker-Text Retrieval via Contrastive Learning

Xuechen Liu, Xin Wang, Erica Cooper, Xiaoxiao Miao, Junichi Yamagishi

专题命中 跨模态检索 ：cross-modal(abstract)；分类 eess.AS

Comments Submitted to IEEE Signal Processing Letters

SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations

Tao Shi, Xiao Liang, Yaoyuan Liang, Xinyi Tong, Shao-Lun Huang

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Bidirectional Contrastive Split Learning for Visual Question Answering

Yuwei Sun, Hideya Ochiai

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted for AAAI 2024

Scaling Laws for Adversarial Attacks on Language Model Activations

Stanislav Fort

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments 15 pages, 9 figures

Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines

Hamed Damirchi, Cristian Rodríguez-Opazo, Ehsan Abbasnejad, Damien Teney, Javen Qinfeng Shi, Stephen Gould, Anton van den Hengel

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

CALICO: Self-Supervised Camera-LiDAR Contrastive Pre-training for BEV Perception

Jiachen Sun, Haizhong Zheng, Qingzhao Zhang, Atul Prakash, Z. Morley Mao, Chaowei Xiao

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Contrastive Transformer Learning with Proximity Data Generation for Text-Based Person Search

Hefeng Wu, Weifeng Chen, Zhibin Liu, Tianshui Chen, Zhiguang Chen, Liang Lin

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IEEE T-CSVT

Overview of the TREC 2023 Product Product Search Track

Daniel Campos, Surya Kallumadi, Corby Rosset, Cheng Xiang Zhai, Alessandro Magnani

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Comments 14 pages, 4 figures, 11 tables - TREC 2023

Bi-directional Training for Composed Image Retrieval via Text Prompt Learning

Zheyuan Liu, Weixuan Sun, Yicong Hong, Damien Teney, Stephen Gould

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CV

Comments WACV 2024 accepted. 12 pages, 7 figures

BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping

Srikumar Sastry, Subash Khanal, Aayush Dhakal, Di Huang, Nathan Jacobs

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at WACV 2024

DocumentNet: Bridging the Data Gap in Document Pre-Training

Lijun Yu, Jin Miao, Xiaoyu Sun, Jiayi Chen, Alexander G. Hauptmann, Hanjun Dai, Wei Wei

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments EMNLP 2023

HiGitClass: Keyword-Driven Hierarchical Classification of GitHub Repositories

Yu Zhang, Frank F. Xu, Sha Li, Yu Meng, Xuan Wang, Qi Li, Jiawei Han

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments 10 pages; Accepted to ICDM 2019; Some typos fixed

Contrastive Prompt Learning-based Code Search based on Interaction Matrix

Yubo Zhang, Yanfang Liu, Xinxin Fan, Yunfeng Lu

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.AI

SelfGraphVQA: A Self-Supervised Graph Neural Network for Scene-based Question Answering

Bruno Souza, Marius Aasan, Helio Pedrini, Adín Ramírez Rivera

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments To appear in Vision-and-Language Algorithmic Reasoning Workshop at ICCV 2023

Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association

Qiyu Wu, Mengjie Zhao, Yutong He, Lang Huang, Junya Ono, Hiromi Wakaki, Yuki Mitsufuji

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

ALEX: Towards Effective Graph Transfer Learning with Noisy Labels

Jingyang Yuan, Xiao Luo, Yifang Qin, Zhengyang Mao, Wei Ju, Ming Zhang

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.AI

Comments Accepted by the ACM International Conference on Multimedia (MM) 2023

Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training

Ziyu Guo, Renrui Zhang, Longtian Qiu, Xianzhi Li, Pheng-Ann Heng

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by IJCAI 2023

MT4CrossOIE: Multi-stage Tuning for Cross-lingual Open Information Extraction

Tongliang Li, Zixiang Wang, Linzheng Chai, Jian Yang, Jiaqi Bai, Yuwei Yin, Jiaheng Liu, Hongcheng Guo, Liqun Yang, Hebboul Zine el-abidine, Zhoujun Li

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CL

Comments 10 pages

In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video Retrieval

Nina Shvetsova, Anna Kukleva, Bernt Schiele, Hilde Kuehne

专题命中 跨模态检索 ：image-text(abstract)；分类 cs.CV

Comments Published at ICCV 2023, code: https://github.com/ninatu/in_style

Biased Attention: Do Vision Transformers Amplify Gender Bias More than Convolutional Neural Networks?

Abhishek Mandal, Susan Leavy, Suzanne Little

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Active Learning for Fine-Grained Sketch-Based Image Retrieval

Himanshu Thakur, Soumitri Chattopadhyay

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted at BMVC 2023

OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Data

Giuseppe Cartella, Alberto Baldrati, Davide Morelli, Marcella Cornia, Marco Bertini, Rita Cucchiara

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.CV

Comments International Conference on Image Analysis and Processing (ICIAP) 2023

Long-Range Transformer Architectures for Document Understanding

Thibault Douzon, Stefan Duffner, Christophe Garcia, Jérémy Espinas

专题命中 跨模态检索 ：multi-modal(abstract)；分类 cs.CL

Comments Conference: ICDAR 2023 Workshops on Document Analysis and Recognition

Journal ref Document Analysis and Recognition ICDAR 2023 Workshops pages 47 to 64

Target-Guided Composed Image Retrieval

Haokun Wen, Xian Zhang, Xuemeng Song, Yinwei Wei, Liqiang Nie

专题命中 跨模态检索 ：multimodal(abstract)；分类 cs.MM

Journal ref ACM Multimedia 2023