多模态大模型

Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics

Nils Böhne, Mark Berger, Ronald van Velzen

专题命中 跨模态检索 ：cross-modal(title,abstract)

Comments Submitted to the AAAI22 conference

Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval

Zichen Yuan, Qi Shen, Bingyi Zheng, Yuting Liu, Linying Jiang, Guibing Guo

专题命中 跨模态检索 ：cross-modal(title,abstract)

RECipe: Does a Multi-Modal Recipe Knowledge Graph Fit a Multi-Purpose Recommendation System?

Ali Pesaranghader, Touqir Sajed

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 19 pages, 8 figures, 8 tables

Multimodal LLMs for health grounded in individual-specific data

Anastasiya Belyaeva, Justin Cosentino, Farhad Hormozdiari, Krish Eswaran, Shravya Shetty, Greg Corrado, Andrew Carroll, Cory Y. McLean, Nicholas A. Furlotte

专题命中 跨模态检索 ：multimodal(title,abstract)

On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning

Yiting Qu, Xinlei He, Shannon Pierson, Michael Backes, Yang Zhang, Savvas Zannettou

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments To Appear in the 44th IEEE Symposium on Security and Privacy, May 22-25, 2023

Robust Failure Diagnosis of Microservice System through Multimodal Data

Shenglin Zhang, Pengxiang Jin, Zihan Lin, Yongqian Sun, Bicheng Zhang, Sibo Xia, Zhengdan Li, Zhenyu Zhong, Minghua Ma, Wa Jin, Dai Zhang, Zhenyu Zhu, Dan Pei

专题命中 跨模态检索 ：multimodal(title,abstract)

Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias

Robert Wolfe, Yiwei Yang, Bill Howe, Aylin Caliskan

专题命中 跨模态检索 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 12 pages, 4 figures, 2 tables

Journal ref ACM FAccT 2023

Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention

Kwanhyung Lee, Soojeong Lee, Sangchul Hahn, Heejung Hyun, Edward Choi, Byungeun Ahn, Joohyung Lee

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments MLHC 2023, Under Review

MDENet: Multi-modal Dual-embedding Networks for Malware Open-set Recognition

Jingcai Guo, Yuanyuan Xu, Wenchao Xu, Yufeng Zhan, Yuxia Sun, Song Guo

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 14 pages, 7 figures

Bootstrap Latent Representations for Multi-modal Recommendation

Xin Zhou, Hongyu Zhou, Yong Liu, Zhiwei Zeng, Chunyan Miao, Pengwei Wang, Yuan You, Feijun Jiang

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Accepted by Proceedings of the ACM Web Conference 2023 (WWW'23)

Self-Supervised Multi-Modal Sequential Recommendation

Kunzhe Song, Qingfeng Sun, Can Xu, Kai Zheng, Yaming Yang

专题命中 跨模态检索 ：multi-modal(title,abstract)

OFAR: A Multimodal Evidence Retrieval Framework for Illegal Live-streaming Identification

Lin Dengtian, Ma Yang, Li Yuhong, Song Xuemeng, Wu Jianlong, Nie Liqiang

专题命中 跨模态检索 ：multimodal(title,abstract)

A Self-supervised Framework for Improved Data-Driven Monitoring of Stress via Multi-modal Passive Sensing

Shayan Fazeli, Lionel Levine, Mehrab Beikzadeh, Baharan Mirzasoleiman, Bita Zadeh, Tara Peris, Majid Sarrafzadeh

专题命中 跨模态检索 ：multi-modal(title,abstract)

Identifiability Results for Multimodal Contrastive Learning

Imant Daunhawer, Alice Bizeul, Emanuele Palumbo, Alexander Marx, Julia E. Vogt

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments ICLR 2023 camera-ready version

Understanding Multimodal Contrastive Learning and Incorporating Unpaired Data

Ryumei Nakada, Halil Ibrahim Gulluk, Zhun Deng, Wenlong Ji, James Zou, Linjun Zhang

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments 42 pages, 3 figures, accepted by AISTATS 2023; a link to GitHub repository added, style corrected, acknowledgements section added

Universal Vision-Language Dense Retrieval: Learning A Unified Representation Space for Multi-Modal Retrieval

Zhenghao Liu, Chenyan Xiong, Yuanhuiyi Lv, Zhiyuan Liu, Ge Yu

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Accepted by ICLR 2023

Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

Miriam Anschütz, Tobias Eder, Georg Groh

专题命中 跨模态检索 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 8 pages, 5 figures, published at 2023 IEEE 17th International Conference on Semantic Computing (ICSC)

A Multimodal Embedding-Based Approach to Industry Classification in Financial Markets

Rian Dolphin, Barry Smyth, Ruihai Dong

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments 8 pages. Accepted at AICS 2022 under title "A Machine Learning Approach to Industry Classification in Financial Markets". Preliminary version under this title was discussed at ICAIF '22 Workshop on NLP and Network Analysis in Financial Applications. arXiv admin note: text overlap with arXiv:2202.08968

MEGCF: Multimodal Entity Graph Collaborative Filtering for Personalized Recommendation

Kang Liu, Feng Xue, Dan Guo, Le Wu, Shujie Li, Richang Hong

专题命中 跨模态检索 ：multimodal(title,abstract)

Information-Theoretic Hashing for Zero-Shot Cross-Modal Retrieval

Yufeng Shi, Shujian Yu, Duanquan Xu, Xinge You

专题命中 跨模态检索 ：cross-modal(title,abstract)

Multimodal Neural Machine Translation with Search Engine Based Image Retrieval

ZhenHao Tang, XiaoBing Zhang, Zi Long, XiangHua Fu

专题命中 跨模态检索 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments 9 pages, 5 figures

Multimodal Estimation of End Point Force During Quasi-dynamic and Dynamic Muscle Contractions Using Deep Learning

Gelareh Hajian, Evelyn Morin, Ali Etemad

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted to IEEE Transactions on Instrumentation and Measurement

Understanding Political Polarization via Jointly Modeling Users, Connections and Multimodal Contents on Heterogeneous Graphs

Hanjia Lyu, Jiebo Luo

专题命中 跨模态检索 ：multimodal(title,abstract)

Comments Accepted for publication in Proceedings of the 30th ACM International Conference on Multimedia, 2022

Contrastive Learning for Multi-Modal Automatic Code Review

Bingting Wu, Xiaofang Zhang

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments 6 pages

COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems

Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor

专题命中 跨模态检索 ：multimodal(title,abstract)

Task-adaptive Asymmetric Deep Cross-modal Hashing

Fengling Li, Tong Wang, Lei Zhu, Zheng Zhang, Xinhua Wang

专题命中 跨模态检索 ：cross-modal(title,abstract)

Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems

Lukas Bernreiter, Lionel Ott, Juan Nieto, Roland Siegwart, Cesar Cadena

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments Accepted for IEEE International Conference on Robotics and Automation, 2021

Journal ref 2021 IEEE International Conference on Robotics and Automation (ICRA)

X-ray Multimodal Intrinsic-Speckle-Tracking

Konstantin M. Pavlov, David M. Paganin, Heyang Li, Sebastien Berujon, Hélène Rougé-Labriet, Emmanuel Brun

专题命中 跨模态检索 ：multimodal(title)；multi-modal(abstract)

Journal ref Journal of Optics 22 125604 (2020)

Learning to Detect Multi-Modal Grasps for Dexterous Grasping in Dense Clutter

Matt Corsaro, Stefanie Tellex, George Konidaris

专题命中 跨模态检索 ：multi-modal(title,abstract)

Comments IROS 2021 Accepted Version

Graph2MDA: a multi-modal variational graph embedding model for predicting microbe-drug associations

Lei Deng, Yibiao Huang, Xuejun Liu, Hui Liu

专题命中 跨模态检索 ：multi-modal(title,abstract)