多模态大模型

Informative Priors Improve the Reliability of Multimodal Clinical Data Classification

L. Julian Lechuga Lopez, Tim G. J. Rudner, Farah E. Shamout

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Published in ML4H 2023 Findings Track Collection

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention

Zhewei Yao, Xiaoxia Wu, Conglong Li, Minjia Zhang, Heyang Qin, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Reliability-based cleaning of noisy training labels with inductive conformal prediction in multi-modal biomedical data mining

Xianghao Zhan, Qinmei Xu, Yuanning Zheng, Guangming Lu, Olivier Gevaert

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

A Survey on Interpretable Cross-modal Reasoning

Dizhan Xue, Shengsheng Qian, Zuyi Zhou, Changsheng Xu

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.AI、cs.MM

Examining User-Friendly and Open-Sourced Large GPT Models: A Survey on Language, Multimodal, and Scientific GPT Models

Kaiyuan Gao, Sunan He, Zhenyu He, Jiacheng Lin, QiZhi Pei, Jie Shao, Wei Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Chain-of-Thought Prompt Distillation for Multimodal Named Entity Recognition and Multimodal Relation Extraction

Feng Chen, Yujian Feng

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments modification

Multimodal Deep Learning for Personalized Renal Cell Carcinoma Prognosis: Integrating CT Imaging and Clinical Data

Maryamalsadat Mahootiha, Hemin Ali Qadir, Jacob Bergsland, Ilangko Balasingham

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Multimodal Sentiment Analysis: A Survey

Songning Lai, Xifeng Hu, Haoxuan Xu, Zhaoxia Ren, Zhi Liu

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments It needs to be returned for major modifications

PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts

Yunshui Li, Binyuan Hui, ZhiChao Yin, Min Yang, Fei Huang, Yongbin Li

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments ACL 2023

A Quantum Probability Driven Framework for Joint Multi-Modal Sarcasm, Sentiment and Emotion Analysis

Yaochen Liu, Yazhou Zhang, Dawei Song

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CL、cs.AI

Improving Generalization for Multimodal Fake News Detection

Sahar Tahmasebi, Sherzod Hakimov, Ralph Ewerth, Eric Müller-Budack

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.MM

Comments This paper has been accepted for ICMR 2023

Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision

Fangqiang Ding, Andras Palffy, Dariu M. Gavrila, Chris Xiaoxuan Lu

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 7 figures. Accepted by CVPR 2023. See our code at https://github.com/Toytiny/CMFlow. Supplementary materials can be found at https://drive.google.com/file/d/1Iewcqnjzecge2ePBM8k2tg-85LX5xs3N/view

SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection

Prabhav Singh, Ridam Srivastava, K. P. S. Rana, Vineet Kumar

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Multimodal Propaganda Processing

Vincent Ng, Shengjie Li

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted in AAAI 2023

Multilingual and Multimodal Topic Modelling with Pretrained Embeddings

Elaine Zosa, Lidia Pivovarova

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Published in COLING 2022 Proceddings

Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective

Baijun Ji, Tong Zhang, Yicheng Zou, Bojie Hu, Si Shen

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 10 pages, 4 figures; EMNLP main conference

Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment Analysis

Teng Sun, Wenjie Wang, Liqiang Jing, Yiran Cui, Xuemeng Song, Liqiang Nie

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Endowing Language Models with Multimodal Knowledge Graph Representations

Ningyuan Huang, Yash R. Deshpande, Yibo Liu, Houda Alberts, Kyunghyun Cho, Clara Vania, Iacer Calixto

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 14 pages with appendix, 2 figures, 15 tables

COGMEN: COntextualized GNN based Multimodal Emotion recognitioN

Abhinav Joshi, Ashwani Bhat, Ayush Jain, Atin Vikram Singh, Ashutosh Modi

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 17 pages (9 main + 8 appendix). Accepted at NAACL 2022

A Novel Multimodal Approach for Studying the Dynamics of Curiosity in Small Group Learning

Tanmay Sinha, Zhen Bai, Justine Cassell

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments arXiv admin note: text overlap with arXiv:1704.07480

Finding Structural Knowledge in Multimodal-BERT

Victor Milewski, Miryam de Lhoneux, Marie-Francine Moens

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted at ACL 2022

XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding

Zhangxuan Gu, Changhua Meng, Ke Wang, Jun Lan, Weiqiang Wang, Ming Gu, Liqing Zhang

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted by CVPR2022

Multi-modal unsupervised brain image registration using edge maps

Vasiliki Sideri-Lampretsa, Georgios Kaissis, Daniel Rueckert

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IEEE International Symposium on Biomedical Imaging (ISBI) 2022

Multi-Modal Attribute Extraction for E-Commerce

Aloïs De la Comble, Anuvabh Dutt, Pablo Montalvo, Aghiles Salah

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.CL

Social-DualCVAE: Multimodal Trajectory Forecasting Based on Social Interactions Pattern Aware and Dual Conditional Variational Auto-Encoder

Jiashi Gao, Xinming Shi, James J. Q. Yu

专题命中 其他多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV、cs.AI

AMMASurv: Asymmetrical Multi-Modal Attention for Accurate Survival Analysis with Whole Slide Images and Gene Expression Data

Ruoqi Wang, Ziwang Huang, Haitao Wang, Hejun Wu

专题命中 其他多模态 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 4 pages. Accepted by IEEE BIBM 2021

Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Vision

Andrew Shin, Masato Ishii, Takuya Narihira

专题命中 其他多模态 ：cross-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted for publication by International Journal of Computer Vision (IJCV)

Multimodal PET/CT Tumour Segmentation and Prediction of Progression-Free Survival using a Full-Scale UNet with Attention

Emmanuelle Bourigault, Daniel R. McGowan, Abolfazl Mehranian, Bartłomiej W. Papież

专题命中 其他多模态 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 3 figures, 2 tables. To appear in Head and Neck Tumor Segmentation in PET/CT: The HECKTOR Challenge,Valentin Oreiller et al., Medical Image Analysis,2021, HECKTOR 2021, Lecture Notes in Computer Science, Springer

Multimodal Knowledge Expansion

Zihui Xue, Sucheng Ren, Zhengqi Gao, Hang Zhao

专题命中 其他多模态 ：multimodal(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by ICCV 2021. Project website: https://tsinghua-mars-lab.github.io/MKE/

Cross-Modal Generative Augmentation for Visual Question Answering

Zixu Wang, Yishu Miao, Lucia Specia

专题命中 其他多模态 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV、cs.CL

Comments BMVC 2021