多模态大模型

Evaluation of Multimodal Semantic Segmentation using RGB-D Data

Jiesi Hu, Ganning Zhao, Suya You, C. C. Jay Kuo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 12 pages, 5 figures

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

Chiho Choi, Joon Hee Choi, Jiachen Li, Srikanth Malla

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments CVPR 2021 [Oral]

Exploiting Multi-Modal Features From Pre-trained Networks for Alzheimer's Dementia Recognition

Junghyun Koo, Jie Hwan Lee, Jaewoo Pyo, Yujin Jo, Kyogu Lee

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、eess.AS

Comments In the Proceedings of INTERSPEECH 2020

Multimodal-Aware Weakly Supervised Metric Learning with Self-weighting Triplet Loss

Huiyuan Deng, Xiangzhu Meng, Lin Feng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI、cs.MM

Multi-Modal Aesthetic Assessment for MObile Gaming Image

Zhenyu Lei, Yejing Xie, Suiyi Ling, Andreas Pastor, Junle Wang, Patrick Le Callet

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 5 pages

On-Device Document Classification using multimodal features

Sugam Garg, Harichandana, Sumit Kumar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 8th ACM IKDD CODS and 26th COMAD 2-4 January 2021

MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classification

Te-Lin Wu, Shikhar Singh, Sayan Paul, Gully Burns, Nanyun Peng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments In The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21), 2021

Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment

Md Sirajus Salekin, Ghada Zamzmi, Dmitry Goldgof, Rangachar Kasturi, Thao Ho, Yu Sun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in Computers in Biology and Medicine, 2020

Language-guided Navigation via Cross-Modal Grounding and Alternate Adversarial Learning

Weixia Zhang, Chao Ma, Qi Wu, Xiaokang Yang

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IEEE TCSVT

Supervised Multimodal Bitransformers for Classifying Images and Text

Douwe Kiela, Suvrat Bhooshan, Hamed Firooz, Ethan Perez, Davide Testuggine

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Rejected from EMNLP, twice

Multi-modal, multi-task, multi-attention (M3) deep learning detection of reticular pseudodrusen: towards automated and accessible classification of age-related macular degeneration

Qingyu Chen, Tiarnan D. L. Keenan, Alexis Allot, Yifan Peng, Elvira Agrón, Amitha Domalpally, Caroline C. W. Klaver, Daniel T. Luttikhuizen, Marcus H. Colyer, Catherine A. Cukras, Henry E. Wiley, M. Teresa Magone, Chantal Cousineau-Krieger, Wai T. Wong, Yingying Zhu, Emily Y. Chew, Zhiyong Lu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 5 figures and 4 tables, To appear in Journal of the American Medical Informatics Association

Situated and Interactive Multimodal Conversations

Seungwhan Moon, Satwik Kottur, Paul A. Crook, Ankita De, Shivani Poddar, Theodore Levin, David Whitney, Daniel Difranco, Ahmad Beirami, Eunjoon Cho, Rajen Subba, Alborz Geramifard

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 5 figures, 11 tables, accepted to COLING 2020

Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering

Jing Yu, Zihao Zhu, Yujing Wang, Weifeng Zhang, Yue Hu, Jianlong Tan

专题命中 多模态评测 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted at Pattern Recognition. arXiv admin note: substantial text overlap with arXiv:2006.09073

MM-Hand: 3D-Aware Multi-Modal Guided Hand Generative Network for 3D Hand Pose Synthesis

Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by ACM Multimedia 2020

Hierarchical Deep Multi-modal Network for Medical Visual Question Answering

Deepak Gupta, Swati Suman, Asif Ekbal

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted for publication at Expert Systems with Applications

RGB2LIDAR: Towards Solving Large-Scale Cross-Modal Visual Localization

Niluthpol Chowdhury Mithun, Karan Sikka, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.MM

Comments ACM Multimedia 2020

Dynamic Context-guided Capsule Network for Multimodal Machine Translation

Huan Lin, Fandong Meng, Jinsong Su, Yongjing Yin, Zhengyuan Yang, Yubin Ge, Jie Zhou, Jiebo Luo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.MM

Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback

Anumeha Agrawal, Rosa Anil George, Selvan Sunitha Ravi, Sowmya Kamath S, Anand Kumar M

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 9 pages, ACL 2020

Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

M. Hamed Mozaffari, Won-Sook Lee

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、eess.AS

Comments 12 figures, 1 table

Journal ref Canadian Acoustics. 48, 1 (Mar. 2020)

SIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platform

Paul A. Crook, Shivani Poddar, Ankita De, Semir Shafi, David Whitney, Alborz Geramifard, Rajen Subba

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、cs.AI

Comments ASRU 2019 (demonstration)

Visual Agreement Regularized Training for Multi-Modal Machine Translation

Pengcheng Yang, Boxing Chen, Pei Zhang, Xu Sun

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted by AAAI 2020

Multi-Modal Emotion recognition on IEMOCAP Dataset using Deep Learning

Samarth Tripathi, Sarthak Tripathi, Homayoon Beigi

专题命中 多模态评测 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Privacy Enhanced Multimodal Neural Representations for Emotion Recognition

Mimansa Jaiswal, Emily Mower Provost

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、eess.AS

Comments 8 pages

Multimodal Word Distributions

Ben Athiwaratkun, Andrew Gordon Wilson

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments This paper also appears at ACL 2017

MEx: Multi-modal Exercises Dataset for Human Activity Recognition

Anjana Wijekoon, Nirmalie Wiratunga, Kay Cooper

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Data

Andrew L. Beam, Benjamin Kompa, Allen Schmaltz, Inbar Fried, Griffin Weber, Nathan P. Palmer, Xu Shi, Tianxi Cai, Isaac S. Kohane

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Multimodal and Multi-view Models for Emotion Recognition

Gustavo Aguilar, Viktor Rozgić, Weiran Wang, Chao Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、eess.AS

Comments ACL 2019

Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)

Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas, Roger Zimmermann, Rada Mihalcea, Soujanya Poria

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted at ACL 2019

Unsupervised Multi-modal Neural Machine Translation

Yuanhang Su, Kai Fan, Nguyen Bach, C. -C. Jay Kuo, Fei Huang

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted to CVPR 2019

Cross-Modal Self-Attention Network for Referring Image Segmentation

Linwei Ye, Mrigank Rochan, Zhi Liu, Yang Wang

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted to CVPR2019