多模态大模型

Desk Organization: Effect of Multimodal Inputs on Spatial Relational Learning

Ryan Rowe, Shivam Singhal, Daqing Yi, Tapomayukh Bhattacharjee, Siddhartha S. Srinivasa

专题命中 其他多模态 ：multimodal(title)；分类 cs.AI

Comments 8 pages, 7 figures

Journal ref 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) (pp. 1-8). IEEE

Don't Sweep your Learning Rate under the Rug: A Closer Look at Cross-modal Transfer of Pretrained Transformers

Danielle Rothermel, Margaret Li, Tim Rocktäschel, Jakob Foerster

专题命中 其他多模态 ：cross-modal(title)；分类 cs.AI

Comments Accepted to ICML 2021 Workshop: Self-Supervised Learning for Reasoning and Perception

Modeling Interactions of Multimodal Road Users in Shared Spaces

Fatema T. Johora, Jörg P. Müller

专题命中 其他多模态 ：multimodal(title)；分类 cs.AI

Journal ref IEEE, 2018, https://ieeexplore.ieee.org/document/8569687

Multimodal trajectory forecasting based on discrete heat map

Jingni Yuan, Jianyun Xu, Yushi Zhu

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

CFPNet-M: A Light-Weight Encoder-Decoder Based Network for Multimodal Biomedical Image Real-Time Segmentation

Ange Lou, Shuyue Guan, Murray Loew

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Hierarchical Bayesian Model for the Transfer of Knowledge on Spatial Concepts based on Multimodal Information

Yoshinobu Hagiwara, Keishiro Taguchi, Satoshi Ishibushi, Akira Taniguchi, Tadahiro Taniguchi

专题命中 其他多模态 ：multimodal(title)；分类 cs.AI

Comments 17 pages, 12 figures, 6 tables

Learning Multi-Modal Volumetric Prostate Registration with Weak Inter-Subject Spatial Correspondence

Oleksii Bashkanov, Anneke Meyer, Daniel Schindele, Martin Schostak, Klaus Tönnies, Christian Hansen, Marko Rak

专题命中 其他多模态 ：multi-modal(title)；分类 cs.CV

Spatially Aware Multimodal Transformers for TextVQA

Yash Kant, Dhruv Batra, Peter Anderson, Alex Schwing, Devi Parikh, Jiasen Lu, Harsh Agrawal

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted at European Conference on Computer Vision, 2020

Where, What, Whether: Multi-modal Learning Meets Pedestrian Detection

Yan Luo, Chongyang Zhang, Muming Zhao, Hao Zhou, Jun Sun

专题命中 其他多模态 ：multi-modal(title)；分类 cs.CV

Comments This work is being revised. The updated version will be upload few months later

Multi-modal AsynDGAN: Learn From Distributed Medical Image Data without Sharing Private Information

Qi Chang, Zhennan Yan, Lohendran Baskaran, Hui Qu, Yikai Zhang, Tong Zhang, Shaoting Zhang, Dimitris N. Metaxas

专题命中 其他多模态 ：multi-modal(title)；分类 cs.AI

Comments arXiv admin note: text overlap with arXiv:2006.00080

Cross-modal registration using point clouds and graph-matching in the context of correlative microscopies

Stephan Kunne, Guillaume Potier, Jean Mérot, Perrine Paul-Gilloteaux

专题命中 其他多模态 ：cross-modal(title)；分类 cs.CV

Comments in Proceedings of iTWIST'20, Paper-ID: 22, Nantes, France, December, 2-4, 2020

Multi-Modal Subjective Context Modelling and Recognition

Qiang Shen, Stefano Teso, Wanyi Zhang, Hao Xu, Fausto Giunchiglia

专题命中 其他多模态 ：multi-modal(title)；分类 cs.AI

Glioma Classification Using Multimodal Radiology and Histology Data

Azam Hamidinekoo, Tomasz Pieciak, Maryam Afzali, Otar Akanyeti, Yinyin Yuan

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Discriminative Cross-Modal Data Augmentation for Medical Imaging Applications

Yue Yang, Pengtao Xie

专题命中 其他多模态 ：cross-modal(title)；分类 cs.CV

Multimodal brain tumor classification

Marvin Lerousseau, Eric Deutsh, Nikos Paragios

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Fully Automatic Intervertebral Disc Segmentation Using Multimodal 3D U-Net

Chuanbo Wang, Ye Guo, Wei Chen, Zeyun Yu

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Adaptive Transformers for Learning Multimodal Representations

Prajjwal Bhargava

专题命中 其他多模态 ：multimodal(title)；分类 cs.CL

Comments Accepted at ACL SRW 2020. Code can be found here https://github.com/prajjwal1/adaptive_transformer

A Multi-modal Neural Embeddings Approach for Detecting Mobile Counterfeit Apps: A Case Study on Google Play Store

Naveen Karunanayake, Jathushan Rajasegaran, Ashanie Gunathillake, Suranga Seneviratne, Guillaume Jourjon

专题命中 其他多模态 ：multi-modal(title)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:1804.09882

Unsupervised Multi-Domain Multimodal Image-to-Image Translation with Explicit Domain-Constrained Disentanglement

Weihao Xia, Yujiu Yang, Jing-Hao Xue

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments 20 pages

Automatic Group Cohesiveness Detection With Multi-modal Features

Bin Zhu, Xin Guo, Kenneth Barner, Charles Boncelet

专题命中 其他多模态 ：multi-modal(title)；分类 cs.CV

Leveraging Multimodal Haptic Sensory Data for Robust Cutting

Kevin Zhang, Mohit Sharma, Manuela Veloso, Oliver Kroemer

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted as conference paper at Humanoids'19

Learning Multimodal Fixed-Point Weights using Gradient Descent

Lukas Enderich, Fabian Timm, Lars Rosenbaum, Wolfram Burgard

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments presented at ESANN 2019 (European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning)

Journal ref https://www.elen.ucl.ac.be/esann/proceedings/papers.php?ann=2019

Graph Convolution for Multimodal Information Extraction from Visually Rich Documents

Xiaojing Liu, Feiyu Gao, Qiong Zhang, Huasha Zhao

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments naacl'19 accepted paper

Learning Multimodal Graph-to-Graph Translation for Molecular Optimization

Wengong Jin, Kevin Yang, Regina Barzilay, Tommi Jaakkola

专题命中 其他多模态 ：multimodal(title)；分类 cs.AI

Multimodal deep learning for short-term stock volatility prediction

Marcelo Sardelich, Suresh Manandhar

专题命中 其他多模态 ：multimodal(title)；分类 cs.CL

3D multirater RCNN for multimodal multiclass detection and characterisation of extremely small objects

Carole H. Sudre, Beatriz Gomez Anson, Silvia Ingala, Chris D. Lane, Daniel Jimenez, Lukas Haider, Thomas Varsavsky, Lorna Smith, H. Rolf Jäger, M. Jorge Cardoso

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Toward Multimodal Image-to-Image Translation

Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A. Efros, Oliver Wang, Eli Shechtman

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments NIPS 2017 Final paper. v4 updated acknowledgment. Website: https://junyanz.github.io/BicycleGAN/

The AAU Multimodal Annotation Toolboxes: Annotating Objects in Images and Videos

Chris H. Bahnsen, Andreas Møgelmose, Thomas B. Moeslund

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments 6 pages, 10 figures

Dynamic Multimodal Instance Segmentation guided by natural language queries

Edgar Margffoy-Tuay, Juan C. Pérez, Emilio Botero, Pablo Arbeláez

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Label-driven weakly-supervised learning for multimodal deformable image registration

Yipeng Hu, Marc Modat, Eli Gibson, Nooshin Ghavami, Ester Bonmati, Caroline M. Moore, Mark Emberton, J. Alison Noble, Dean C. Barratt, Tom Vercauteren

专题命中 其他多模态 ：multimodal(title)；分类 cs.CV

Comments Accepted to ISBI 2018