多模态大模型 - arXivDaily 专题

2005.10622 2020-05-25 cs.LG cs.AI cs.RO stat.ML 79%

Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets

Cong Fei, Bin Wang, Yuzheng Zhuang, Zongzhang Zhang, Jianye Hao, Hongbo Zhang, Xuewu Ji, Wulong Liu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments 7 papges, 3 figures

1810.10974 2020-04-21 cs.CV cs.LG q-bio.NC 79%

Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features

Simone Palazzo, Concetto Spampinato, Isaak Kavasidis, Daniela Giordano, Joseph Schmidt, Mubarak Shah

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2004.03590 2020-04-09 cs.CV cs.GR cs.LG cs.NE eess.IV 79%

Multimodal Image Synthesis with Conditional Implicit Maximum Likelihood Estimation

Ke Li, Shichong Peng, Tianhao Zhang, Jitendra Malik

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments To appear in International Journal of Computer Vision (IJCV). arXiv admin note: text overlap with arXiv:1811.12373

2003.12697 2020-04-03 cs.CV 79%

Semantically Multi-modal Image Synthesis

Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments To appear in CVPR 2020

2003.09691 2020-03-31 cs.CV cs.LG eess.IV 79%

Cross-modal Deep Face Normals with Deactivable Skip Connections

Victoria Fernandez Abrevaya, Adnane Boukhayma, Philip H. S. Torr, Edmond Boyer

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments CVPR 2020

2003.05787 2020-03-13 cs.CV 79%

Cross-modal Multi-task Learning for Graphic Recognition of Caricature Face

Zuheng Ming, Jean-Christophe Burie, Muhammad Muzzamil Luqman

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:1911.03341

2002.07236 2020-02-19 cs.LG cs.AI stat.ML 79%

GACEM: Generalized Autoregressive Cross Entropy Method for Multi-Modal Black Box Constraint Satisfaction

Kourosh Hakhamaneshi, Keertana Settaluri, Pieter Abbeel, Vladimir Stojanovic

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

1908.07344 2020-02-06 eess.IV cs.CV cs.LG 79%

Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentation

Chen Chen, Cheng Ouyang, Giacomo Tarroni, Jo Schlemper, Huaqi Qiu, Wenjia Bai, Daniel Rueckert

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments STACOM 2019 camera-ready. Winner of Multi-sequence Cardiac MR Segmentation Challenge (MS-CMRSeg 2019) https://zmiclab.github.io/mscmrseg19/

2001.10179 2020-01-29 cs.CL 79%

Multi-modal Sentiment Analysis using Super Characters Method on Low-power CNN Accelerator Device

Baohua Sun, Lin Yang, Hao Sha, Michael Lin

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

Comments 9 pages, 2 figures, 6 tables. Accepted by AAAI 2020 Affective Content Analysis Workshop

2001.03111 2020-01-10 cs.CV eess.IV 79%

Unpaired Multi-modal Segmentation via Knowledge Distillation

Qi Dou, Quande Liu, Pheng Ann Heng, Ben Glocker

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE TMI, code available

1904.04443 2020-01-08 cs.CV 79%

Multimodal Style Transfer via Graph Cuts

Yulun Zhang, Chen Fang, Yilin Wang, Zhaowen Wang, Zhe Lin, Yun Fu, Jimei Yang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICCV 2019. Typos in Eqs. (11) and (12) have been fixed in arXiv V2 and this version (V6). Code: https://github.com/yulunzhang/MST

1912.12799 2020-01-01 cs.CV 79%

PMC-GANs: Generating Multi-Scale High-Quality Pedestrian with Multimodal Cascaded GANs

Jie Wu, Ying Peng, Chenghao Zheng, Zongbo Hao, Jian Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by The British Machine Vision Conference (BMVC2019)

1910.13616 2019-10-31 cs.LG cs.AI stat.ML 79%

Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

1910.08320 2019-10-21 cs.CV cs.LG eess.IV 79%

Multimodal Image Super-resolution via Deep Unfolding with Side Information

Iman Marivani, Evaggelia Tsiligianni, Bruno Cornelis, Nikos Deligiannis

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 5 pages, 5 figures, 3 tables, EUSIPCO 2019

1910.02766 2019-10-08 cs.CL 79%

Adversarial reconstruction for Multi-modal Machine Translation

Jean-Benoit Delbrouck, Stéphane Dupont

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

1909.07201 2019-09-17 cs.RO cs.CV 79%

MuPNet: Multi-modal Predictive Coding Network for Place Recognition by Unsupervised Learning of Joint Visuo-Tactile Latent Representations

Oliver Struckmeier, Kshitij Tiwari, Shirin Dora, Martin J. Pearson, Sander M. Bohte, Cyriel MA Pennartz, Ville Kyrki

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Submitted to ICRA 2020. 6+1 Pages with 5 figures

1908.03919 2019-09-17 cs.CV cs.LG 79%

GAN-Tree: An Incrementally Learned Hierarchical Generative Framework for Multi-Modal Data Distributions

Jogendra Nath Kundu, Maharshi Gor, Dakshit Agrawal, R. Venkatesh Babu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments ICCV 2019 (code available at https://github.com/val-iisc/GANTree)

1902.04049 2019-09-17 cs.CV 79%

MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation

Nabil Ibtehaz, M. Sohel Rahman

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

1908.04107 2019-08-20 cs.CV 79%

Multimodal Unified Attention Networks for Vision-and-Language Interactions

Zhou Yu, Yuhao Cui, Jun Yu, Dacheng Tao, Qi Tian

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 11 pages, 7 figures

1908.01351 2019-08-06 cs.IR cs.CV 79%

Improving IT Support by Enhancing Incident Management Process with Multi-modal Analysis

Atri Mandal, Shivali Agarwal, Nikhil Malhotra, Giriprasad Sridhara, Anupama Ray, Daivik Swarup

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

1907.03395 2019-07-18 cs.CV cs.LG 79%

Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks

Vineet Kosaraju, Amir Sadeghian, Roberto Martín-Martín, Ian Reid, S. Hamid Rezatofighi, Silvio Savarese

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

1905.10464 2019-06-25 cs.CL 79%

Debiasing Word Embeddings Improves Multimodal Machine Translation

Tosho Hirasawa, Mamoru Komachi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments 11 pages; MT Summit 2019 (camera ready)

1906.03952 2019-06-11 cs.CL 79%

Multimodal Logical Inference System for Visual-Textual Entailment

Riko Suzuki, Hitomi Yanaka, Masashi Yoshikawa, Koji Mineshima, Daisuke Bekki

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

1904.06236 2019-05-07 cs.CV 79%

Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data

Aleksei Tiulpin, Stefan Klein, Sita M. A. Bierma-Zeinstra, Jérôme Thevenot, Esa Rahtu, Joyce van Meurs, Edwin H. G. Oei, Simo Saarakkala

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.CV

1904.04088 2019-04-09 stat.ML cs.CV cs.LG 79%

Large Margin Multi-modal Multi-task Feature Extraction for Image Classification

Yong Luo, Yonggang Wen, Dacheng Tao, Jie Gui, Chao Xu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Journal ref IEEE Transactions on Image Processing (Volume: 25, Issue: 1, Jan. 2016)

1901.04623 2019-02-07 cs.CV 79%

Multi-modal Ensemble Classification for Generalized Zero Shot Learning

Rafael Felix, Michele Sasdelli, Ian Reid, Gustavo Carneiro

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 10 pages, 3 Figures, 4 Tables

1812.07172 2018-12-19 cs.LG cs.AI stat.ML 79%

Toward Multimodal Model-Agnostic Meta-Learning

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

1811.04045 2018-11-12 cs.CV 79%

Splenomegaly Segmentation on Multi-modal MRI using Deep Convolutional Networks

Yuankai Huo, Zhoubing Xu, Shunxing Bao, Camilo Bermudez, Hyeonsoo Moon, Prasanna Parvathaneni, Tamara K. Moyo, Michael R. Savona, Albert Assad, Richard G. Abramson, Bennett A. Landman

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Medical Imaging

1805.05499 2018-10-31 cs.CV 79%

Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs

Nachiket Deo, Mohan M. Trivedi

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments accepted for publication at IV 2018

1810.12241 2018-10-30 cs.CV 79%

Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning

Arnab Kumar Mondal, Jose Dolz, Christian Desrosiers

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments submitted to Medical Image Analysis for review

1. 其他多模态 4874 篇

Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets

Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features

Multimodal Image Synthesis with Conditional Implicit Maximum Likelihood Estimation

Semantically Multi-modal Image Synthesis

Cross-modal Deep Face Normals with Deactivable Skip Connections

Cross-modal Multi-task Learning for Graphic Recognition of Caricature Face

GACEM: Generalized Autoregressive Cross Entropy Method for Multi-Modal Black Box Constraint Satisfaction

Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentation

Multi-modal Sentiment Analysis using Super Characters Method on Low-power CNN Accelerator Device

Unpaired Multi-modal Segmentation via Knowledge Distillation

Multimodal Style Transfer via Graph Cuts

PMC-GANs: Generating Multi-Scale High-Quality Pedestrian with Multimodal Cascaded GANs

Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation

Multimodal Image Super-resolution via Deep Unfolding with Side Information

Adversarial reconstruction for Multi-modal Machine Translation

MuPNet: Multi-modal Predictive Coding Network for Place Recognition by Unsupervised Learning of Joint Visuo-Tactile Latent Representations

GAN-Tree: An Incrementally Learned Hierarchical Generative Framework for Multi-Modal Data Distributions

MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation

Multimodal Unified Attention Networks for Vision-and-Language Interactions

Improving IT Support by Enhancing Incident Management Process with Multi-modal Analysis

Social-BiGAT: Multimodal Trajectory Forecasting using Bicycle-GAN and Graph Attention Networks

Debiasing Word Embeddings Improves Multimodal Machine Translation

Multimodal Logical Inference System for Visual-Textual Entailment

Multimodal Machine Learning-based Knee Osteoarthritis Progression Prediction from Plain Radiographs and Clinical Data

Large Margin Multi-modal Multi-task Feature Extraction for Image Classification

Multi-modal Ensemble Classification for Generalized Zero Shot Learning

Toward Multimodal Model-Agnostic Meta-Learning

Splenomegaly Segmentation on Multi-modal MRI using Deep Convolutional Networks

Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs

Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning