arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4874 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4874 篇

1810.11856 2018-10-30 cs.CV 79%

Scale Estimation of Monocular SfM for a Multi-modal Stereo Camera

Shinya Sumikura, Ken Sakurada, Nobuo Kawaguchi, Ryosuke Nakamura

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted to ACCV 2018, please see the additional results here: http://youtu.be/xOLtvMZJseU

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.10592 2018-09-03 cs.CL 79%

Ensemble Sequence Level Training for Multimodal MT: OSU-Baidu WMT18 Multimodal Machine Translation System Report

Renjie Zheng, Yilin Yang, Mingbo Ma, Liang Huang

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments 5 pages

Journal ref Published in WMT 2018

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.06467 2018-08-21 cs.CY cs.MM 79%

Intrinsic and Extrinsic Motivation Modeling Essential for Multi-Modal Health Recommender Systems

Nitish Nag, Mathias Lux, Ramesh C. Jain

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.MM

Comments Related to ACM Multimedia HealthMedia Workshop 2018

详情

展开后加载摘要…

URL PDF HTML 收藏
1706.03285 2018-08-17 cs.CV 79%

Recovering 6D Object Pose: A Review and Multi-modal Analysis

Caner Sahin, Tae-Kyun Kim

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.00136 2018-08-03 cs.CV 79%

Multi-modal Cycle-consistent Generalized Zero-Shot Learning

Rafael Felix, B. G. Vijay Kumar, Ian Reid, Gustavo Carneiro

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted at ECCV 2018, 15th European Conference on Computer Vision, September 8 to 14, 2018

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.08465 2018-07-24 cs.LG cs.CL stat.ML 79%

Multimodal Social Media Analysis for Gang Violence Prevention

Philipp Blandfort, Desmond Patton, William R. Frey, Svebor Karaman, Surabhi Bhargava, Fei-Tzin Lee, Siddharth Varia, Chris Kedzie, Michael B. Gaskell, Rossano Schifanella, Kathleen McKeown, Shih-Fu Chang

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.06537 2018-07-18 cs.CV 79%

PIMMS: Permutation Invariant Multi-Modal Segmentation

Thomas Varsavsky, Zach Eaton-Rosen, Carole H. Sudre, Parashkev Nachev, M. Jorge Cardoso

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments Accepted at the 4th Workshop on Deep Learning in Medical Image Analysis held at MICCAI2018

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.03952 2018-07-12 cs.NE cs.AI 79%

Shortening Time Required for Adaptive Structural Learning Method of Deep Belief Network with Multi-Modal Data Arrangement

Shin Kamada, Takumi Ichimura

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.AI

Comments 6 pages, 5 figures, Proc. of IEEE 10th International Workshop on Computational Intelligence and Applications (IWCIA2017)

详情

展开后加载摘要…

URL PDF HTML 收藏
1806.01550 2018-06-06 cs.CV 79%

TS-Net: Combining modality specific and common features for multimodal patch matching

Sovann En, Alexis Lechervy, Frédéric Jurie

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1712.03449 2018-06-01 cs.CL 79%

Modulating and attending the source image during encoding improves Multimodal Translation

Jean-Benoit Delbrouck, Stéphane Dupont

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments Accepted at NIPS Workshop

Journal ref Visually-Grounded Interaction and Language, NIPS 2017 Workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
1707.00995 2018-05-31 cs.CL 79%

An empirical study on the effectiveness of images in Multimodal Neural Machine Translation

Jean-Benoit Delbrouck, Stéphane Dupont

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments Accepted to EMNLP 2017

Journal ref Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.09493 2018-04-26 cs.CV 79%

RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform

Jiayuan Li, Qingwu Hu, Mingyao Ai

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments 14 pages,17 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1803.02392 2018-04-18 cs.CL 79%

Multimodal Emoji Prediction

Francesco Barbieri, Miguel Ballesteros, Francesco Ronzano, Horacio Saggion

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments NAACL 2018 (short)

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.04591 2018-04-13 cs.CV 79%

Improving Classification Rate of Schizophrenia Using a Multimodal Multi-Layer Perceptron Model with Structural and Functional MR

Alvaro Ulloa, Sergey Plis, Vince Calhoun

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.02286 2018-04-09 cs.CL 79%

Chart Parsing Multimodal Grammars

Richard Moot

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

详情

展开后加载摘要…

URL PDF HTML 收藏
1803.11404 2018-04-02 cs.CV 79%

Cross-modal Deep Variational Hand Pose Estimation

Adrian Spurr, Jie Song, Seonwook Park, Otmar Hilliges

专题命中 其他多模态 :cross-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1803.04687 2018-03-14 cs.CV 79%

Multimodal Recurrent Neural Networks with Information Transfer Layers for Indoor Scene Labeling

Abrar H. Abdulnabi, Bing Shuai, Zhen Zuo, Lap-Pui Chau, Gang Wang

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments 15 pages, 13 figures, IEEE TMM 2017

Journal ref IEEE Transactions on Multimedia 2017

详情

展开后加载摘要…

URL PDF HTML 收藏
1707.06907 2018-01-09 cs.CV 79%

What Looks Good with my Sofa: Multimodal Search Engine for Interior Design

Ivona Tautkute, Aleksandra Możejko, Wojciech Stokowiec, Tomasz Trzciński, Łukasz Brocki, Krzysztof Marasek

专题命中 其他多模态 :multimodal(title);multi-modal(abstract);分类 cs.CV

Comments FEDCSIS 5th Conference on Multimedia, Interaction, Design and Innovation (MIDI), 2017

Journal ref Proceedings of the 2017 Federated Conference on Computer Science and Information Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
1712.04314 2017-12-13 cs.HC cs.CL cs.CY cs.LG 79%

Generating and Estimating Nonverbal Alphabets for Situated and Multimodal Communications

Serhii Hamotskyi, Sergii Stirenko, Yuri Gordienko, Anis Rojbi

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CL

Comments 5 pages, 5 figures

Journal ref International Journal of Systems Applications Engineering and Development, 11, 232-236 (2017)

详情

展开后加载摘要…

URL PDF HTML 收藏
1709.09843 2017-09-29 cs.CV 79%

Soft Correspondences in Multimodal Scene Parsing

Sarah Taghavi Namin, Mohammad Najafi, Mathieu Salzmann, Lars Petersson

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments 16 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
1706.08124 2017-09-06 cs.CV 79%

Scalable multimodal convolutional networks for brain tumour segmentation

Lucas Fidon, Wenqi Li, Luis C. Garcia-Peraza-Herrera, Jinendra Ekanayake, Neil Kitchen, Sebastien Ourselin, Tom Vercauteren

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments Paper accepted at MICCAI 2017

详情

展开后加载摘要…

URL PDF HTML 收藏
1706.00355 2017-06-02 cs.AI 79%

Grounding Symbols in Multi-Modal Instructions

Yordan Hristov, Svetlin Penkov, Alex Lascarides, Subramanian Ramamoorthy

专题命中 其他多模态 :multi-modal(title);cross-modal(abstract);分类 cs.AI

Comments 9 pages, 8 figures, To appear in the Proceedings of the ACL workshop Language Grounding for Robotics, Vancouver, Canada

详情

展开后加载摘要…

URL PDF HTML 收藏
1703.00122 2017-06-01 cs.CV 79%

RGB-D Salient Object Detection Based on Discriminative Cross-modal Transfer Learning

Hao Chen, Y. F. Li, Dan Su

专题命中 其他多模态 :cross-modal(title,abstract);分类 cs.CV

Comments This paper has been rejected by CVPR2017, we plan to withdraw this manuscript for further revision

详情

展开后加载摘要…

URL PDF HTML 收藏
1704.07734 2017-04-26 cs.SE cs.CL cs.NE 79%

DeepAM: Migrate APIs with Multi-modal Sequence to Sequence Learning

Xiaodong Gu, Hongyu Zhang, Dongmei Zhang, Sunghun Kim

专题命中 其他多模态 :multi-modal(title);multimodal(abstract);分类 cs.CL

Comments Accepted at IJCAI 2017 (The 26th International Joint Conference on Artificial Intelligence)

详情

展开后加载摘要…

URL PDF HTML 收藏
1702.01287 2017-02-07 cs.CL 79%

Doubly-Attentive Decoder for Multi-modal Neural Machine Translation

Iacer Calixto, Qun Liu, Nick Campbell

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CL

Comments 8 pages (11 including references), 2 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1607.04147 2016-11-15 cs.CV 79%

Multi-modal dictionary learning for image separation with application in art investigation

Nikos Deligiannis, Joao F. C. Mota, Bruno Cornelis, Miguel R. D. Rodrigues, Ingrid Daubechies

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments submitted to IEEE Transactions on Images Processing

详情

展开后加载摘要…

URL PDF HTML 收藏
1610.03640 2016-10-17 cs.CV 79%

Analyzing the Affect of a Group of People Using Multi-modal Framework

Xiaohua Huang, Abhinav Dhall, Xin Liu, Guoying Zhao, Jingang Shi, Roland Goecke, Matti Pietikainen

专题命中 其他多模态 :multi-modal(title,abstract);分类 cs.CV

Comments 11 pages. Submitted to the IEEE Transactions on Cybernetics

详情

展开后加载摘要…

URL PDF HTML 收藏
1603.06327 2016-03-22 cs.CV 79%

Deep Self-Convolutional Activations Descriptor for Dense Cross-Modal Correspondence

Seungryong Kim, Dongbo Min, Stephen Lin, Kwanghoon Sohn

专题命中 其他多模态 :cross-modal(title,abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
1602.02343 2016-02-23 cs.CV 79%

Eye-CU: Sleep Pose Classification for Healthcare using Multimodal Multiview Data

Carlos Torres, Victor Fragoso, Scott D. Hammond, Jeffrey C. Fried, B. S. Manjunath

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.CV

Comments Ten-page manuscript including references and ten figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1508.00457 2015-08-04 cs.NE cs.AI q-bio.QM 79%

Evolutionary Multimodal Optimization: A Short Survey

Ka-Chun Wong

专题命中 其他多模态 :multimodal(title,abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏