多模态大模型 - arXivDaily 专题

2106.06744 2021-06-15 eess.IV cs.CV 79%

DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

Yujiao Wu, Jie Ma, Xiaoshui Huang, Sai Ho Ling, Steven Weidong Su

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 7 Submitted to IEEE TBME

2101.05434 2021-06-08 eess.IV cs.CV 79%

A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation

Xiaofeng Liu, Fangxu Xing, Georges El Fakhri, Jonghye Woo

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Published in IEEE International Symposium on Biomedical Imaging (ISBI) 2021 for Oral presentation

2105.14355 2021-06-01 cs.CV eess.IV 79%

Three-dimensional multimodal medical imaging system based on free-hand ultrasound and structured light

Jhacson Meza, Sonia H. Contreras-Ortiz, Lenny A. Romero, Andres G. Marrugo

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Journal ref Optical Engineering 60(5), 054106 (2021)

2105.12306 2021-05-27 cs.CL 79%

Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking

Heng-Da Xu, Zhongli Li, Qingyu Zhou, Chao Li, Zizhen Wang, Yunbo Cao, Heyan Huang, Xian-Ling Mao

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments In ACL Findings 2021

2006.02000 2021-05-25 cs.CV cs.LG eess.IV 79%

MultiXNet: Multiclass Multistage Multimodal Motion Prediction

Nemanja Djuric, Henggang Cui, Zhaoen Su, Shangxuan Wu, Huahua Wang, Fang-Chieh Chou, Luisa San Martin, Song Feng, Rui Hu, Yang Xu, Alyssa Dayan, Sidney Zhang, Brian C. Becker, Gregory P. Meyer, Carlos Vallespi-Gonzalez, Carl K. Wellington

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted for publication at IEEE Intelligent Vehicles Symposium (IV) 2021

2008.03529 2021-05-11 cs.CV cs.LG eess.IV stat.ML 79%

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Zhiwen Zuo, Lei Zhao, Zhizhong Wang, Haibo Chen, Ailin Li, Qijiang Xu, Wei Xing, Dongming Lu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2103.05964 2021-05-10 math.NA cs.CV cs.NA 79%

Oversampling errors in multimodal medical imaging are due to the Gibbs effect

Davide Poggiali, Diego Cecchin, Cristina Campi, Stefano De Marchi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2104.11619 2021-05-05 cs.CV cs.LG 79%

Co-training for Deep Object Detection: Comparing Single-modal and Multi-modal Approaches

Jose L. Gómez, Gabriel Villalonga, Antonio M. López

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Journal ref special issue of Sensors (ISSN 1424-8220) "Feature Papers in Physical Sensors Section 2020"

2103.14793 2021-03-30 cs.CV 79%

CalibDNN: Multimodal Sensor Calibration for Perception Using Deep Neural Networks

Ganning Zhao, Jiesi Hu, Suya You, C. -C. Jay Kuo

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2103.12575 2021-03-24 cs.CV cs.CR eess.IV 79%

Multimodal Personal Ear Authentication Using Smartphones

S. Itani, S. Kita, Y. Kajikawa

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 23 figures

2103.05677 2021-03-11 cs.CV 79%

SMIL: Multimodal Learning with Severely Missing Modality

Mengmeng Ma, Jian Ren, Long Zhao, Sergey Tulyakov, Cathy Wu, Xi Peng

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments In AAAI 2021 (9 pages)

1806.10678 2021-03-11 cs.CV 79%

Multimodal Image Denoising based on Coupled Dictionary Learning

Pingfan Song, Miguel R. D. Rodrigues

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 2018 IEEE International Conference on Image Processing (ICIP). arXiv admin note: text overlap with arXiv:1806.09882

2001.04271 2021-03-09 cs.LG cs.CV eess.IV stat.ML 79%

Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection

Luigi Tommaso Luppino, Michael Kampffmeyer, Filippo Maria Bianchi, Gabriele Moser, Sebastiano Bruno Serpico, Robert Jenssen, Stian Normann Anfinsen

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2102.02971 2021-02-08 cs.CV 79%

Metaknowledge Extraction Based on Multi-Modal Documents

Shukan Liu, Ruilin Xu, Boying Geng, Qiao Sun, Li Duan, Yiming Liu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2102.02967 2021-02-08 cs.CL cs.LG 79%

RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER

Lin Sun, Jiquan Wang, Kai Zhang, Yindu Su, Fangsheng Weng

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments Accepted by AAAI2021

2101.04454 2021-01-21 cs.LG cs.AI 79%

Learning Intuitive Physics with Multimodal Generative Models

Sahand Rezaei-Shoshtari, Francois Robert Hogan, Michael Jenkin, David Meger, Gregory Dudek

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments AAAI 2021

2101.06979 2021-01-19 eess.IV cs.CV 79%

Comparing Deep Learning strategies for paired but unregistered multimodal segmentation of the liver in T1 and T2-weighted MRI

Vincent Couteaux, Mathilde Trintignac, Olivier Nempont, Guillaume Pizaine, Anna Sesilia Vlachomitrou, Pierre-Jean Valette, Laurent Milot, Isabelle Bloch

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 4 pages, 3 figures and 3 tables. Conference paper

2012.10267 2020-12-21 cs.CL 79%

ReINTEL Challenge 2020: A Multimodal Ensemble Model for Detecting Unreliable Information on Vietnamese SNS

Nguyen Manh Duc Tuan, Pham Quang Nhat Minh

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments 5 pages, ReINTEL Task at VLSP 2020 Workshop

1912.02678 2020-12-16 cs.CV 79%

Multi-Modal Deep Clustering: Unsupervised Partitioning of Images

Guy Shiran, Daphna Weinshall

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted to ICPR 2020

2007.14558 2020-11-17 cs.CV cs.RO 79%

BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimation

Yu Yao, Ella Atkins, Matthew Johnson-Roberson, Ram Vasudevan, Xiaoxiao Du

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Main paper: 8 pages, 5 figures, 5 tables Supplement: 4 pages, 2 figrues, 3 tables

2011.06102 2020-11-13 cs.AI 79%

Improving Multimodal Accuracy Through Modality Pre-training and Attention

Aya Abdelsalam Ismail, Mahmudul Hasan, Faisal Ishtiaq

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2011.05186 2020-11-11 eess.IV cs.CV cs.LG 79%

Pristine annotations-based multi-modal trained artificial intelligence solution to triage chest X-ray for COVID-19

Tao Tan, Bipul Das, Ravi Soni, Mate Fejes, Sohan Ranjan, Daniel Attila Szabo, Vikram Melapudi, K S Shriram, Utkarsh Agrawal, Laszlo Rusko, Zita Herczeg, Barbara Darazs, Pal Tegzes, Lehel Ferenczi, Rakesh Mullick, Gopal Avinash

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2011.00840 2020-11-03 cs.CV cs.LG eess.IV 79%

Predicting Brain Degeneration with a Multimodal Siamese Neural Network

Cecilia Ostertag, Marie Beurton-Aimar, Muriel Visani, Thierry Urruty, Karell Bertet

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in the 10th International Conference on Image Processing Theory, Tools and Applications (IPTA 2020)

2010.09594 2020-10-26 eess.IV cs.CV cs.LG 79%

Multi-Modal Super Resolution for Dense Microscopic Particle Size Estimation

Sarvesh Patil, Chava Y P D Phani Rajanish, Naveen Margankunte

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 11 pages, 10 figures, 6 tables, submitted to IEEE-TPAMI

2010.10802 2020-10-22 cs.CV cs.LG 79%

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

Itai Gat, Idan Schwartz, Alexander Schwing, Tamir Hazan

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments NeurIPS 2020

2010.06084 2020-10-14 cs.AI cs.RO 79%

Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence

Sean Andrist, Dan Bohus

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 5 pages, 1 figure. Submitted to the 2020 AAAI Fall Symposium: Trust and Explainability in Artificial Intelligence for Human-Robot Interaction

2009.08876 2020-09-21 cs.RO cs.CV cs.LG 79%

Multi-modal Experts Network for Autonomous Driving

Shihong Fang, Anna Choromanska

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Published at the International Conference on Robotics and Automation (ICRA), 2020

Journal ref 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 2020, pp. 6439-6445

1901.10408 2020-08-10 cs.CL cs.HC 79%

Guidelines for creating man-machine multimodal interfaces

João Ranhel, Cacilda Vilela

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments The pseudo-code in section "5.2.2 The Algorithm Kernel" needs revision. We are working on systems description using SDL, instead of showing a pseudo-code algorithm. Describing the system using "Specification and Description Language" can make reading easier and precise. Explanations of linguistic theories need to be simplified. Tables and figures will also help on understanding the article

2006.04700 2020-06-09 cs.CV 79%

Multimodal Future Localization and Emergence Prediction for Objects in Egocentric View with a Reachability Prior

Osama Makansi, Özgün Cicek, Kevin Buchicchio, Thomas Brox

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments In CVPR 2020

2005.13970 2020-05-29 math.OC cs.AI 79%

Population Control meets Doob's Martingale Theorems: the Noise-free Multimodal Case

Marie-Liesse Cauwet, Olivier Teytaud

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

1. 其他多模态 4868 篇

DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation

Three-dimensional multimodal medical imaging system based on free-hand ultrasound and structured light

Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking

MultiXNet: Multiclass Multistage Multimodal Motion Prediction

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Oversampling errors in multimodal medical imaging are due to the Gibbs effect

Co-training for Deep Object Detection: Comparing Single-modal and Multi-modal Approaches

CalibDNN: Multimodal Sensor Calibration for Perception Using Deep Neural Networks

Multimodal Personal Ear Authentication Using Smartphones

SMIL: Multimodal Learning with Severely Missing Modality

Multimodal Image Denoising based on Coupled Dictionary Learning

Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection

Metaknowledge Extraction Based on Multi-Modal Documents

RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER

Learning Intuitive Physics with Multimodal Generative Models

Comparing Deep Learning strategies for paired but unregistered multimodal segmentation of the liver in T1 and T2-weighted MRI

ReINTEL Challenge 2020: A Multimodal Ensemble Model for Detecting Unreliable Information on Vietnamese SNS

Multi-Modal Deep Clustering: Unsupervised Partitioning of Images

BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimation

Improving Multimodal Accuracy Through Modality Pre-training and Attention

Pristine annotations-based multi-modal trained artificial intelligence solution to triage chest X-ray for COVID-19

Predicting Brain Degeneration with a Multimodal Siamese Neural Network

Multi-Modal Super Resolution for Dense Microscopic Particle Size Estimation

Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies

Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence

Multi-modal Experts Network for Autonomous Driving

Guidelines for creating man-machine multimodal interfaces

Multimodal Future Localization and Emergence Prediction for Objects in Egocentric View with a Reachability Prior

Population Control meets Doob's Martingale Theorems: the Noise-free Multimodal Case