多模态大模型 - arXivDaily 专题

2202.13347 2022-03-01 cs.CV 79%

A Robust Multimodal Remote Sensing Image Registration Method and System Using Steerable Filters with First- and Second-order Gradients

Yuanxin Ye, Bai Zhu, Tengfeng Tang, Chao Yang, Qizhi Xu, Guo Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2202.12537 2022-02-28 eess.IV cs.CV cs.LG 79%

An Ensemble Approach for Patient Prognosis of Head and Neck Tumor Using Multimodal Data

Numan Saeed, Roba Al Majzoub, Ikboljon Sobirov, Mohammad Yaqub

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 9 pages, 5 figures

2202.10325 2022-02-22 math.NA cs.CV cs.NA 79%

Reducing the Gibbs effect in multimodal medical imaging by the Fake Nodes Approach

Davide Poggiali, Diego Cecchin, Stefano De Marchi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2202.03775 2022-02-09 cs.CV 79%

Addressing Data Scarcity in Multimodal User State Recognition by Combining Semi-Supervised and Supervised Learning

Hendric Voß, Heiko Wersing, Stefan Kopp

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2104.04362 2022-01-14 cs.CV 79%

Multimodal Face Synthesis from Visual Attributes

Xing Di, Vishal M. Patel

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments IEEE Transactions on Biometrics, Behavior, and Identity Science (T-BIOM) submission

2112.10274 2022-01-04 cs.LG cs.AI stat.ME 79%

Estimating Causal Effects of Multi-Aspect Online Reviews with Multi-Modal Proxies

Lu Cheng, Ruocheng Guo, Huan Liu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments 10 pages, 6 figures, accepted to WSDM22

2101.10391 2021-12-28 cs.CV 79%

Anytime 3D Object Reconstruction using Multi-modal Variational Autoencoder

Hyeonwoo Yu, Jean Oh

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE Robotics and Automation Letters (accepted with ICRA2022 options)

2112.05130 2021-12-10 cs.CV 79%

Multimodal Conditional Image Synthesis with Product-of-Experts GANs

Xun Huang, Arun Mallya, Ting-Chun Wang, Ming-Yu Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2110.14202 2021-10-28 cs.LG cs.CV 79%

Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learning

Milad Abdollahzadeh, Touba Malekzadeh, Ngai-Man Cheung

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in 35th Conference on Neural Information Processing Systems (NeurIPS 2021); 27 pages

2110.10205 2021-10-22 cs.IR cs.AI 79%

MultiHead MultiModal Deep Interest Recommendation Network

Mingbao Yang, ShaoBo Li, Zhou Peng, Ansi Zhang, Yuanmeng Zhang

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.AI

2110.05186 2021-10-12 cs.RO cs.AI 79%

A MultiModal Social Robot Toward Personalized Emotion Interaction

Baijun Xie, Chung Hyuk Park

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments Presented at AI-HRI symposium as part of AAAI-FSS 2021 (arXiv:2109.10836)

2109.09020 2021-09-21 cs.LG cs.AI 79%

Multimodal Classification: Current Landscape, Taxonomy and Future Directions

William C. Sleeman, Rishabh Kapoor, Preetam Ghosh

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 24 pages, 3 tables, 7 figures

2109.05023 2021-09-21 eess.IV cs.CV cs.LG 79%

Real-time multimodal image registration with partial intraoperative point-set data

Zachary M C Baum, Yipeng Hu, Dean C Barratt

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted manuscript in Medical Image Analysis

2109.07411 2021-09-16 cs.IR cs.AI 79%

AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce

Guohai Xu, Hehong Chen, Feng-Lin Li, Fu Sun, Yunzhou Shi, Zhixiong Zeng, Wei Zhou, Zhongzhou Zhao, Ji Zhang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments CIKM2021

2109.04835 2021-09-13 cs.SI cs.CL cs.LG 79%

FR-Detect: A Multi-Modal Framework for Early Fake News Detection on Social Media Using Publishers Features

Ali Jarrahi, Leila Safari

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

2109.04652 2021-09-13 cs.CL 79%

Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

Lei Yu, Yang Xu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2109.02439 2021-09-07 cs.LG cs.CV eess.IV 79%

Developing and validating multi-modal models for mortality prediction in COVID-19 patients: a multi-center retrospective study

Joy Tzung-yu Wu, Miguel Ángel Armengol de la Hoz, Po-Chih Kuo, Joseph Alexander Paguio, Jasper Seth Yao, Edward Christopher Dee, Wesley Yeung, Jerry Jurado, Achintya Moulick, Carmelo Milazzo, Paloma Peinado, Paula Villares, Antonio Cubillo, José Felipe Varona, Hyung-Chul Lee, Alberto Estirado, José Maria Castellano, Leo Anthony Celi

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2108.10513 2021-08-25 cs.LG cs.AI 79%

Maximum Likelihood Estimation for Multimodal Learning with Missing Modality

Fei Ma, Xiangxiang Xu, Shao-Lun Huang, Lin Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

2108.09591 2021-08-24 eess.IV cs.CV 79%

Multimodal Breast Lesion Classification Using Cross-Attention Deep Networks

Hung Q. Vo, Pengyu Yuan, Tiancheng He, Stephen T. C. Wong, Hien V. Nguyen

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2108.05617 2021-08-13 cs.CV 79%

Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learning

Junkai Huang, Chaowei Fang, Weikai Chen, Zhenhua Chai, Xiaolin Wei, Pengxu Wei, Liang Lin, Guanbin Li

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICCV2021

2010.00502 2021-08-11 cs.SI cs.CL cs.IR 79%

AMUSED: An Annotation Framework of Multi-modal Social Media Data

Gautam Kishore Shahi

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

Comments 10 pages, 5 figures, 3 tables

2108.02572 2021-08-06 cs.LG cs.AI 79%

SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis

Naili Xing, Sai Ho Yeung, Chenghao Cai, Teck Khim Ng, Wei Wang, Kaiyuan Yang, Nan Yang, Meihui Zhang, Gang Chen, Beng Chin Ooi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 10 pages, 10 figures

2008.06877 2021-08-05 cs.CL cs.IR cs.LG 79%

TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection

Meysam Asgari-Chenaghlu, Mohammad-Reza Feizi-Derakhshi, Leili farzinvash, Mohammad-Ali Balafar, Cina Motamed

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2108.01495 2021-08-04 cs.RO cs.CV 79%

Cross-Modal Analysis of Human Detection for Robotics: An Industrial Case Study

Timm Linder, Narunas Vaskevicius, Robert Schirmer, Kai O. Arras

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted for publication at 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

2107.11196 2021-07-26 cs.CV 79%

Multi-Modal Pedestrian Detection with Large Misalignment Based on Modal-Wise Regression and Multi-Modal IoU

Napat Wanchaitanawong, Masayuki Tanaka, Takashi Shibata, Masatoshi Okutomi

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by MVA2021

2103.15555 2021-07-26 cs.AI cs.CY math.OC 79%

Selective Survey: Most Efficient Models and Solvers for Integrative Multimodal Transport

Oliviu Matei, Erdei Rudolf, Camelia-M. Pintea

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 12 pages; Accepted: Informatica (ISSN 0868-4952)

Journal ref Informatica, vol. 32, no. 2, pp. 371-396, 2021

2107.09892 2021-07-22 eess.IV cs.CE cs.CV cs.LG 79%

Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Data

Viswanath P. Sudarshan, Uddeshya Upadhyay, Gary F. Egan, Zhaolin Chen, Suyash P. Awate

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at Medical Image Analysis

2106.16237 2021-07-08 cs.CV 79%

Multimodal Shape Completion via IMLE

Himanshu Arora, Saurabh Mishra, Shichong Peng, Ke Li, Ali Mahdavi-Amiri

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Project Website: https://sites.google.com/site/alimahdaviamiri/projects/shape-completion

2107.00596 2021-07-02 cs.CL 79%

Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction

Sriram Pingali, Shweta Yadav, Pratik Dutta, Sriparna Saha

专题命中其他多模态：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments To appear in Findings of ACL 2021

2106.09015 2021-06-18 cs.CV cs.LG 79%

Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis

Shichong Peng, Alireza Moazeni, Ke Li

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Videos available as ancillary files

1. 其他多模态 4868 篇

A Robust Multimodal Remote Sensing Image Registration Method and System Using Steerable Filters with First- and Second-order Gradients

An Ensemble Approach for Patient Prognosis of Head and Neck Tumor Using Multimodal Data

Reducing the Gibbs effect in multimodal medical imaging by the Fake Nodes Approach

Addressing Data Scarcity in Multimodal User State Recognition by Combining Semi-Supervised and Supervised Learning

Multimodal Face Synthesis from Visual Attributes

Estimating Causal Effects of Multi-Aspect Online Reviews with Multi-Modal Proxies

Anytime 3D Object Reconstruction using Multi-modal Variational Autoencoder

Multimodal Conditional Image Synthesis with Product-of-Experts GANs

Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learning

MultiHead MultiModal Deep Interest Recommendation Network

A MultiModal Social Robot Toward Personalized Emotion Interaction

Multimodal Classification: Current Landscape, Taxonomy and Future Directions

Real-time multimodal image registration with partial intraoperative point-set data

AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce

FR-Detect: A Multi-Modal Framework for Early Fake News Detection on Social Media Using Publishers Features

Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

Developing and validating multi-modal models for mortality prediction in COVID-19 patients: a multi-center retrospective study

Maximum Likelihood Estimation for Multimodal Learning with Missing Modality

Multimodal Breast Lesion Classification Using Cross-Attention Deep Networks

Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learning

AMUSED: An Annotation Framework of Multi-modal Social Media Data

SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis

TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection

Cross-Modal Analysis of Human Detection for Robotics: An Industrial Case Study

Multi-Modal Pedestrian Detection with Large Misalignment Based on Modal-Wise Regression and Multi-Modal IoU

Selective Survey: Most Efficient Models and Solvers for Integrative Multimodal Transport

Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Data

Multimodal Shape Completion via IMLE

Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction

Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis