多模态大模型 - arXivDaily 专题

2307.04377 2023-07-11 cs.SD eess.AS 74%

HCLAS-X: Hierarchical and Cascaded Lyrics Alignment System Using Multimodal Cross-Correlation

Minsung Kang, Soochul Park, Keunwoo Choi

专题命中多模态训练与对齐：multimodal(title)；分类 eess.AS

2307.02978 2023-07-07 cs.CV 74%

Multi-modal multi-class Parkinson disease classification using CNN and decision level fusion

Sushanta Kumar Sahu, Ananda S. Chowdhury

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 10th International Conference on Pattern Recognition and Machine Intelligence (Acepted)

2303.13814 2023-03-27 cs.CV 74%

Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification

Ashwin Prakash, Thejaswin S, Athira Nambiar, Alexandre Bernardino

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments -

2303.11755 2023-03-22 cs.CV 74%

LIMITR: Leveraging Local Information for Medical Image-Text Representation

Gefen Dawidowicz, Elad Hirsch, Ayellet Tal

专题命中多模态训练与对齐：image-text(title)；分类 cs.CV

2303.09782 2023-03-20 cs.CV 74%

High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion

Anh Duy Nguyen, Huy Hieu Pham, Huynh Thanh Trung, Quoc Viet Hung Nguyen, Thao Nguyen Truong, Phi Le Nguyen

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments Under review by Plos ONE journal

2302.11283 2023-02-23 cs.CV 74%

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

Yu Guo, Ryan Wen Liu, Jingxiang Qu, Yuxu Lu, Fenghua Zhu, Yisheng Lv

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2302.05200 2023-02-13 cs.CV 74%

End-to-end Semantic Object Detection with Cross-Modal Alignment

Silvan Ferreira, Allan Martins, Ivanovitch Silva

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV

2212.07560 2022-12-20 cs.CV cs.NE cs.RO eess.IV 74%

Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles

Yiming Hou, Mahdi Rezaei, Richard Romano

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

2211.03109 2022-11-08 eess.IV cs.CV 74%

A Sequence Agnostic Multimodal Preprocessing for Clogged Blood Vessel Detection in Alzheimer's Diagnosis

Partho Ghosh, Md. Abrar Istiak, Mir Sayeed Mohammad, Swapnil Saha, Uday Kamal

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments 5 pages, 4 figures

2210.09739 2022-10-19 cs.CV cs.RO 74%

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation

Simon Bultmann, Jan Quenzel, Sven Behnke

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 35 pages, 18 figures, Accepted for Robotics and Autonomous Systems, Elsevier. arXiv admin note: substantial text overlap with arXiv:2108.06608

2112.13593 2022-10-13 cs.LG cs.CL q-fin.TR 74%

Multi-modal Attention Network for Stock Movements Prediction

Shwai He, Shi Gu

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CL

Comments The AAAI-22 Workshop on Knowledge Discovery from Unstructured Data in Financial Services (KDF 2022)

2210.04208 2022-10-11 cs.CV 74%

Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis

Xu Yan, Heshen Zhan, Chaoda Zheng, Jiantao Gao, Ruimao Zhang, Shuguang Cui, Zhen Li

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CV

Comments To appear in NIPS2022

2207.00186 2022-08-04 cs.CV cs.RO 74%

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Qingwen Zhang, Mingkai Tang, Ruoyu Geng, Feiyi Chen, Ren Xin, Lujia Wang

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments 7 pages, 5 figures, accepted by IROS 2022

2111.00993 2022-07-08 cs.CV 74%

Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion

Jianing Qiu, Lipeng Chen, Xiao Gu, Frank P. -W. Lo, Ya-Yen Tsai, Jiankai Sun, Jiaqi Liu, Benny Lo

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Journal ref IEEE Robotics and Automation Letters, June, 2022

2204.08653 2022-04-20 cs.SE cs.CL cs.LG 74%

On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules

Divyam Goel, Ramansh Grover, Fatemeh H. Fard

专题命中多模态训练与对齐：cross-modal(title)；分类 cs.CL

Comments 11 pages, 6 figures, ICPC 2022. 30th International Conference on Program Comprehension (ICPC '22), May 16--17, 2022, Virtual Event, USA}

2203.03568 2022-03-08 cs.CV 74%

An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions

George Eskandar, Robert A. Marsden, Pavithran Pandiyan, Mario Döbler, Karim Guirguis, Bin Yang

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2202.05500 2022-02-14 cs.CV cs.RO 74%

Multi-Modal Fusion for Sensorimotor Coordination in Steering Angle Prediction

Farzeen Munir, Shoaib Azam, Byung-Geun Lee, Moongu Jeon

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

2201.08747 2022-01-24 q-bio.NC cs.AI 74%

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

Jalal Mirakhorli

专题命中多模态训练与对齐：multimodal(title)；分类 cs.AI

Comments 13 pages, 2 figures

2110.15763 2021-11-01 cs.CL 74%

How to Leverage Multimodal EHR Data for Better Medical Predictions?

Bo Yang, Lijun Wu

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL

Comments Accepted by EMNLP 2021

2107.11757 2021-10-22 cs.CL 74%

MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class Transformation Toolbox

Lukas Stappen, Lea Schumann, Benjamin Sertolli, Alice Baird, Benjamin Weigel, Erik Cambria, Björn W. Schuller

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CL

Comments (1) https://github.com/lstappen/MuSe-Toolbox (2) docker pull musetoolbox/musetoolbox

2110.07919 2021-10-18 eess.IV cs.CV 74%

Combining CNNs With Transformer for Multimodal 3D MRI Brain Tumor Segmentation With Self-Supervised Pretraining

Mariia Dobko, Danylo-Ivan Kolinko, Ostap Viniavskyi, Yurii Yelisieiev

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2109.01066 2021-09-03 cs.CV 74%

4D-Net for Learned Multi-Modal Alignment

AJ Piergiovanni, Vincent Casser, Michael S. Ryoo, Anelia Angelova

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments ICCV 2021

2108.07139 2021-08-17 cs.LG cs.AI 74%

Efficient Feature Representations for Cricket Data Analysis using Deep Learning based Multi-Modal Fusion Model

Souridas Alaka, Rishikesh Sreekumar, Hrithwik Shalu

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.AI

2108.06608 2021-08-17 cs.CV cs.RO 74%

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles

Simon Bultmann, Jan Quenzel, Sven Behnke

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments Accepted for: 10th European Conference on Mobile Robots (ECMR), Bonn, Germany, September 2021

2107.11853 2021-07-27 cs.CV 74%

Will Multi-modal Data Improves Few-shot Learning?

Zilun Zhang, Shihao Ma, Yichun Zhang

专题命中多模态训练与对齐：multi-modal(title)；分类 cs.CV

Comments Project Report

2107.04288 2021-07-12 eess.IV cs.CV 74%

Retinal OCT Denoising with Pseudo-Multimodal Fusion Network

Dewei Hu, Joseph D. Malone, Yigit Atay, Yuankai K. Tao, Ipek Oguz

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments Accepted by International Workshop on Ophthalmic Medical Image Analysis (OMIA) 2020

2010.02358 2021-07-06 cs.CV cs.LG 74%

VisualWordGrid: Information Extraction From Scanned Documents Using A Multimodal Approach

Mohamed Kerroumi, Othmane Sayem, Aymen Shabou

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2105.13536 2021-05-31 eess.SP cs.CV cs.LG 74%

ECG Heart-beat Classification Using Multimodal Image Fusion

Zeeshan Ahmad, Anika Tabassum, Naimul Khan, Ling Guan

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

2104.07803 2021-04-19 cs.CV 74%

Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

Devis Tuia, Michele Volpi, Maxime Trolliet, Gustau Camps-Valls

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Journal ref IEEE Transactions on Geoscience and Remote Sensing, 52(12): 7708 - 7720, 2014

2011.07517 2020-11-17 cs.CV 74%

Data-efficient Alignment of Multimodal Sequences by Aligning Gradient Updates and Internal Feature Distributions

Jianan Wang, Boyang Li, Xiangyu Fan, Jing Lin, Yanwei Fu

专题命中多模态训练与对齐：multimodal(title)；分类 cs.CV

Comments This paper is accepted to WACV2021

1. 多模态训练与对齐 6897 篇

HCLAS-X: Hierarchical and Cascaded Lyrics Alignment System Using Multimodal Cross-Correlation

Multi-modal multi-class Parkinson disease classification using CNN and decision level fusion

Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification

LIMITR: Leveraging Local Information for Medical Image-Text Representation

High Accurate and Explainable Multi-Pill Detection Framework with Graph Neural Network-Assisted Multimodal Data Fusion

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

End-to-end Semantic Object Detection with Cross-Modal Alignment

Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles

A Sequence Agnostic Multimodal Preprocessing for Clogged Blood Vessel Detection in Alzheimer's Diagnosis

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles with Label Propagation for Cross-Domain Adaptation

Multi-modal Attention Network for Stock Movements Prediction

Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Egocentric Human Trajectory Forecasting with a Wearable Camera and Multi-Modal Fusion

On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules

An Unsupervised Domain Adaptive Approach for Multimodal 2D Object Detection in Adverse Weather Conditions

Multi-Modal Fusion for Sensorimotor Coordination in Steering Angle Prediction

Inferring Brain Dynamics via Multimodal Joint Graph Representation EEG-fMRI

How to Leverage Multimodal EHR Data for Better Medical Predictions?

MuSe-Toolbox: The Multimodal Sentiment Analysis Continuous Annotation Fusion and Discrete Class Transformation Toolbox

Combining CNNs With Transformer for Multimodal 3D MRI Brain Tumor Segmentation With Self-Supervised Pretraining

4D-Net for Learned Multi-Modal Alignment

Efficient Feature Representations for Cricket Data Analysis using Deep Learning based Multi-Modal Fusion Model

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles

Will Multi-modal Data Improves Few-shot Learning?

Retinal OCT Denoising with Pseudo-Multimodal Fusion Network

VisualWordGrid: Information Extraction From Scanned Documents Using A Multimodal Approach

ECG Heart-beat Classification Using Multimodal Image Fusion

Semisupervised Manifold Alignment of Multimodal Remote Sensing Images

Data-efficient Alignment of Multimodal Sequences by Aligning Gradient Updates and Internal Feature Distributions