多模态大模型 - arXivDaily 专题

2405.12681 2024-05-22 cs.CV 79%

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Francisco Neves, Luís Branco, Maria Pereira, Rafael Claro, Andry Pinto

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2404.17324 2024-04-29 cs.CV 79%

Dense Road Surface Grip Map Prediction from Multimodal Image Data

Jyri Maanpää, Julius Pesonen, Heikki Hyyti, Iaroslav Melekhov, Juho Kannala, Petri Manninen, Antero Kukko, Juha Hyyppä

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 17 pages, 7 figures (supplementary material 1 page, 1 figure). Submitted to 27th International Conference of Pattern Recognition (ICPR 2024)

2403.20168 2024-04-25 eess.IV cs.CV 79%

Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation

Chuan Huang, Jia Wei, Rui Li

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 5 figures. It has been provisionally accepted for IJCNN 2024

2404.12006 2024-04-19 cs.CL 79%

Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction

Qian Li, Cheng Ji, Shu Guo, Yong Zhao, Qianren Mao, Shangguang Wang, Yuntao Wei, Jianxin Li

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CL

2309.10900 2024-04-18 cs.RO cs.CV 79%

Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models

Kshitij Goel, Wennie Tabib

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures, published in IEEE Robotics and Automation Letters

2404.08347 2024-04-15 cs.CV cs.LG 79%

Learning to Rebalance Multi-Modal Optimization by Adaptively Masking Subnetworks

Yang Yang, Hongpeng Pan, Qing-Yuan Jiang, Yi Xu, Jinghui Tang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments 17 pages;6 figures

2404.04514 2024-04-09 cs.CL 79%

Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models

Songtao Jiang, Yan Zhang, Chenyi Zhou, Yeying Jin, Yang Feng, Jian Wu, Zuozhu Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2304.01705 2024-04-01 eess.IV cs.CV 79%

Cross-modal tumor segmentation using generative blending augmentation and self training

Guillaume Sallé, Pierre-Henri Conze, Julien Bert, Nicolas Boussion, Dimitris Visvikis, Vincent Jaouen

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

2403.15712 2024-03-26 cs.CV cs.RO 79%

PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search

Chensheng Peng, Zhaoyu Zeng, Jinling Gao, Jundong Zhou, Masayoshi Tomizuka, Xinbing Wang, Chenghu Zhou, Nanyang Ye

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

Comments IEEE Robotics and Automation Letters 2024. Code is available at https://github.com/PholyPeng/PNAS-MOT

Journal ref IEEE Robotics and Automation Letters, 2024

2403.13600 2024-03-21 cs.CV 79%

VL-Mamba: Exploring State Space Models for Multimodal Learning

Yanyuan Qiao, Zheng Yu, Longteng Guo, Sihan Chen, Zijia Zhao, Mingzhen Sun, Qi Wu, Jing Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2402.00038 2024-03-18 eess.IV cs.CV cs.LG q-bio.QM 79%

Detecting Brain Tumors through Multimodal Neural Networks

Antonio Curci, Andrea Esposito

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Presented at NeroPRAI 2024 (co-located with ICPRAM 2024). This version did not undergo peer review: refer to the open access version of record (see DOI)

Journal ref Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2024) - NeroPRAI 2024

2306.15612 2024-03-18 cs.CV 79%

Adaptive Multi-Modal Cross-Entropy Loss for Stereo Matching

Peng Xu, Zhiyu Xiang, Chenyu Qiao, Jingyun Fu, Tianyu Pu

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.CV

2403.03721 2024-03-08 cs.CV 79%

CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection

Gyusam Chang, Wonseok Roh, Sujin Jang, Dongwook Lee, Daehyun Ji, Gyeongrok Oh, Jinsun Park, Jinkyu Kim, Sangpil Kim

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by AAAI 2024

2403.03075 2024-03-06 cs.CL 79%

Detecting Concrete Visual Tokens for Multimodal Machine Translation

Braeden Bowen, Vipin Vijayan, Scott Grigsby, Timothy Anderson, Jeremy Gwinnup

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

2403.01546 2024-03-05 cs.CV cs.LG 79%

Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques

Shivam Pande

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 253 pages

2403.01487 2024-03-05 cs.CV 79%

InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding

Haogeng Liu, Quanzeng You, Xiaotian Han, Yiqi Wang, Bohan Zhai, Yongfei Liu, Yunzhe Tao, Huaibo Huang, Ran He, Hongxia Yang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2402.18507 2024-02-29 cs.CV 79%

Multimodal Learning To Improve Cardiac Late Mechanical Activation Detection From Cine MR Images

Jiarui Xing, Nian Wu, Kenneth Bilchick, Frederick Epstein, Miaomiao Zhang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

2310.09650 2024-02-28 cs.LG cs.AI 79%

Multimodal Federated Learning in Healthcare: a Review

Jacob Thrasher, Alina Devkota, Prasiddha Siwakotai, Rohit Chivukula, Pranav Poudel, Chaunbo Hu, Binod Bhattarai, Prashnna Gyawali

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 28 pages, 5 figures

2402.14289 2024-02-23 cs.LG cs.CL 79%

TinyLLaVA: A Framework of Small-scale Large Multimodal Models

Baichuan Zhou, Ying Hu, Xi Weng, Junlong Jia, Jie Luo, Xien Liu, Ji Wu, Lei Huang

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CL

Comments Our model weights and codes will be made public at https://github.com/DLCV-BUAA/TinyLLaVABench

2203.11160 2024-02-22 cs.CV 79%

Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation

Antonin Vobecky, David Hurych, Oriane Siméoni, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CV

Comments v2: improved quality of images. See the project webpage https://vobecant.github.io/DriveAndSegment/ for the code and more

2402.05322 2024-02-09 cs.LG cs.AI cs.GR cs.SI 79%

Learning on Multimodal Graphs: A Survey

Ciyuan Peng, Jiayuan He, Feng Xia

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 9 pages, 1 figure

2302.03497 2024-02-09 cs.IR cs.MM 79%

MMRec: Simplifying Multimodal Recommendation

Xin Zhou

专题命中其他多模态：multimodal(title,abstract)；分类 cs.MM

Comments Published at MMAsia'23 Workshops

2202.03189 2024-01-17 cs.CV cs.HC cs.LG physics.app-ph physics.optics 79%

Optical skin: Sensor-integration-free multimodal flexible sensing

Sho Shimadera, Kei Kitagawa, Koyo Sagehashi, Tomoaki Niiyama, Satoshi Sunada

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 13 pages, 11 figures

Journal ref Sci Rep 12, 13096 (2022)

2401.03806 2024-01-09 cs.CV 79%

FM-AE: Frequency-masked Multimodal Autoencoder for Zinc Electrolysis Plate Contact Abnormality Detection

Canzong Zhou, Can Zhou, Hongqiu Zhu, Tianhao Liu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments 2023 The 34th Chinese Process Control Conference (CPCC 2023)

2312.13156 2024-01-01 cs.CE cs.AI 79%

AccidentGPT: Accident Analysis and Prevention from V2X Environmental Perception with Multi-modal Large Model

Lening Wang, Yilong Ren, Han Jiang, Pinlong Cai, Daocheng Fu, Tianqi Wang, Zhiyong Cui, Haiyang Yu, Xuesong Wang, Hanchu Zhou, Helai Huang, Yinhai Wang

专题命中其他多模态：multi-modal(title,abstract)；分类 cs.AI

Comments 21 pages, 19 figures

2312.15890 2023-12-29 cs.CV 79%

Towards Robust Multimodal Prompting With Missing Modalities

Jaehyuk Jang, Yooseung Wang, Changick Kim

专题命中其他多模态：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to ICASSP 2024

2312.10372 2023-12-19 cs.AI 79%

When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

Qihang Ai, Jianwu Zhou, Haiyun Jiang, Lemao Liu, Shuming Shi

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments 15 pages, 10 figures, 9 tables

2310.14805 2023-12-19 cs.CL 79%

Cross-Modal Conceptualization in Bottleneck Models

Danis Alukaev, Semen Kiselev, Ilya Pershin, Bulat Ibragimov, Vladimir Ivanov, Alexey Kornaev, Ivan Titov

专题命中其他多模态：cross-modal(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2023; camera-ready version

2309.13782 2023-12-19 cs.LG cs.AI 79%

On the Computational Benefit of Multimodal Learning

Zhou Lu

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments ALT 2024, to appear

2312.05368 2023-12-12 cs.AI cs.CY cs.HC cs.LG 79%

Toward Scalable and Transparent Multimodal Analytics to Study Standard Medical Procedures: Linking Hand Movement, Proximity, and Gaze Data

Ville Heilala, Sami Lehesvuori, Raija Hämäläinen, Tommi Kärkkäinen

专题命中其他多模态：multimodal(title,abstract)；分类 cs.AI

Comments To be published in the Proceedings of the 39th ACM/SIGAPP Symposium on Applied Computing (SAC'24), April 8--12, 2024, Avila, Spain

1. 其他多模态 4868 篇

A Multimodal Learning-based Approach for Autonomous Landing of UAV

Dense Road Surface Grip Map Prediction from Multimodal Image Data

Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation

Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction

Incremental Multimodal Surface Mapping via Self-Organizing Gaussian Mixture Models

Learning to Rebalance Multi-Modal Optimization by Adaptively Masking Subnetworks

Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models

Cross-modal tumor segmentation using generative blending augmentation and self training

PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search

VL-Mamba: Exploring State Space Models for Multimodal Learning

Detecting Brain Tumors through Multimodal Neural Networks

Adaptive Multi-Modal Cross-Entropy Loss for Stereo Matching

CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection

Detecting Concrete Visual Tokens for Multimodal Machine Translation

Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques

InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding

Multimodal Learning To Improve Cardiac Late Mechanical Activation Detection From Cine MR Images

Multimodal Federated Learning in Healthcare: a Review

TinyLLaVA: A Framework of Small-scale Large Multimodal Models

Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation

Learning on Multimodal Graphs: A Survey

MMRec: Simplifying Multimodal Recommendation

Optical skin: Sensor-integration-free multimodal flexible sensing

FM-AE: Frequency-masked Multimodal Autoencoder for Zinc Electrolysis Plate Contact Abnormality Detection

AccidentGPT: Accident Analysis and Prevention from V2X Environmental Perception with Multi-modal Large Model

Towards Robust Multimodal Prompting With Missing Modalities

When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

Cross-Modal Conceptualization in Bottleneck Models

On the Computational Benefit of Multimodal Learning

Toward Scalable and Transparent Multimodal Analytics to Study Standard Medical Procedures: Linking Hand Movement, Proximity, and Gaze Data