多模态大模型

Multimodal Imaging-based Material Mass Density Estimation for Proton Therapy Using Physics-Constrained Deep Learning

Chih-Wei Chang, Raanan Marants, Yuan Gao, Matthew Goette, Jessica E. Scholey, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, Xiaofeng Yang

专题命中 其他多模态 ：multimodal(title,abstract)

Journal ref British Journal of Radiology, Volume 96, Issue 1152, 1 December 2023

SurfAAV: Design and Implementation of a Novel Multimodal Surfing Aquatic-Aerial Vehicle

Kun Liu, Junhao Xiao, Hao Lin, Yue Cao, Hui Peng, Kaihong Huang, Huimin Lu

机构 * College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China（智能科学与技术学院，国防科技大学，长沙，中国） ； School of Electronic Information, Central South University, Changsha, China（电子信息学院，中南大学，长沙，中国） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Tailless Flapping-Wing Robot With Bio-Inspired Elastic Passive Legs for Multi-Modal Locomotion

Zhi Zheng, Xiangyu Xu, Jin Wang, Yikai Chen, Jingyang Huang, Ruixin Wu, Huan Yu, Guodong Lu

机构 * State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University（流体动力与机械系统国家重点实验室，机械工程学院，浙江大学） ； Zhejiang Key Laboratory of Industrial Big Data and Robot Intelligent Systems, Zhejiang University（工业大数据与机器人智能系统浙江省重点实验室，浙江大学） ； Robotics Research Center of Yuyao City（余姚市机器人研究室） ； College of Electrical Engineering, Zhejiang University（电气工程学院，浙江大学） ； College of Control Science and Engineering, Zhejiang University（控制科学与工程学院，浙江大学） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)

Comments 8 pages, 11 figures, accepted by IEEE Robotics and Automation Letters (RAL)

Stacked Intelligent Metasurfaces for Multi-Modal Semantic Communications

Guojun Huang, Jiancheng An, Lu Gan, Dusit Niyato, Mérouane Debbah, Tie Jun Cui

专题命中 其他多模态 ：multi-modal(title,abstract)

Comments 6 pages, 6 figures, have been accepted by IEEE WCL

Interpretable Multimodal Learning for Tumor Protein-Metal Binding: Progress, Challenges, and Perspectives

Xiaokun Liu, Sayedmohammadreza Rastegari, Yijun Huang, Sxe Chang Cheong, Weikang Liu, Wenjie Zhao, Qihao Tian, Hongming Wang, Yingjie Guo, Shuo Zhou, Sina Tabakhi, Xianyuan Liu, Zheqing Zhu, Wei Sang, Haiping Lu

机构 * Institute of Big Data Science and Industry, Shanxi University, Taiyuan, China（山西大学大数据科学与产业研究院） ； School of Computer and Information Technology, Shanxi University, Taiyuan, China（山西大学计算机与信息学院） ； Key Laboratory of Evolutionary Science Intelligence of Shanxi Province, Taiyuan, Shanxi, China（山西省进化科学智能重点实验室） ； Faculty of Computer Engineering, University of Isfahan, Isfahan, Iran（伊斯法罕大学计算机工程学院） ； The First Clinical Medical School, Shanxi Medical University, Taiyuan, China（山西医科大学第一临床医学院） ； School of Medicine & Population Health, University of Sheffield, Sheffield, UK（谢菲尔德大学医学院与人口健康学院） ； School of Computer Science, University of Sheffield, Sheffield, UK（谢菲尔德大学计算机科学学院） ； Centre for Machine Intelligence, University of Sheffield, Sheffield, UK（谢菲尔德大学智能中心） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Geodesic Slice Sampler for Multimodal Distributions with Strong Curvature

Bernardo Williams, Hanlin Yu, Hoang Phuc Hau Luu, Georgios Arvanitidis, Arto Klami

机构 * Department of Computer Science, University of Helsinki, Finland（赫尔辛基大学计算机科学系） ； Cognitive Systems, DTU Compute, Technical University of Denmark（丹麦技术大学计算系认知系统） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

ArcNeural: A Multi-Modal Database for the Gen-AI Era

Wu Min, Qiao Yuncong, Yu Tan, Chenghu Yang

专题命中 其他多模态 ：multi-modal(title)；multimodal(abstract)

STREAMS: An Assistive Multimodal AI Framework for Empowering Biosignal Based Robotic Controls

Ali Rabiee, Sima Ghafoori, Xiangyu Bai, Sarah Ostadabbas, Reza Abiri

机构 * Dept. of Electrical Engineering University of Rhode Island Kingston, RI, USA（电气工程系 罗德岛大学 罗得岛州金斯顿） ； Computer Engineering Northeastern University Boston, Massachusetts, USA（计算机工程 美国东北大学 波士顿） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Enhancing Situational Awareness in Underwater Robotics with Multi-modal Spatial Perception

Pushyami Kaveti, Ambjorn Grimsrud Waldum, Hanumant Singh, Martin Ludvigsen

机构 * Northeastern University（东北大学） ； NTNU（挪威特罗姆瑟大学） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)

Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Model

Hugo Tabanelli, Pierre Mergny, Lenka Zdeborova, Florent Krzakala

机构 * Information Learning and Physics Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)（信息学习与物理实验室，瑞士联邦理工学院（EPFL）） ； Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL)（计算统计物理实验室，瑞士联邦理工学院（EPFL）） 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)

Multimodal Sensing and Machine Learning to Compare Printed and Verbal Assembly Instructions Delivered by a Social Robot

Ruchik Mishra, Laksita Prasanna, Adair Adair, Dan O Popa

机构 * Louisville Automation and Robotics Research Institute (LARRI), University of Louisville（路易斯维尔自动化与机器人研究研究所（LARRI）、路易斯维尔大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Comments Accepted to IEEE CASE 2025

Scattering polarimetry enables correlative nerve fiber imaging and multimodal analysis

Franca auf der Heiden, Markus Axer, Katrin Amunts, Miriam Menzel

专题命中 其他多模态 ：multimodal(title,abstract)

Comments 28 pages, 7 figures, all study data are available on https://doi.org/10.26165/JUELICH-DATA/CUXQYF

Journal ref Sci Rep 15, 18493 (2025)

Privacy-preserving Prompt Personalization in Federated Learning for Multimodal Large Language Models

Sizai Hou, Songze Li, Baturalp Buyukates

专题命中 其他多模态 ：multimodal(title,abstract)

Comments Under Review

Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions

Dongze Wu, Yao Xie

机构 * Dongze Wu ； Yao Xie 纠错

专题命中 其他多模态 ：multi-modal(title,abstract)

Comments This paper has been accepted to ICML 2025 and will appear in the Proceedings of Machine Learning Research (PMLR)

MDVT: Enhancing Multimodal Recommendation with Model-Agnostic Multimodal-Driven Virtual Triplets

Jinfeng Xu, Zheyu Chen, Jinze Li, Shuo Yang, Hewei Wang, Yijie Li, Mengran Li, Puzhen Wu, Edith C. H. Ngai

专题命中 其他多模态 ：multimodal(title,abstract)

Comments Accepted by KDD 2025

Multimodal Online Federated Learning with Modality Missing in Internet of Things

Heqiang Wang, Xiang Liu, Xiaoxiong Zhong, Lixing Chen, Fangming Liu, Weizhe Zhang

机构 * Peng Cheng Laboratory（鹏城实验室） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Learning Multimodal AI Algorithms for Amplifying Limited User Input into High-dimensional Control Space

Ali Rabiee, Sima Ghafoori, MH Farhadi, Robert Beyer, Xiangyu Bai, David J Lin, Sarah Ostadabbas, Reza Abiri

机构 * Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island（电气、计算机与生物医学工程系，罗德岛大学） ； Department of Electrical and Computer Engineering, Northeastern University（电气与计算机工程系，东北大学） ； Department of Neurology, Harvard Medical School（神经病学系，哈佛医学院） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

EdgeMM: Multi-Core CPU with Heterogeneous AI-Extension and Activation-aware Weight Pruning for Multimodal LLMs at Edge

Kangbo Bai, Le Ye, Ru Huang, Tianyu Jia

专题命中 其他多模态 ：multimodal(title,abstract)

Comments Accepted by DAC 2025

Constrained Multimodal Sensing-Aided Communications: A Dynamic Beamforming Design

Abolfazl Zakeri, Nhan Thanh Nguyen, Ahmed Alkhateeb, Markku Juntti

专题命中 其他多模态 ：multimodal(title,abstract)

Multimodal transformers with elemental priors for phase classification of X-ray diffraction spectra

Kangyu Ji, Fang Sheng, Tianran Liu, Basita Das, Tonio Buonassisi

专题命中 其他多模态 ：multimodal(title,abstract)

Thalamus: A User Simulation Toolkit for Prototyping Multimodal Sensing Studies

Kayhan Latifzadeh, Luis A. Leiva

专题命中 其他多模态 ：multimodal(title,abstract)

NeuroPal: A Clinically-Informed Multimodal LLM Assistant for Mental Health Combining Sleep Chronotherapy, Cognitive Behavioral Reframing, and Adaptive Phytochemical Intervention

Xiaoran Han

专题命中 其他多模态 ：multimodal(title,abstract)

Controlling Peak Sharpness in Multimodal Biomolecular Systems via the Chemical Fokker-Planck Equation

Taishi Kotsuka, Enoch Yeung

专题命中 其他多模态 ：multimodal(title,abstract)

Multi-modal cascade feature transfer for polymer property prediction

Kiichi Obuchi, Yuta Yahagi, Kiyohiko Toyama, Shukichi Tanaka, Kota Matsui

专题命中 其他多模态 ：multi-modal(title,abstract)

Aggregation of Dependent Expert Distributions in Multimodal Variational Autoencoders

Rogelio A Mancisidor, Robert Jenssen, Shujian Yu, Michael Kampffmeyer

专题命中 其他多模态 ：multimodal(title,abstract)

JAvaScript Multimodal INformation Explorer

Fenja Schweder, Sebastian Trujillo-Gomez, Kai Polsterer

专题命中 其他多模态 ：multimodal(title,abstract)

RABBIT: A Robot-Assisted Bed Bathing System with Multimodal Perception and Integrated Compliance

Rishabh Madan, Skyler Valdez, David Kim, Sujie Fang, Luoyan Zhong, Diego Virtue, Tapomayukh Bhattacharjee

机构 * Cornell University（康奈尔大学） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

Comments 10 pages, 8 figures, 19th Annual ACM/IEEE International Conference on Human Robot Interaction (HRI)

Multimodal Perception for Goal-oriented Navigation: A Survey

I-Tak Ieong, Hao Tang

机构 * School of Computer Science and Technology, Tongji University（同济大学计算机科学与技术学院） ； School of Computer Science, Peking University（北京大学计算机学院） 纠错

专题命中 其他多模态 ：multimodal(title,abstract)

BaThe: Defense against the Jailbreak Attack in Multimodal Large Language Models by Treating Harmful Instruction as Backdoor Trigger

Yulin Chen, Haoran Li, Yirui Zhang, Zihao Zheng, Yangqiu Song, Bryan Hooi

专题命中 其他多模态 ：multimodal(title,abstract)

Multimodal Shifts in the Dark Current of Silicon Photomultipliers

Ryu Kawarasaki, Akira Okumura, Kazuhiro Furuta, Hiroyasu Tajima

专题命中 其他多模态 ：multimodal(title,abstract)

Comments 7 pages, 3 figures, accepted for JINST