医学 AI - arXivDaily 专题

2405.20421 2025-06-12 cs.AI 50%

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

Qianqi Yan, Xuehai He, Xiang Yue, Xin Eric Wang

机构 * University of California, Santa Cruz（加州大学圣克ruz分校）； Carnegie Mellon University（卡内基梅隆大学）

专题命中医疗多模态：diagnosis(abstract)

2506.02470 2025-06-04 cs.AI 50%

A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoning

Xuejiao Zhao, Siyan Liu, Su-Yin Yang, Chunyan Miao

机构 * Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), NTU（联合NTU-UBC老龄化积极生活卓越研究中心（LILY），NTU）； College of Computing and Data Science, Nanyang Technological University (NTU), Singapore（计算与数据科学学院，南洋理工大学（NTU），新加坡）； Tan Tock Seng Hospital, Singapore（坦 tok sing 医院，新加坡）； Woodlands Health, Singapore（伍德兰兹健康，新加坡）

专题命中医疗多模态：diagnosis(abstract)

2505.18530 2025-05-27 cs.MA cs.AI 50%

MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMs

Pengyu Wang, Shuchang Ye, Usman Naseem, Jinman Kim

机构 * University of Sydney（悉尼大学）； Macquarie University（麦考瑞大学）

专题命中医疗多模态：diagnosis(abstract)

Comments 10pages

2505.05937 2025-05-12 cs.HC 50%

MER-CLIP: AU-Guided Vision-Language Alignment for Micro-Expression Recognition

Shifeng Liu, Xinglong Mao, Sirui Zhao, Peiming Li, Tong Xu, Enhong Chen

专题命中医疗多模态：diagnosis(abstract)

2502.15993 2025-02-25 cs.SI 50%

Community Detection in Multimodal Data: A Similarity Network Perspective

Aidan Marnane, T. Ian Simpson

专题命中医疗多模态：biomedical(abstract)

Comments 21 pages, 8 figures

2502.15040 2025-02-24 cs.CL cs.AI 50%

Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generation

Yun-Wei Chu, Kai Zhang, Christopher Malon, Martin Renqiang Min

专题命中医疗多模态：medical image(abstract)

Comments GenAI4Health - AAAI '25

2412.09928 2025-02-19 cs.SD eess.AS 50%

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer's Disease Identification

Yifan Gao, Long Guo, Hong Liu

专题命中医疗多模态：diagnosis(abstract)

Comments ICASSP 2025

2412.17077 2024-12-24 cs.AI 50%

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults

Jinzhi Wang, Qinfeng Song, Lidong Qian, Haozhou Li, Qinke Peng, Jiangbo Zhang

专题命中医疗多模态：diagnosis(abstract)

2412.13387 2024-12-19 eess.AS cs.SD 50%

Deep Speech Synthesis from Multimodal Articulatory Representations

Peter Wu, Bohan Yu, Kevin Scheck, Alan W Black, Aditi S. Krishnapriyan, Irene Y. Chen, Tanja Schultz, Shinji Watanabe, Gopala K. Anumanchipalli

专题命中医疗多模态：MRI(abstract)

2406.18088 2024-09-25 cs.CL cs.AI cs.SD eess.AS 50%

LLM-Driven Multimodal Opinion Expression Identification

Bonian Jia, Huiyao Chen, Yueheng Sun, Meishan Zhang, Min Zhang

专题命中医疗多模态：diagnosis(abstract)

Comments 5 pages, 3 Figures, Accept by Interspeech 2024

Journal ref Proceedings of Interspeech 2024

2402.14416 2024-09-13 stat.AP 50%

Algorithm-agnostic significance testing in supervised learning with multimodal data

Lucas Kook, Anton Rask Lundborg

专题命中医疗多模态：medical image(abstract)

2403.04277 2024-09-10 physics.bio-ph 50%

Multimodal Analysis of Traction Forces and Temperature Dynamics of Living Cells with Diamond-Embedded Substrate

Tomasz Kołodziej, Mariusz Mrózek, Saravanan Sengottuvel, Maciej J. Głowacki, Mateusz Ficek, Wojciech Gawlik, Zenon Rajfur, Adam Wojciechowski

专题命中医疗多模态：biomedical(abstract)

Comments 19 pages, 5 figures

Journal ref Biomed. Opt. Express, 15(7), 4024-4043 (2024)

2403.04785 2024-09-02 cs.CL cs.AI 50%

Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Data

Jun-En Ding, Phan Nguyen Minh Thao, Wen-Chih Peng, Jian-Zhe Wang, Chun-Cheng Chug, Min-Chen Hsieh, Yun-Chien Tseng, Ling Chen, Dongsheng Luo, Chi-Te Wang, Pei-fu Chen, Feng Liu, Fang-Ming Hung

专题命中医疗多模态：diagnosis(abstract)

2405.20775 2024-08-22 cs.CR cs.AI cs.CL cs.MM 50%

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Xijie Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

专题命中医疗多模态：medical image(abstract)

2406.18829 2024-06-28 stat.ME stat.ML 50%

Full Information Linked ICA: addressing missing data problem in multimodal fusion

Ruiyang Li, F. DuBois Bowman, Seonjoo Lee

专题命中医疗多模态：diagnosis(abstract)

Comments 17 pages, 6 figures

2309.15857 2024-06-21 cs.CL cs.AI cs.MM 50%

A Survey on Image-text Multimodal Models

Ruifeng Guo, Jingxuan Wei, Linzhuang Sun, Bihui Yu, Guiyong Chang, Dawei Liu, Sibo Zhang, Zhengbing Yao, Mingjun Xu, Liping Bu

专题命中医疗多模态：biomedical(abstract)

2405.19654 2024-05-31 cs.AI 50%

Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training

Jinxia Yang, Bing Su, Wayne Xin Zhao, Ji-Rong Wen

专题命中医疗多模态：medical image(abstract)

Comments Accepted at ICML 2024

2307.16740 2024-04-09 cond-mat.soft cond-mat.mtrl-sci 50%

Bioinspired multi-asymmetric magnetized surfaces for tailoring energy-free liquid manipulation and 3-DOF solid transportation

Jiaqi Miao

专题命中医疗多模态：biomedical(abstract)

Comments 25 pages, 6 figures

Journal ref Sensors and Actuators A: Physical, 115104 (2024)

2403.01483 2024-03-05 cs.RO 50%

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

Jianbo Zhao, Hao Chen, Qingyao Tian, Jian Chen, Bingyu Yang, Hongbin Liu

专题命中医疗多模态：diagnosis(abstract)

2402.14840 2024-02-26 cs.CL cs.AI stat.AP 50%

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

Congyun Jin, Ming Zhang, Xiaowei Ma, Li Yujiao, Yingbo Wang, Yabo Jia, Yuliang Du, Tao Sun, Haowen Wang, Cong Fan, Jinjie Gu, Chenfei Chi, Xiangguo Lv, Fangzhou Li, Wei Xue, Yiran Huang

专题命中医疗多模态：diagnosis(abstract)

Comments 15 pages, 13 figures

2312.07904 2024-02-05 physics.ins-det 50%

ForMAX -- a beamline for multiscale and multimodal structural characterization of hierarchical materials

K. Nygård, S. A. McDonald, J. B. González, V. Haghighat, C. Appel, E. Larsson, R. Ghanbari, M. Viljanen, J. Silva, S. Malki, Y. Li, V. Silva, C. Weninger, F. Engelmann, T. Jeppsson, G. Felcsuti, T. Rosén, K. Gordeyeva, L. D. Söderberg, H. Dierks, Y. Zhang, Z. Yao, R. Yang, E. M. Asimakopoulou, J. K. Rogalinski, J. Wallentin, P. Villanueva-Perez, R. Krüger, T. Dreier, M. Bech, M. Liebi, M. Bek, R. Kádár, A. E. Terry, H. Tarawneh, P. Ilinski, J. Malmqvist, Y. Cerenius

专题命中医疗多模态：biomedical(abstract)

Comments Accepted for publication in J. Synchrotron Rad

2401.00580 2024-01-02 physics.med-ph 50%

Multimodal surface coils for low-field MR imaging

Yunkun Zhao, Aditya A Bhosale, Xiaoliang Zhang

专题命中医疗多模态：MRI(abstract)

2312.06982 2023-12-13 cond-mat.mtrl-sci physics.app-ph 50%

Residual Stress-Driven Non-Euclidean Morphing in Origami Structures

Zihe Liang, Sibo Chai, Qinyun Ding, Kai Xiao, Ke Liu, Jiayao Ma, Jaehyung Ju

专题命中医疗多模态：biomedical(abstract)

2310.09926 2023-11-28 cs.AI 50%

Estimating Uncertainty in Multimodal Foundation Models using Public Internet Data

Shiladitya Dutta, Hongbo Wei, Lars van der Laan, Ahmed M. Alaa

专题命中医疗多模态：biomedical(abstract)

2308.09442 2023-08-22 cs.CE 50%

BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine

Yizhen Luo, Jiahuan Zhang, Siqi Fan, Kai Yang, Yushuai Wu, Mu Qiao, Zaiqing Nie

专题命中医疗多模态：biomedical(abstract)

Comments 12 pages, 4 figures

2307.13706 2023-07-27 cs.HC cs.AI 50%

Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism

Annanda Sousa, Karen Young, Mathieu D'aquin, Manel Zarrouk, Jennifer Holloway

专题命中医疗多模态：diagnosis(abstract)

Journal ref HCII 2023: Universal Access in Human-Computer Interaction, Margherita Antona; Constantine Stephanidis, Jul 2023, Copenhagen, Denmark. pp.657-677

2301.04535 2023-04-03 cs.CL cs.SI 50%

Few-shot Learning for Cross-Target Stance Detection by Aggregating Multimodal Embeddings

Parisa Jamadi Khiabani, Arkaitz Zubiaga

专题命中医疗多模态：CT(abstract)

Comments To appear in IEEE Transactions on Computational Social Systems

2203.10122 2022-07-06 cs.RO physics.app-ph 50%

Spinning-enabled Wireless Amphibious Origami Millirobot

Qiji Ze, Shuai Wu, Jize Dai, Sophie Leanza, Gentaro Ikeda, Phillip C. Yang, Gianluca Iaccarino, Ruike Renee Zhao

专题命中医疗多模态：biomedical(abstract)

2205.02510 2022-06-13 cs.GR 50%

Encoding of direct 4D printing of isotropic single-material system for double-curvature and multimodal morphing

Bihui Zou, Chao Song, Zipeng He, Jaehyung Ju

专题命中医疗多模态：biomedical(abstract)

Journal ref Extreme Mech. Lett. 54 (2022) 101779

2108.00866 2021-12-03 stat.ML math-ph math.MP stat.AP stat.ME 50%

Nonparametric posterior learning for emission tomography with multimodal data

Fedor Goncharov, Éric Barat, Thomas Dautremer

专题命中医疗多模态：MRI(abstract)

1. 医疗多模态 966 篇

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA

A Smart Multimodal Healthcare Copilot with Powerful LLM Reasoning

MRGAgents: A Multi-Agent Framework for Improved Medical Report Generation with Med-LVLMs

MER-CLIP: AU-Guided Vision-Language Alignment for Micro-Expression Recognition

Community Detection in Multimodal Data: A Similarity Network Perspective

Reducing Hallucinations of Medical Multimodal Large Language Models with Visual Retrieval-Augmented Generation

Leveraging Multimodal Methods and Spontaneous Speech for Alzheimer's Disease Identification

SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults

Deep Speech Synthesis from Multimodal Articulatory Representations

LLM-Driven Multimodal Opinion Expression Identification

Algorithm-agnostic significance testing in supervised learning with multimodal data

Multimodal Analysis of Traction Forces and Temperature Dynamics of Living Cells with Diamond-Embedded Substrate

Large Language Multimodal Models for 5-Year Chronic Disease Cohort Prediction Using EHR Data

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Full Information Linked ICA: addressing missing data problem in multimodal fusion

A Survey on Image-text Multimodal Models

Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-training

Bioinspired multi-asymmetric magnetized surfaces for tailoring energy-free liquid manipulation and 3-DOF solid transportation

BronchoCopilot: Towards Autonomous Robotic Bronchoscopy via Multimodal Reinforcement Learning

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

ForMAX -- a beamline for multiscale and multimodal structural characterization of hierarchical materials

Multimodal surface coils for low-field MR imaging

Residual Stress-Driven Non-Euclidean Morphing in Origami Structures

Estimating Uncertainty in Multimodal Foundation Models using Public Internet Data

BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine

Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism

Few-shot Learning for Cross-Target Stance Detection by Aggregating Multimodal Embeddings

Spinning-enabled Wireless Amphibious Origami Millirobot

Encoding of direct 4D printing of isotropic single-material system for double-curvature and multimodal morphing

Nonparametric posterior learning for emission tomography with multimodal data