多模态大模型

A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI

Luyang Luo, Mingxiang Wu, Mei Li, Yi Xin, Qiong Wang, Varut Vardhanabhuti, Winnie CW Chu, Zhenhui Li, Juan Zhou, Pranav Rajpurkar, Hao Chen

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Nature Communications 2025

Finer-CAM: Spotting the Difference Reveals Finer Details for Visual Explanation

Ziheng Zhang, Jianyang Gu, Arpita Chowdhury, Zheda Mai, David Carlyn, Tanya Berger-Wolf, Yu Su, Wei-Lun Chao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted by CVPR 2025

Vision as LoRA

Han Wang, Yongjie Ye, Bingru Li, Yuxiang Nie, Jinghui Lu, Jingqun Tang, Yanjie Wang, Can Huang

专题命中 其他多模态 ：MLLM(abstract)；分类 cs.CV、cs.CL

Gemma 3 Technical Report

Gemma Team, Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard, Ramona Merhej, Sarah Perrin, Tatiana Matejovicova, Alexandre Ramé, Morgane Rivière, Louis Rouillard, Thomas Mesnard, Geoffrey Cideron, Jean-bastien Grill, Sabela Ramos, Edouard Yvinec, Michelle Casbon, Etienne Pot, Ivo Penchev, Gaël Liu, Francesco Visin, Kathleen Kenealy, Lucas Beyer, Xiaohai Zhai, Anton Tsitsulin, Robert Busa-Fekete, Alex Feng, Noveen Sachdeva, Benjamin Coleman, Yi Gao, Basil Mustafa, Iain Barr, Emilio Parisotto, David Tian, Matan Eyal, Colin Cherry, Jan-Thorsten Peter, Danila Sinopalnikov, Surya Bhupatiraju, Rishabh Agarwal, Mehran Kazemi, Dan Malkin, Ravin Kumar, David Vilar, Idan Brusilovsky, Jiaming Luo, Andreas Steiner, Abe Friesen, Abhanshu Sharma, Abheesht Sharma, Adi Mayrav Gilady, Adrian Goedeckemeyer, Alaa Saade, Alex Feng, Alexander Kolesnikov, Alexei Bendebury, Alvin Abdagic, Amit Vadi, András György, André Susano Pinto, Anil Das, Ankur Bapna, Antoine Miech, Antoine Yang, Antonia Paterson, Ashish Shenoy, Ayan Chakrabarti, Bilal Piot, Bo Wu, Bobak Shahriari, Bryce Petrini, Charlie Chen, Charline Le Lan, Christopher A. Choquette-Choo, CJ Carey, Cormac Brick, Daniel Deutsch, Danielle Eisenbud, Dee Cattle, Derek Cheng, Dimitris Paparas, Divyashree Shivakumar Sreepathihalli, Doug Reid, Dustin Tran, Dustin Zelle, Eric Noland, Erwin Huizenga, Eugene Kharitonov, Frederick Liu, Gagik Amirkhanyan, Glenn Cameron, Hadi Hashemi, Hanna Klimczak-Plucińska, Harman Singh, Harsh Mehta, Harshal Tushar Lehri, Hussein Hazimeh, Ian Ballantyne, Idan Szpektor, Ivan Nardini, Jean Pouget-Abadie, Jetha Chan, Joe Stanton, John Wieting, Jonathan Lai, Jordi Orbay, Joseph Fernandez, Josh Newlan, Ju-yeong Ji, Jyotinder Singh, Kat Black, Kathy Yu, Kevin Hui, Kiran Vodrahalli, Klaus Greff, Linhai Qiu, Marcella Valentine, Marina Coelho, Marvin Ritter, Matt Hoffman, Matthew Watson, Mayank Chaturvedi, Michael Moynihan, Min Ma, Nabila Babar, Natasha Noy, Nathan Byrd, Nick Roy, Nikola Momchev, Nilay Chauhan, Noveen Sachdeva, Oskar Bunyan, Pankil Botarda, Paul Caron, Paul Kishan Rubenstein, Phil Culliton, Philipp Schmid, Pier Giuseppe Sessa, Pingmei Xu, Piotr Stanczyk, Pouya Tafti, Rakesh Shivanna, Renjie Wu, Renke Pan, Reza Rokni, Rob Willoughby, Rohith Vallu, Ryan Mullins, Sammy Jerome, Sara Smoot, Sertan Girgin, Shariq Iqbal, Shashir Reddy, Shruti Sheth, Siim Põder, Sijal Bhatnagar, Sindhu Raghuram Panyam, Sivan Eiger, Susan Zhang, Tianqi Liu, Trevor Yacovone, Tyler Liechty, Uday Kalra, Utku Evci, Vedant Misra, Vincent Roseberry, Vlad Feinberg, Vlad Kolesnikov, Woohyun Han, Woosuk Kwon, Xi Chen, Yinlam Chow, Yuvein Zhu, Zichuan Wei, Zoltan Egyed, Victor Cotruta, Minh Giang, Phoebe Kirk, Anand Rao, Kat Black, Nabila Babar, Jessica Lo, Erica Moreira, Luiz Gustavo Martins, Omar Sanseviero, Lucas Gonzalez, Zach Gleicher, Tris Warkentin, Vahab Mirrokni, Evan Senter, Eli Collins, Joelle Barral, Zoubin Ghahramani, Raia Hadsell, Yossi Matias, D. Sculley, Slav Petrov, Noah Fiedel, Noam Shazeer, Oriol Vinyals, Jeff Dean, Demis Hassabis, Koray Kavukcuoglu, Clement Farabet, Elena Buchatskaya, Jean-Baptiste Alayrac, Rohan Anil, Dmitry, Lepikhin, Sebastian Borgeaud, Olivier Bachem, Armand Joulin, Alek Andreev, Cassidy Hardin, Robert Dadashi, Léonard Hussenot

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

PP-DocLayout: A Unified Document Layout Detection Model to Accelerate Large-Scale Data Construction

Ting Sun, Cheng Cui, Yuning Du, Yi Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Github Repo: https://github.com/PaddlePaddle/PaddleX

DreamLLM-3D: Affective Dream Reliving using Large Language Model and 3D Generative AI

Pinyao Liu, Keon Ju Lee, Alexander Steinmaurer, Claudia Picard-Deland, Michelle Carr, Alexandra Kitson

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI、cs.MM

Comments 8 pages, 3 figures, Accepted by NeurIPS creative AI track 2024

MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation

Yuxiang Fu, Qi Yan, Lele Wang, Ke Li, Renjie Liao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted to CVPR 2025

Dynamic Analysis and Adaptive Discriminator for Fake News Detection

Xinqi Su, Zitong Yu, Yawen Cui, Ajian Liu, Xun Lin, Yuhao Wang, Haochen Liang, Wenhui Li, Li Shen, Xiaochun Cao

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Pi-GPS: Enhancing Geometry Problem Solving by Unleashing the Power of Diagrammatic Information

Junbo Zhao, Ting Zhang, Jiayu Sun, Mi Tian, Hua Huang

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model

Necdet Gurkan, Kimathi Njoki, Jordan W. Suchow

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

EdgeMoE: Empowering Sparse Large Language Models on Mobile Devices

Rongjie Yi, Liwei Guo, Shiyun Wei, Ao Zhou, Shangguang Wang, Mengwei Xu

专题命中 其他多模态 ：MLLM(abstract)；分类 cs.CL、cs.AI

Walking the Web of Concept-Class Relationships in Incrementally Trained Interpretable Models

Susmit Agrawal, Deepika Vemuri, Sri Siddarth Chakaravarthy P, Vineeth N. Balasubramanian

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 8 pages of main text, 6 figures in main text, 11 pages of Appendix, published in AAAI 2025

A Split-Window Transformer for Multi-Model Sequence Spammer Detection using Multi-Model Variational Autoencoder

Zhou Yang, Yucai Pang, Hongbo Yin, Yunpeng Xiao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI、cs.MM

Towards Robust Probabilistic Modeling on SO(3) via Rotation Laplace Distribution

Yingda Yin, Jiangran Lyu, Yang Wang, Haoran Liu, He Wang, Baoquan Chen

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments TPAMI 2025. ICLR 2023 spotlight. arXiv admin note: substantial text overlap with arXiv:2303.01743

Label Drop for Multi-Aspect Relation Modeling in Universal Information Extraction

Lu Yang, Jiajia Li, En Ci, Lefei Zhang, Zuchao Li, Ping Wang

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL-main 2025

Large Language Models and Provenance Metadata for Determining the Relevance of Images and Videos in News Stories

Tomas Peterka, Matyas Bohacek

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Tell2Reg: Establishing spatial correspondence between images by the same language prompts

Wen Yan, Qianye Yang, Shiqi Huang, Yipei Wang, Shonit Punwani, Mark Emberton, Vasilis Stavrinides, Yipeng Hu, Dean Barratt

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 3 figures, conference paper

Beyond Specialization: Assessing the Capabilities of MLLMs in Age and Gender Estimation

Maksim Kuprashevich, Grigorii Alekseenko, Irina Tolstykh

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

FLM-101B: An Open LLM and How to Train It with $100K Budget

Xiang Li, Yiqun Yao, Xin Jiang, Xuezhi Fang, Xuying Meng, Siqi Fan, Peng Han, Jing Li, Li Du, Bowen Qin, Zheng Zhang, Aixin Sun, Yequan Wang

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

VisualRWKV: Exploring Recurrent Neural Networks for Visual Language Models

Haowen Hou, Peigen Zeng, Fei Ma, Fei Richard Yu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments Accepted at COLING 2025 main conference

xVal: A Continuous Numerical Tokenization for Scientific Language Models

Siavash Golkar, Mariel Pettee, Michael Eickenberg, Alberto Bietti, Miles Cranmer, Geraud Krawezik, Francois Lanusse, Michael McCabe, Ruben Ohana, Liam Parker, Bruno Régaldo-Saint Blancard, Tiberiu Tesileanu, Kyunghyun Cho, Shirley Ho

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 12 figures. Appendix: 8 pages, 2 figures. Accepted contribution at the NeurIPS Workshop on ML for the Physical Sciences

A Review of Intelligent Device Fault Diagnosis Technologies Based on Machine Vision

Guiran Liu, Binrong Zhu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 9 pages, This paper has been accepted for publication at RICAI 2024

Design-o-meter: Towards Evaluating and Refining Graphic Designs

Sahil Goyal, Abhinav Mahajan, Swasti Mishra, Prateksha Udhayanan, Tripti Shukla, K J Joseph, Balaji Vasan Srinivasan

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted to WACV 2025. Project page: https://sahilg06.github.io/Design-o-meter/

Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMs

Xiaofeng Zhang, Yihao Quan, Chaochen Gu, Chen Shen, Xiaosong Yuan, Shaotian Yan, Hao Cheng, Kaijie Wu, Jieping Ye

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

MBDRes-U-Net: Multi-Scale Lightweight Brain Tumor Segmentation Network

Longfeng Shen, Yanqi Hou, Jiacong Chen, Liangjin Diao, Yaxi Duan

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Brain tumor segmentation, lightweight model, Brain Tumor Segmentation (BraTS) Challenge, group convolution

Text2Freq: Learning Series Patterns from Text via Frequency Domain

Ming-Chih Lo, Ching Chang, Wen-Chih Peng

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 3 figures, and be accepted by NeurIPS 2024 Workshop: Time Series in the Age of Large Models

Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact

Junhua Liu, Bin Fu

专题命中 其他多模态 ：MLLM(abstract)；分类 cs.CL、cs.AI

NatLan: Native Language Prompting Facilitates Knowledge Elicitation Through Language Trigger Provision and Domain Trigger Retention

Baixuan Li, Yunlong Fan, Tianyi Ma, Zhiqiang Gao

专题命中 其他多模态 ：MLLM(abstract)；分类 cs.CL、cs.AI

Chip-Tuning: Classify Before Language Models Say

Fangwei Zhu, Dian Li, Jiajun Huang, Gang Liu, Hui Wang, Zhifang Sui

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI

The Sampling-Gaussian for stereo matching

Baiyu Pan, jichao jiao, Bowen Yao, Jianxin Pang, Jun Cheng

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments TL;DR: A novel Gaussian distribution-based supervision method for stereo matching. Implemented with five baseline methods and achieves notable improvement. Main content, 10 pages. conference submission