Zatom-1: Towards a Multimodal Foundation Model for 3D Molecules and Materials
Zatom-1:迈向3D分子和材料的多模态基础模型
Alex Morehead, Miruna Cretu, Antonia Panescu, Rishabh Anand, Maurice Weiler, Tynan Perez, Samuel Blau, Steven Farrell, Wahid Bhimji, Anubhav Jain, Hrushikesh Sahasrabuddhe, Pietro Lio, Tommi Jaakkola, Rafael Gomez-Bombarelli, Rex Ying, N. Benjamin Erichson, Michael W. Mahoney
机构
*
LBNL(劳伦斯伯克利国家实验室)
;
ICSI(国际计算机科学研究所)
;
University of Cambridge(剑桥大学)
;
Yale University(耶鲁大学)
;
MIT(麻省理工学院)
;
UC Berkeley(加州大学伯克利分校)
专题命中
多模态训练与对齐
:multimodal(title,abstract);multimodal foundation model(title);分类 cs.AI
OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models
OmniSIFT: 多模态非对称令牌压缩用于高效的多模态大语言模型
Yue Ding, Yiyan Ji, Jungang Li, Xuyang Liu, Xinlong Chen, Junfei Wu, Bozhou Li, Bohan Zeng, Yang Shi, Yushuo Guan, Yuanxing Zhang, Jiaheng Liu, Qiang Liu, Pengfei Wan, Liang Wang
机构
*
New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences (CASIA)(模式识别新实验室(NLPR)、自动化研究所、中国科学院(CASIA))
;
Nanjing University(南京大学)
;
The Hong Kong University of Science(香港科学大学)
;
Sichuan University(四川大学)
;
Peking University(北京大学)
BrainAnytime: Anatomy-Aware Cross-Modal Pretraining for Brain Image Analysis with Arbitrary Modality Availability
BrainAnytime: 基于解剖结构的跨模态预训练用于脑图像分析,支持任意模态可用性
Guangqian Yang, Tong Ding, Wenlong Hou, Yue Xun, Ye Du, Qian Niu, Shujun Wang
机构
*
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China(生物医学工程系,香港理工大学,香港特别行政区,中国)
;
Department of Technology Management for Innovation, The University of Tokyo, Japan(创新技术管理系,东京大学,日本)
;
Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China(数据科学与人工智能系,香港理工大学,香港特别行政区,中国)
ChatSR: Multimodal Large Language Models for Scientific Formula Discovery
ChatSR:用于科学公式发现的多模态大语言模型
Yanjie Li, Lina Yu, Weijun Li, Min Wu, Liping Zhang, Jingyi Liu, Yusong Deng, Mingzhu Wan, Xin Ning
机构
*
AnnLab, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China(安 lab,半导体研究所,中国科学院,北京,中国)
;
School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China(电子、电气与通信工程学院,中国科学院大学,北京,中国)
;
Zhongguancun Academy, Beijing, China(中关村学院,北京,中国)
;
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing 101408, China(先进交叉科学学院,中国科学院大学,北京101408,中国)
;
College of Materials Science and Opto-Electronic Technology, University of Chinese Academy of Sciences, Beijing, 100049, China(材料科学与光电技术学院,中国科学院大学,北京100049,中国)
;
School of Integrated Circuits, University of Chinese Academy of Sciences, Beijing 100049, China(集成电路学院,中国科学院大学,北京100049,中国)
Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysis
监督深度多模态矩阵分解用于可解释性脑网络分析
Amjad Seyedi, Lifang He, Songlin Zhao, Akwum Onwunta, Nicolas Gillis
机构
*
Dept. of Mathematics & Operational Research University of Mons(数学与运筹学系蒙斯大学)
;
Dept. of Computer Science & Engineering Lehigh University(计算机科学与工程系莱斯大学)
;
Dept. of Industrial & Systems Engineering Lehigh University(工业与系统工程系莱斯大学)
Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing
通过混合随机平滑实现异质扰动下的认证鲁棒性
Blaise Delattre, Hengyu Wu, Paul Caillon, Wei Yang Bryan Lim, Yang Cao
机构
*
Department of Computer Science, School of Computing, Institute of Science Tokyo, Tokyo, Japan(东京科学研究所计算机科学系)
;
College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算机与数据科学学院)
;
PSL University, Paris, France(巴黎高等师范学院)
机构
*
Institute for AI Industry Research (AIR), Tsinghua University(人工智能产业研究院(AIR),清华大学)
;
Juhaokan Technology Co.,Ltd(极皓科技有限公司)
;
Nanjing University(南京大学)
;
University of Science and Technology of China(中国科学技术大学)
TokaMind for Power Grid: Cross-Domain Transfer from Fusion Plasma
TokaMind用于电网:从融合等离子体的跨域迁移
JC Wu, Norton Lee, Kai Siang Chen
机构
*
TaiScience Research Group(TaiScience研究组)
;
Fu Jen Catholic University(辅仁大学)
;
Center for Geometry and Physics(几何与物理中心)
;
Institute for Basic Science (IBS)(基础科学研究所)