One QK Channel, Many Sources: Guarding Low-Precision Attention Collapse
一个QK通道,多个源:防范低精度注意力崩溃
Shuxiao Xie, Shuyang Xie, Yuan Cao, Dezhi Ran, Wei Yang, Tao Xie
机构
*
Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC)(北京通明湖信息技术应用创新中心(TLAIC))
;
Fudan University Institute of Systems for Advanced Computing(复旦大学先进计算系统研究所)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Peking University(北京大学)
;
Shanghai Institute of Systems for Open Computing(上海开放计算系统研究所)
A Survey of Large Audio Language Models: Generalization, Trustworthiness, and Outlook
大型音频语言模型综述:通用性、可信度与展望
Kaiwen Luo, Zhenhong Zhou, Leyan Wang, Liang Lin, Tianyu Shao, Yuanhe Zhang, Yang Xiao, Yuxuan Li, Miao Yu, Kailin Lyu, Jiaming Zhang, Li Sun, Songze Li, Yueming Wu, Ting Dang, Xiaojun Jia, Dongrui Liu, Kai Li, Rohan Kumar Das, Siyuan Liang, Xinfeng Li, Qiankun Li, Jing Chen, Xingjun Ma, Kun Wang, Junhao Dong, Deqing Zou, Yu Cheng, Xia Hu, Zhigang Zeng, Sen Su, Yang Liu, Yu-Gang Jiang, Philip S. Yu, Yew-Soon Ong
机构
*
Nanyang Technological University(南洋理工大学)
;
Independent Researcher(独立研究者)
;
The University of Melbourne(墨尔本大学)
;
North China Electric Power University(华北电力大学)
;
Beijing University of Posts and Telecommunications(北京邮电大学)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Huazhong University of Science and Technology(华中科技大学)
;
Tsinghua University(清华大学)
;
Fortemedia Singapore(富媒体新加坡)
;
Tencent(腾讯)
;
Fudan University(复旦大学)
;
Wuhan University(武汉大学)
;
Chinese University of Hong Kong(香港中文大学)
;
Chongqing University of Posts and Telecommunications(重庆邮电大学)
;
University of Illinois Chicago(伊利诺伊大学芝加哥分校)
Chimera: Neuro-Symbolic Attention Primitives for Trustworthy Dataplane Intelligence
Chimera:用于可信数据平面智能的神经符号注意力原语
Rong Fu, Xiaowen Ma, Kun Liu, Wangyu Wu, Ziyu Kong, Jia Yee Tan, Tailong Luo, Xianda Li, Yongtai Liu, Youjin Wang, Simon Fong
机构
*
University of Macau(澳门大学)
;
Zhejiang University(浙江大学)
;
University of Southampton(南安普顿大学)
;
University of Liverpool(利物浦大学)
;
Fudan University(复旦大学)
;
Renmin University of China(中国人民大学)
;
New York Institute of Technology(纽约理工学院)
;
University of Bologna(博洛尼亚大学)
;
Minzu University of China(民族大学)
;
Hanyang University(汉阳大学)
GaiaFlow: Semantic-Guided Diffusion Tuning for Carbon-Frugal Search
GaiaFlow:基于语义的扩散调优用于碳节约搜索
Rong Fu, Jia Yee Tan, Chunlei Meng, Shuo Yin, Xiaowen Ma, Wangyu Wu, Simon Fong
机构
*
University of Macau(澳门大学)
;
Renmin University of China(中国人民大学)
;
Fudan University(复旦大学)
;
Tsinghua University(清华大学)
;
Zhejiang University(浙江大学)
;
University of Liverpool(利物浦大学)
;
Peking University(北京大学)
;
Northeast Normal University(东北师范大学)
;
Minzu University of China(民族大学)
Missing-by-Design: Certifiable Modality Deletion for Revocable Multimodal Sentiment Analysis
缺失-by-设计:可撤销多模态情感分析的可验证模态删除
Rong Fu, Ziming Wang, Chunlei Meng, Jiekai Wu, Kangan Qian, Hao Zhang, Simon Fong
机构
*
University of Macau(澳门大学)
;
Zhejiang University(浙江大学)
;
Fudan University(复旦大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Juntendo University(立命馆大学)
;
Tsinghua University(清华大学)
;
University of Chinese Academy of Sciences(中国科学院大学)
Comments21 pages, 6 figures. In the previous version, Juntendo University was erroneously listed as the affiliation; we must clarify that this paper has absolutely no relation to Juntendo University. Therefore, we have replaced this affiliation in the new version