Attention Sinks and Outliers in Attention Residuals
注意力沉底与注意力残差中的异常值
Haozheng Luo, Haoran Dai, Shaoyang Zhang, Xi Chen, Eric Hanchen Jiang, Yijiang Li, Jingyuan Huang, Chenghao Qiu, Chenwei Xu, Zhenyu Pan, Haotian Zhang, Binghui Wang, Yan Chen
机构
*
Department of Computer Science, Northwestern University(西北大学计算机科学系)
;
Department of Computer Science and Engineering, University of Michigan(密歇根大学计算机科学与工程系)
;
Department of Statistics and Data Science, University of California Los Angeles(加州大学洛杉矶分校统计与数据科学系)
;
Department of Electrical and Computer Engineering, University of California San Diego(加州圣地亚哥大学电气与计算机工程系)
;
Department of Computer Science, Rutgers University-New Brunswick(新泽西州立大学鲁特学院计算机科学系)
;
Department of Computer Science and Engineering, Texas A&M University(德克萨斯农工大学计算机科学与工程系)
;
Department of Computer Science, Columbia University(哥伦比亚大学计算机科学系)
Conv-FinRe: A Conversational and Longitudinal Benchmark for Utility-Grounded Financial Recommendation
Conv-FinRe:一种用于实用导向财务推荐的对话和纵向基准
Yan Wang, Yi Han, Lingfei Qian, Yueru He, Xueqing Peng, Dongji Feng, Zhuohan Xie, Vincent Jim Zhang, Rosie Guo, Fengran Mo, Jimin Huang, Yankai Chen, Xue Liu, Jian-Yun Nie
机构
*
Georgia Institute of Technology(佐治亚理工学院)
;
Columbia University(哥伦比亚大学)
;
California State University(加州州立大学)
;
University of Montreal(蒙特利尔大学)
;
The University of Manchester(曼彻斯特大学)
;
McGill University(麦吉尔大学)
FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMs
FinAuditing: 一个基于财务分类结构的多文档基准,用于评估LLMs
Yan Wang, Keyi Wang, Shanshan Yang, Jaisal Patel, Jeff Zhao, Fengran Mo, Xueqing Peng, Lingfei Qian, Yankai Chen, Víctor Gutiérrez-Basulto, Jimin Huang, Guojun Xiong, Xiao-Yang Liu, Xue Liu, Jian-Yun Nie
机构
*
Columbia University(哥伦比亚大学)
;
Stevens Institute of Technology(史蒂文斯理工学院)
;
Rensselaer Polytechnic Institute(拉特格斯理工学院)
;
University of Montreal(蒙特利尔大学)
;
McGill University(麦吉尔大学)
;
MBZUAI(麦吉尔大学人工智能研究所)
;
Cardiff University(卡迪夫大学)
;
The University of Manchester(曼彻斯特大学)
;
Harvard University(哈佛大学)
机构
*
Northeastern University(东北大学)
;
University of Southern California(南加州大学)
;
Stony Brook University(石溪大学)
;
Independent Researcher(独立研究者)
;
Ohio State University(俄亥俄州立大学)
;
University of Notre Dame(Notre Dame 大学)
;
Columbia University(哥伦比亚大学)
机构
*
Georgia Institute of Technology(佐治亚理工学院)
;
Columbia University(哥伦比亚大学)
;
California State University(加州州立大学)
;
University of Montreal(蒙特利尔大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Rensselaer Polytechnic Institute(莱斯利理工学院)
;
The University of Manchester(曼彻斯特大学)
;
Harvard University(哈佛大学)
Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents
面向LLM推理和AI代理的吞吐量最优调度算法
J. G. Dai, Tianze Deng, Yueying Li, Tianyi Peng
机构
*
School of Operations Research and Information Engineering, Cornell University(Cornell大学运筹学与信息工程学院)
;
Operations Management, Booth School of Business, University of Chicago(芝加哥大学博斯商学院运营管理系)
;
Decision, Risk and Operations, Columbia Business School, Columbia University(哥伦比亚大学哥伦比亚商学院决策、风险与运营系)
Can LLM Agents Be CFOs? Benchmarking Long-Horizon Resource Allocation in an Uncertain Enterprise Environment
LLM代理能成为CFO吗?在不确定的企业环境中评估长期资源分配
Yi Han, Yan Wang, Lingfei Qian, Haohang Li, Yupeng Cao, Yueru He, Xueqing Peng, Nanhan Shen, Yitao Xu, Yankai Chen, Dongji Feng, Jimin Huang, Xue Liu, Jian-Yun Nie, Sophia Ananiadou
机构
*
Georgia Institute of Technology(佐治亚理工学院)
;
The Fin AI
;
Stevens Institute of Technology(史蒂文斯理工学院)
;
Columbia University(哥伦比亚大学)
;
George Mason University(乔治·马歇尔大学)
;
McGill University(麦吉尔大学)
;
Mohamed bin Zayed University of Artificial Intelligence(莫扎大学人工智能学院)
;
California State University, Monterey Bay(加州州立大学蒙特雷湾分校)
;
University of Manchester(曼彻斯特大学)
;
Mila – Quebec Artificial Intelligence Institute(魁北克人工智能研究所)
;
Université de Montréal(蒙特利尔大学)
机构
*
Columbia University(哥伦比亚大学)
;
Columbia University School of Professional Studies(哥伦比亚大学专业研究学院)
;
Department of Statistics(统计学系)
;
Columbia University Department of Computer Science(哥伦比亚大学计算机科学系)
Gradient Dynamics of Attention: How Cross-Entropy Sculpts Bayesian Manifolds
注意力的梯度动力学:交叉熵如何塑造贝叶斯流形
Naman Agarwal, Siddhartha R. Dalal, Vishal Misra
机构
*
Columbia University(哥伦比亚大学)
;
Columbia University School of Professional Studies(哥伦比亚大学专业研究学院)
;
Department of Statistics(统计学系)
;
Columbia University Department of Computer Science(哥伦比亚大学计算机科学系)
机构
*
Columbia University(哥伦比亚大学)
;
Columbia University School of Professional Studies(哥伦比亚大学专业研究学院)
;
Department of Statistics(统计学系)
;
Columbia University Department of Computer Science(哥伦比亚大学计算机科学系)
Learning more physically realistic dynamics in machine-learning based weather forecasting with latent-space constraints
在基于机器学习的天气预报中通过隐空间约束学习更符合物理现实的动力学
Hang Fan, Yi Xiao, Yongquan Qu, Juan Nathaniel, Fenghua Ling, Ben Fei, Lei Bai, Pierre Gentine
机构
*
Department of Earth and Environmental Engineering, Columbia University(哥伦比亚大学地球与环境工程系)
;
Learning the Earth with Artificial Intelligence and Physics (LEAP) Center, Columbia University(人工智能与物理联合地球学习中心(LEAP), 哥伦比亚大学)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
The Chinese University of Hong Kong(香港中文大学)
;
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Wavelet Flow Matching for Multi-Scale Physics Emulation
小波流匹配用于多尺度物理模拟
Gabriele Accarino, Juan Nathaniel, Carla Roesch, Pierre Gentine, Sara Shamekh, Duncan Watson-Parris, Viviana Acquaviva
机构
*
Department of Earth and Environmental Engineering(地球与环境工程系)
;
Columbia University(哥伦比亚大学)
;
University of Edinburgh(爱丁堡大学)
;
Courant Institute of Mathematical Sciences(数学科学学院)
;
New York University(纽约大学)
;
Scripps Institution of Oceanography(斯克里普斯海洋研究所)
;
Halıcıoğlu Data Science Institute(哈利奇数据科学研究所)
;
University of California San Diego(加州大学圣地亚哥分校)
;
CUNY New York City College of Technology(纽约市立大学纽约技术学院)
;
Lamont-Doherty Earth Observatory(拉蒙特-多伊蒂地球观测站)