Law of Neural Interaction: Depth-Width Shape, Interaction Efficiency, and Generalization
神经交互定律:深度-宽度形状、交互效率与泛化
Wenjie Sun, Jinning Yang, Shuai Zhang, Mengnan Du
机构
*
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
;
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院)
;
New Jersey Institute of Technology(新泽西理工学院)
专题命中
效率与部署
:large language model(abstract);language model(abstract);分类 cs.LG
Julien Abadji, Marah Abdin, Connor Adams, Eric Alcaide, Mustafa Altun, Michele Artoni, Junze Bao, Uday Barar, Vassilis Bekiaris, Arkadii Bessonov, Benjamin Bütikofer, Jonathan Chang, Yen-Chun Chen, Dmitry Chernenkov, Yang Chi, Filippos Christianos, Fenia Christopoulou, Razvan-Andrei Ciocoiu, Tzachi Cohen, Yohann Coppel, Dmitrii Emelianenko, Brandon Fergerson, Brian Fitzgerald, Matthias Gallé, Alex Golonzovskyi, George Grigorev, Yiyang Hao, Christian Hensel, Jan Huenermann, Ye Ji, Sarthak Joshi, Eiso Kant, Kabir Khandpur, Seonghyeon Kim, Vladimir Kirichenko, Umut Kocasarac, Ilya Kochik, Ivan Komarov, Chaerin Kong, Anurag Koul, François-Joseph Lacroix, Sergei Laktionov, Waren Long, Quentin Malartic, Vadim Markovtsev, Afonso Marques, Robert McHardy, Carlos Mocholí, Dmitry Monakhov, Adam Morris, Martin Muller, Christian Mürtz, Robin Nabel, Thien Nguyen, Rok Novosel, Szymon Ozog, Aalhad Patankar, Aleksei Petrov, Alexandre Piché, Arthur Pignet, Teodor Poncu, Phil Potter, Alexander Rakowski, Pierre-Yves Ritschard, Jay Roberts, Joe Rowell, Piotr Sarna, Pierre-André Savalle, Uladzislau Sazanovich, Nikita Shapovalov, Arsenii Shevchenko, Mikhail Shilkov, Andrei Sokol, Mohamed Soliman, Jack Stephenson, Victor Storchan, Dragos-Constantin Tantaru, Artem Tyurin, Adrian Wälchli, Pengming Wang, Jianxiao Yang, Renat Zayashnikov, Alexander Zelenka Martin, Nikolay Zinov, Caroline Bercier, José Caldeira, Margarida Garcia, Tom George, Kabeer Gharzai, Glenn Hitchcock, Carson Klingenberg, Ivo Pinto, Varun Randery, Noah Smith, Arina Sugako, Jason Warner
Graph-of-Skills: Dependency-Aware Structural Retrieval for Massive Agent Skills
技能图谱:面向大规模智能体技能的依赖感知结构检索
Dawei Liu, Zongxia Li, Hongyang Du, Xiyang Wu, Shihang Gui, Yongbei Kuang, Lichao Sun
机构
*
University of Pennsylvania(宾夕法尼亚大学)
;
University of Maryland(马里兰大学)
;
Brown University(布朗大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
Lehigh University(莱斯大学)
ICAN-Deploy: Identity-Stable Canary Deployment for Safety-Critical Embodied Agents
ICAN-Deploy:面向安全关键具身智能体的身份稳定金丝雀部署
Xue Qin, Simin Luan, John See, Zeyd Boukhers, Cong Yang, Zhijun Li
机构
*
Harbin Institute of Technology(哈尔滨工业大学)
;
Heriot-Watt University, Malaysia Campus(赫瑞-沃德大学马来西亚分校)
;
Fraunhofer Institute for Applied Information Technology(弗劳恩霍夫应用信息技术研究所)
;
Soochow University(苏州大学)
LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
LocateAnything: 基于并行框解码的快速高质量视觉定位
Shihao Wang, Shilong Liu, Yuanguo Kuang, Xinyu Wei, Yangzhou Liu, Zhiqi Li, Yunze Man, Guo Chen, Andrew Tao, Guilin Liu, Jan Kautz, Lei Zhang, Zhiding Yu
机构
*
The Hong Kong Polytechnic University(香港理工大学)
;
Princeton University(普林斯顿大学)
;
Nanjing University(南京大学)
;
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
ASTRA: Communication-Efficient Acceleration for Multi-Device Transformer Inference
ASTRA:面向多设备Transformer推理的通信高效加速
Xiao Liu, Lijun Zhang, Deepak Ganesan, Hui Guan
机构
*
Manning College of Information and Computer Sciences, University of Massachusetts Amherst, MA, US(信息与计算机科学学院,马萨诸塞大学阿默斯特分校,马萨诸塞州,美国)
;
Amazon, Seattle, WA, US(亚马逊,华盛顿州西雅图,美国)
;
Amazon AWS, Washington, D.C., US(亚马逊AWS,华盛顿特区,美国)
Structure-Guided Visual Perturbation Neutralization for LVLMs
结构引导的视觉扰动中和用于大型视觉语言模型
Yuanhe Zhang, Xueting Wang, YanBin Ren, Haoran Gao, Xinhan Zheng, Zhenhong Zhou, Fanyu Meng, Li Sun, Sen Su
机构
*
Beijing University of Posts and Telecommunications(北京邮电大学)
;
University of Science and Technology of China(中国科学技术大学)
;
JIUTIAN Research(JIUTIAN研究所)
;
Nanyang Technological University(南洋理工大学)
;
Chongqing University of Posts and Telecommunications(重庆邮电大学)
机构
*
National Institute of Metrology, China(中国计量科学研究院)
;
University of California, Berkeley(加州大学伯克利分校)
;
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
;
Nanjing University of Chinese Medicine(南京中医药大学)
;
WEEX Exchange(WEEX交易所)
;
National University of Singapore(新加坡国立大学)
;
Wuhan University(武汉大学)
;
Peking University(北京大学)
Ligand-Conditioned Discrete Diffusion for Protein Sequence-Structure Co-Design
配体条件离散扩散用于蛋白质序列-结构协同设计
Chen Wei, Fanding Xu, Minghao Sun, Zhiyuan Liu, Lin Wang, Tianrui Jia, Yihang Zhou, Yang Zhang
机构
*
Xi’an University of Posts & Telecommunications(西安邮电大学)
;
National University of Singapore(新加坡国立大学)
;
Xi’an Jiaotong University(西安交通大学)
;
Institute of Systems Medicine, Chinese Academy of Medical Sciences(中国医学科学院系统医学研究院)
CommentsAll baseline tokenizers (BPE, WordPiece, Unigram) were trained incorrectly due to a bug in the Hugging Face tokenizers library: pair counts overflow i32 above ~108 GB of training data, dropping the most common merge pairs. All comparisons to ToaST are invalid. Thanks to Sander Land for identifying the missing merge pairs. See https://github.com/huggingface/tokenizers/issues/2058
Conditionally Site-Independent Neural Evolution of Antibody Sequences
抗体序列的条件性位点无关神经进化
Stephen Zhewen Lu, Aakarsh Vermani, Kohei Sanno, Jiarui Lu, Frederick A Matsen, Milind Jagota, Yun S. Song
机构
*
University of California, Berkeley
;
Columbia University
;
Mila - Qu \'e bec AI Institute
;
Fred Hutchinson Cancer Research Center
;
University of Washington
;
Howard Hughes Medical Institute