Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency Without Model Sweeps
混合测度的树状图用于Softmax门控高斯混合专家:无需模型扫描的一致性
机构 * Faculty of Mathematics and Computer Science, University of Science, Ho Chi Minh City, Vietnam(越南胡志明市科学大学数学与计算机科学学院) ; Vietnam National University Ho Chi Minh City, Vietnam(越南胡志明市国家大学) ; Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam(越南胡志明市科学大学信息技术学院) ; ARC Centre of Excellence for the Mathematical Analysis of Cellular Systems(细胞系统数学分析 excellence 中心) ; School of Mathematical Sciences, Queensland University of Technology, Brisbane City, Australia(昆士兰科技大学数学科学学院) ; Department of Statistics and Data Science, University of Texas at Austin, Austin, USA(德克萨斯大学奥斯汀分校统计与数据科学系)
AI总结 针对softmax门控高斯混合专家模型,提出基于Voronoi损失函数的统一统计框架,解决参数非可识别性和模型选择问题,并引入混合测度树状图实现一致且无需多尺寸训练的专家数选择。
Comments Do Tien Hai, Trung Nguyen Mai, and TrungTin Nguyen are co-first authors. In Proceedings of The 29th International Conference on Artificial Intelligence and Statistics, AISTATS 2026 Spotlight, Acceptance rate 2.5% over 2102 submissions