RSGMamba: Reliability-Aware Self-Gated State Space Model for Multimodal Semantic Segmentation
RSGMamba:面向多模态语义分割的可靠性感知自门控状态空间模型
机构 * Faculty of Engineering and Information Technology, University of Technology Sydney(工程与信息技术学院,悉尼技术大学) ; PCA Lab, Key Laboratory of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(教育部高维信息智能感知与系统重点实验室,南京理工大学计算机科学与工程学院) ; Bionic Vision Systems Laboratory, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences(中国科学院上海微系统与信息技术研究所生物视觉系统实验室) ; Research Center for Industries of the Future and the School of Engineering, Westlake University(未来产业研究中心和工程学院,西湖大学) ; OPPO Research, Seattle, WA 98101 USA(OPPO研究,美国华盛顿州西雅图98101)
AI总结 本文提出RSGMamba框架,通过可靠性感知自门控机制提升多模态语义分割性能,实验表明其在RGB-D和RGB-T基准上取得最优结果,参数量仅48.6M。
Comments 7tables,9 figures