MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering
MemoryCard: 面向长视频问答的主题感知多模态线索压缩
机构 * School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院) ; Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系) ; Digital China Group(数字中国集团)
专题命中 视频问答 :long video(abstract);分类 cs.CV
AI总结 提出MemoryCard框架,通过将长视频分割为主题事件单元并生成事件级摘要和代表性视觉时刻,以记忆卡形式增强VLMs的长视频问答能力,在相同视觉令牌预算下准确率提升高达21.8%。
Comments 21 pages, 8 figures