Scaling the Long Video Understanding of Multimodal Large Language Models via Visual Memory Mechanism
通过视觉记忆机制扩展多模态大语言模型的长视频理解
Tao Chen, Kun Zhang, Qiong Wu, Xiao Chen, Chao Chang, Xiaoshuai Sun, Yiyi Zhou, Rongrong Ji
机构
*
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(厦门大学多媒体可信感知与高效计算教育部重点实验室)
;
National University of Defense Technology(国防科技大学)
专题命中
长上下文与记忆
:large language model(title,abstract);language model(title,abstract);分类 cs.AI
Not All News Is Equal: Topic- and Event-Conditional Sentiment from Finetuned LLMs for Aluminum Price Forecasting
并非所有新闻都同等重要:基于微调LLM的专题和事件条件情绪用于铝价预测
Alvaro Paredes Amorin, Andre Python, Christoph Weisser
机构
*
International Business School, Zhejiang University(浙江大学国际商学院)
;
Center for Data Science, Zhejiang University(浙江大学数据科学中心)
;
Centre for Human Genetics, Nuffield Department of Medicine, Oxford University(牛津大学纳菲尔德医学部人类遗传学中心)
;
School of Medicine, Zhejiang University(浙江大学医学院)
;
Bielefeld School of Business, Hochschule Bielefeld (HSBI) - University of Applied Sciences and Arts(比勒费尔德应用科学大学比勒费尔德商学院)
专题命中
长上下文与记忆
:large language model(abstract);language model(abstract);分类 cs.AI、cs.LG
Tucker Attention: A generalization of approximate attention mechanisms
Tucker Attention: 多头自注意机制近似机制的推广
Timon Klein, Jonas Kusch, Sebastian Sager, Stefan Schnake, Steffen Schotthöfer
机构
*
Otto von Guericke University Magdeburg(奥托·冯·格里克大学马格德堡)
;
Max Planck Institute for Dynamics of Complex Technical Systems(马克斯·普朗克复杂技术系统动力学研究所)
;
Norwegian University of Life Sciences(挪威生命科学大学)
;
Oak Ridge National Laboratory(橡树岭国家实验室)
Know-Show: Benchmarking Video-Language Models on Spatio-Temporal Grounded Reasoning
Know-Show:在时空 grounded 推理上评估视频语言模型的基准测试
Chinthani Sugandhika, Chen Li, Deepu Rajan, Basura Fernando
机构
*
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
;
Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所)
;
Centre for Frontier AI Research, Agency for Science, Technology and Research(新加坡科技研究局前沿人工智能研究中心)
机构
*
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
;
Southeast University(东南大学)
;
Beijing University of Posts and Telecommunications(北京邮电大学)
;
National University of Singapore(新加坡国立大学)
;
Wuhan AI Research(武汉人工智能研究院)
;
Guangdong Provincial Key Laboratory of Intellectual Property and Big Data, Guangdong Polytechnic Normal University(广东技术师范大学广东省知识产权大数据重点实验室)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);prompting(abstract)