多模态大模型

Framework for developing and evaluating ethical collaboration between expert and machine

Ayan Banerjee, Payal Kamboj, Sandeep Gupta

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted in ECAI Workshop AIEB

IQLS: Framework for leveraging Metadata to enable Large Language Model based queries to complex, versatile Data

Sami Azirar, Hossam A. Gabbar, Chaouki Regoui

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

FinVision: A Multi-Agent Framework for Stock Market Prediction

Sorouralsadat Fatemi, Yuheng Hu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Accepted at ICAIF 2024

Towards Low-Resource Harmful Meme Detection with LMM Agents

Jianzhao Huang, Hongzhan Lin, Ziyan Liu, Ziyang Luo, Guang Chen, Jing Ma

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments EMNLP 2024

Pixel State Value Network for Combined Prediction and Planning in Interactive Environments

Sascha Rosbach, Stefan M. Leupold, Simon Großjohann, Stefan Roth

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication

Frontier AI Ethics: Anticipating and Evaluating the Societal Impacts of Language Model Agents

Seth Lazar

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Rapid and Automated Alloy Design with Graph Neural Network-Powered LLM-Driven Multi-Agent Systems

Alireza Ghafarollahi, Markus J. Buehler

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

DeMo: Decoupling Motion Forecasting into Directional Intentions and Dynamic States

Bozhou Zhang, Nan Song, Li Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments NeurIPS 2024

ActPlan-1K: Benchmarking the Procedural Planning Ability of Visual Language Models in Household Activities

Ying Su, Zhan Ling, Haochen Shi, Jiayang Cheng, Yauwai Yim, Yangqiu Song

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

Comments 13 pages, 9 figures, 8 tables, accepted to EMNLP 2024 main conference

SELU: Self-Learning Embodied MLLMs in Unknown Environments

Boyu Li, Haobin Jiang, Ziluo Ding, Xinrun Xu, Haoran Li, Dongbin Zhao, Zongqing Lu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Data Analysis in the Era of Generative AI

Jeevana Priya Inala, Chenglong Wang, Steven Drucker, Gonzalo Ramos, Victor Dibia, Nathalie Riche, Dave Brown, Dan Marshall, Jianfeng Gao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Conversational Health Agents: A Personalized LLM-Powered Agent Framework

Mahyar Abbasian, Iman Azimi, Amir M. Rahmani, Ramesh Jain

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments 23 pages, 6 figures, 2 tables, 4 appendices, journal paper

Cog-GA: A Large Language Models-based Generative Agent for Vision-Language Navigation in Continuous Environments

Zhiyuan Li, Yanfeng Lu, Yao Mu, Hong Qiao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Human-Centered LLM-Agent User Interface: A Position Paper

Daniel Chin, Yuxuan Wang, Gus Xia

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Case

Peng Chen, Pi Bu, Jun Song, Yuan Gao, Bo Zheng

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Representing Positional Information in Generative World Models for Object Manipulation

Stefano Ferraro, Pietro Mazzaglia, Tim Verbelen, Bart Dhoedt, Sai Rajeswar

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

multiPI-TransBTS: A Multi-Path Learning Framework for Brain Tumor Image Segmentation Based on Multi-Physical Information

Hongjun Zhu, Jiaohang Huang, Kuo Chen, Xuehui Ying, Ying Qian

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

MVLLaVA: An Intelligent Agent for Unified and Flexible Novel View Synthesis

Hanyu Jiang, Jian Xue, Xing Lan, Guohong Hu, Ke Lu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments project page: https://jamesjg.github.io/MVLLaVA_homepage/

A Study on Prompt Injection Attack Against LLM-Integrated Mobile Robotic Systems

Wenxiao Zhang, Xiangrui Kong, Conan Dewitt, Thomas Braunl, Jin B. Hong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systems

Wenxiao Zhang, Xiangrui Kong, Thomas Braunl, Jin B. Hong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

VAAD: Visual Attention Analysis Dashboard applied to e-Learning

Miriam Navarro, Álvaro Becerra, Roberto Daza, Ruth Cobos, Aythami Morales, Julian Fierrez

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Published in IEEE Intl. Symposium on Computers in Education (SIIE) 2024

Intelligent OPC Engineer Assistant for Semiconductor Manufacturing

Guojin Chen, Haoyu Yang, Bei Yu, Haoxing Ren

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

MEDCO: Medical Education Copilots Based on A Multi-Agent Framework

Hao Wei, Jianing Qiu, Haibao Yu, Wu Yuan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Journal ref ECCV 2024 Workshop

Imagining from Images with an AI Storytelling Tool

Edirlei Soares de Lima, Marco A. Casanova, Antonio L. Furtado

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments

Sangwoo Shin, Seunghyun Kim, Youngsoo Jang, Moontae Lee, Honguk Woo

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Findings of ACL-2024 Camera Ready Version

Robustness-Aware 3D Object Detection in Autonomous Driving: A Review and Outlook

Ziying Song, Lin Liu, Feiyang Jia, Yadan Luo, Guoxin Zhang, Lei Yang, Li Wang, Caiyan Jia

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Egocentric Vision Language Planning

Zhirui Fang, Ming Yang, Weishuai Zeng, Boyu Li, Junpeng Yue, Ziluo Ding, Xiu Li, Zongqing Lu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Body of Her: A Preliminary Study on End-to-End Humanoid Agent

Tenglong Ao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Technical Report v1; Project Page: https://aubrey-ao.github.io/BodyOfHer

CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving

Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang, Iman Soltani, Junshan Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang contributed equally

PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch

Riku Arakawa, Hiromu Yakura, Mayank Goel

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments conditionally accepted to ACM UIST 2024