Two Sides of the Same Coin: Co-Evolving Search for Cross-Task Attacks on Vision-Language Models
同一硬币的两面:面向视觉-语言模型跨任务攻击的协同演化搜索
机构 * College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院) ; Center for Frontier AI Research, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局前沿人工智能研究中心) ; School of Electrical Engineering and Automation, Fuzhou University(福州大学电气工程与自动化学院) ; ByteDance(字节跳动)
专题命中 效率与部署 :language model(title,abstract)
AI总结 针对视觉-语言模型易受对抗扰动的问题,提出协同演化跨模态攻击框架,联合优化文本与视觉空间,在多任务上展现出强攻击性能与跨任务可迁移性。
Comments 15 pages, 7 figures, and 8 tables; includes supplementary material