视觉大模型 / VLM

Language Embedded Radiance Fields for Zero-Shot Task-Oriented Grasping

Adam Rashid, Satvik Sharma, Chung Min Kim, Justin Kerr, Lawrence Chen, Angjoo Kanazawa, Ken Goldberg

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments See the project website at: lerftogo.github.io

Implicit Neural Representation for Cooperative Low-light Image Enhancement

Shuzhou Yang, Moxuan Ding, Yanmin Wu, Zihan Li, Jian Zhang

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Gradient-Based Word Substitution for Obstinate Adversarial Examples Generation in Language Models

Yimu Wang, Peng Shi, Hongyang Zhang

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.AI

Comments 19 pages

Visual Adversarial Examples Jailbreak Aligned Large Language Models

Xiangyu Qi, Kaixuan Huang, Ashwinee Panda, Peter Henderson, Mengdi Wang, Prateek Mittal

专题命中 幻觉与鲁棒性 ：visual language model(abstract)；分类 cs.LG

Transferable Decoding with Visual Entities for Zero-Shot Image Captioning

Junjie Fei, Teng Wang, Jinrui Zhang, Zhenyu He, Chengjie Wang, Feng Zheng

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments Accepted by ICCV 2023

Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment

Yongrae Jo, Seongyun Lee, Aiden SJ Lee, Hyunji Lee, Hanseok Oh, Minjoon Seo

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Pick your Poison: Undetectability versus Robustness in Data Poisoning Attacks

Nils Lukas, Florian Kerschbaum

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.LG

Comments Preprint

Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions

Ian Huang, Vrishab Krishna, Omoruyi Atekha, Leonidas Guibas

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks

Haiyang Xu, Qinghao Ye, Xuan Wu, Ming Yan, Yuan Miao, Jiabo Ye, Guohai Xu, Anwen Hu, Yaya Shi, Guangwei Xu, Chenliang Li, Qi Qian, Maofei Que, Ji Zhang, Xiao Zeng, Fei Huang

专题命中 幻觉与鲁棒性 ：multimodal large language model(abstract)；分类 cs.CV

Comments Working in progress

Balancing the Picture: Debiasing Vision-Language Datasets with Synthetic Contrast Sets

Brandon Smith, Miguel Farinha, Siobhan Mackenzie Hall, Hannah Rose Kirk, Aleksandar Shtedritski, Max Bain

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments Github: https://github.com/oxai/debias-gensynth

Understanding Zero-Shot Adversarial Robustness for Large-Scale Models

Chengzhi Mao, Scott Geng, Junfeng Yang, Xin Wang, Carl Vondrick

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

KD-DLGAN: Data Limited Image Generation via Knowledge Distillation

Kaiwen Cui, Yingchen Yu, Fangneng Zhan, Shengcai Liao, Shijian Lu1, Eric Xing

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Journal ref CVPR2023

The Myth of Culturally Agnostic AI Models

Eva Cetinic

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.AI

Comments Accepted for "Cultures in AI/AI in Culture" NeurIPS 2022 Workshop

Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination

Yue Yang, Wenlin Yao, Hongming Zhang, Xiaoyang Wang, Dong Yu, Jianshu Chen

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments EMNLP 2022

GAMA: Generative Adversarial Multi-Object Scene Attacks

Abhishek Aich, Calvin-Khang Ta, Akash Gupta, Chengyu Song, Srikanth V. Krishnamurthy, M. Salman Asif, Amit K. Roy-Chowdhury

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments Accepted at NeurIPS 2022; First two authors contributed equally; Includes Supplementary Material

On Modality Bias Recognition and Reduction

Yangyang Guo, Liqiang Nie, Harry Cheng, Zhiyong Cheng, Mohan Kankanhalli, Alberto Del Bimbo

专题命中 幻觉与鲁棒性 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by ToMM

Prompt Distribution Learning

Yuning Lu, Jianzhuang Liu, Yonggang Zhang, Yajing Liu, Xinmei Tian

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments Accepted by CVPR 2022

Domain Adaptation via Prompt Learning

Chunjiang Ge, Rui Huang, Mixue Xie, Zihang Lai, Shiji Song, Shuang Li, Gao Huang

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Comments 10 pages, 5 figures

LaMDA: Language Models for Dialog Applications

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, Quoc Le

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.AI

High-Performance FPGA-based Accelerator for Bayesian Neural Networks

Hongxiang Fan, Martin Ferianc, Miguel Rodrigues, Hongyu Zhou, Xinyu Niu, Wayne Luk

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.LG

Comments Design Automation Conference (DAC) 2021

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models

Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu

专题命中 幻觉与鲁棒性 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in ICCV 2021; Website: https://adversarialvqa.github.io/

Reinforcement Learning Under Moral Uncertainty

Adrien Ecoffet, Joel Lehman

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.AI

Comments 28 pages, 18 figures; update adds discussion of a possible flaw of Nash voting, discussion of further possible research into MEC, as well as a few more references; updated to ICML version

Scaffolded Learning of In-place Trotting Gait for a Quadruped Robot with Bayesian Optimization

Keyan Zhai, Chu'an Li, Andre Rosendo

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.LG

Comments 9 pages, 6 figures, 16-th International Conference on Intelligent Autonomous System (IAS-16)

Causal Attention for Vision-Language Tasks

Xu Yang, Hanwang Zhang, Guojun Qi, Jianfei Cai

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

Adversarial Representation Learning for Text-to-Image Matching

Nikolaos Sarafianos, Xiang Xu, Ioannis A. Kakadiaris

专题命中 幻觉与鲁棒性 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in ICCV 2019

Adversarial Attacks Beyond the Image Space

Xiaohui Zeng, Chenxi Liu, Yu-Siang Wang, Weichao Qiu, Lingxi Xie, Yu-Wing Tai, Chi Keung Tang, Alan L. Yuille

专题命中 幻觉与鲁棒性 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in CVPR 2019 as oral

Learning Visually-Grounded Semantics from Contrastive Adversarial Samples

Haoyue Shi, Jiayuan Mao, Tete Xiao, Yuning Jiang, Jian Sun

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.CV

Comments To Appear at COLING 2018

Strength Factors: An Uncertainty System for a Quantified Modal Logic

Naveen Sundar Govindarajulu, Selmer Bringsjord

专题命中 幻觉与鲁棒性 ：grounding(abstract)；分类 cs.AI

Comments Presented on August 20, 2017 at the Logical Foundations for Uncertainty and Machine Learning Workshop @ IJCAI 2017 in Melbourne, Australia

Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging

Yuzhe Yang, Yujia Liu, Xin Liu, Avanti Gulhane, Domenico Mastrodicasa, Wei Wu, Edward J Wang, Dushyant W Sahani, Shwetak Patel

专题命中 幻觉与鲁棒性 ：分类 cs.CV、cs.AI、cs.LG；VLM(comments)

Comments Code and data are available at https://github.com/YyzHarry/vlm-fairness

Reducing Technician Search Burden: A Multimodal RAG for Cessna 172 Maintenance Manual

减轻技术人员的检索负担：面向赛斯纳172维护手册的多模态检索增强生成

Seongjun Ha, Md Rashedul Islam, Gaurav Nanda, Damon Lercel

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)

AI总结 本研究针对赛斯纳172维护手册，开发多模态检索增强生成流程，其多模态手册检索器召回率达93.37%，生成响应与基准答案语义相似度87.20%，可减轻技术人员检索负担。