多模态大模型

Quizzard@INOVA Challenge 2025 -- Track A: Plug-and-Play Technique in Interleaved Multi-Image Model

Dinh Viet Cuong, Hoang-Bao Le, An Pham Ngoc Nguyen, Liting Zhou, Cathal Gurrin

机构 * School of Computing, Dublin City University（都柏林城市大学计算机学院） ； ADAPT Centre（ADAPT中心） 纠错

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL、cs.MM

Retrospective Learning from Interactions

Zizhao Chen, Mustafa Omer Gul, Yiwei Chen, Gloria Geng, Anne Wu, Yoav Artzi

机构 * Department of Computer Science and Cornell Tech, Cornell University（计算机科学系和康奈尔科技学院，康奈尔大学） 纠错

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

A Clinical Tuning Framework for Continuous Kinematic and Impedance Control of a Powered Knee-Ankle Prosthesis

Emma Reznick, T. Kevin Best, Robert Gregg

机构 * IEEE 纠错

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Comments Published in IEEE JTEHM. IEEE Journal of Translational Engineering in Health and Medicine (2025)

SE(3)-Equivariant Robot Learning and Control: A Tutorial Survey

Joohwan Seo, Soochul Yoo, Junwoo Chang, Hyunseok An, Hyunwoo Ryu, Soomi Lee, Arvind Kruthiventy, Jongeun Choi, Roberto Horowitz

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Comments Accepted to International Journcal of Control, Automation and Systems (IJCAS)

Data Metabolism: An Efficient Data Design Schema For Vision Language Model

Jingyuan Zhang, Hongzhi Zhang, Zhou Haonan, Chenxi Sun, Xingguang ji, Jiakang Wang, Fanheng Kong, Yahui Liu, Qi Wang, Fuzheng Zhang

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments To be presented at ICLR 2025, First Workshop on Open Science for Foundation Models

VGA: Vision and Graph Fused Attention Network for Rumor Detection

Lin Bai, Caiyan Jia, Ziying Song, Chaoqun Cui

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.MM

CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements

Afshin Khadangi, Amir Sartipi, Igor Tchappi, Gilbert Fridgen

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

GIRAFFE: Design Choices for Extending the Context Length of Visual Language Models

Mukai Li, Lei Li, Shansan Gong, Qi Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Working in progress

DuetML: Human-LLM Collaborative Machine Learning Framework for Non-Expert Users

Wataru Kawabe, Yusuke Sugano

专题命中 其他多模态 ：multimodal(abstract)；MLLM(abstract)

Comments 22 pages, 10 figures

'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue

Rena Gao, Xuetong Wu, Siwen Luo, Caren Han, Feng Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI、cs.MM

Comments 16 pages, 5 figures

Conditional Neural Expert Processes for Learning Movement Primitives from Demonstration

Yigit Yildirim, Emre Ugur

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Comments This work has been submitted to the IEEE RA-L for possible publication. Submitted to Robotics and Automation Letters on July 5, 2024

Social Media Bot Policies: Evaluating Passive and Active Enforcement

Kristina Radivojevic, Christopher McAleer, Catrell Conley, Cormac Kennedy, Paul Brenner

专题命中 其他多模态 ：multimodal(abstract)；multimodal foundation model(abstract)

Identifying Terrain Physical Parameters from Vision -- Towards Physical-Parameter-Aware Locomotion and Navigation

Jiaqi Chen, Jonas Frey, Ruyi Zhou, Takahiro Miki, Georg Martius, Marco Hutter

专题命中 其他多模态 ：multi-modal(abstract)；cross-modal(abstract)

No winners: Performance of lung cancer prediction models depends on screening-detected, incidental, and biopsied pulmonary nodule use cases

Thomas Z. Li, Kaiwen Xu, Aravind Krishnan, Riqiang Gao, Michael N. Kammer, Sanja Antic, David Xiao, Michael Knight, Yency Martinez, Rafael Paez, Robert J. Lentz, Stephen Deppen, Eric L. Grogan, Thomas A. Lasko, Kim L. Sandler, Fabien Maldonado, Bennett A. Landman

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Comments Submitted to Radiology: AI

All in an Aggregated Image for In-Image Learning

Lei Wang, Wanyu Xu, Zhiqiang Hu, Yihuai Lan, Shan Dong, Hao Wang, Roy Ka-Wei Lee, Ee-Peng Lim

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Preprint

Visual AI and Linguistic Intelligence Through Steerability and Composability

David Noever, Samantha Elizabeth Miller Noever

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V

Jianwei Yang, Hao Zhang, Feng Li, Xueyan Zou, Chunyuan Li, Jianfeng Gao

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge

Xingyu Fu, Sheng Zhang, Gukyeong Kwon, Pramuditha Perera, Henghui Zhu, Yuhao Zhang, Alexander Hanbo Li, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Dan Roth, Bing Xiang

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted to ACL 2023 Findings

VIRDO++: Real-World, Visuo-tactile Dynamics and Perception of Deformable Objects

Youngsun Wi, Andy Zeng, Pete Florence, Nima Fazeli

专题命中 其他多模态 ：multimodal(abstract)；cross-modal(abstract)

Continuously-Tempered PDMP Samplers

Matthew Sutton, Robert Salomone, Augustin Chevallier, Paul Fearnhead

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Information Symmetry Matters: A Modal-Alternating Propagation Network for Few-Shot Learning

Zhong Ji, Zhishen Hou, Xiyao Liu, Yanwei Pang, Jungong Han

专题命中 其他多模态 ：cross-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

SCENIC: A JAX Library for Computer Vision Research and Beyond

Mostafa Dehghani, Alexey Gritsenko, Anurag Arnab, Matthias Minderer, Yi Tay

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

Detecting Propaganda Techniques in Memes

Dimitar Dimitrov, Bishr Bin Ali, Shaden Shaar, Firoj Alam, Fabrizio Silvestri, Hamed Firooz, Preslav Nakov, Giovanni Da San Martino

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.MM

Comments propaganda, disinformation, fake news, memes, multimodality. arXiv admin note: text overlap with arXiv:2105.09284

Journal ref ACL-2021

Cetacean Translation Initiative: a roadmap to deciphering the communication of sperm whales

Jacob Andreas, Gašper Beguš, Michael M. Bronstein, Roee Diamant, Denley Delaney, Shane Gero, Shafi Goldwasser, David F. Gruber, Sarah de Haas, Peter Malkin, Roger Payne, Giovanni Petri, Daniela Rus, Pratyusha Sharma, Dan Tchernov, Pernille Tønnesen, Antonio Torralba, Daniel Vogt, Robert J. Wood

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI、eess.AS

Visual Methods for Sign Language Recognition: A Modality-Based Review

Bassem Seddik, Najoua Essoukri Ben Amara

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI、cs.MM

Comments This survey paper is accepted as Springer book chapter, currently under edition

Look, Read and Enrich. Learning from Scientific Figures and their Captions

Jose Manuel Gomez-Perez, Raul Ortega

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted in the 10th International Conference on Knowledge capture (K-CAP 2019)

Is the Red Square Big? MALeViC: Modeling Adjectives Leveraging Visual Contexts

Sandro Pezzelle, Raquel Fernández

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted at EMNLP-IJCNLP 2019

Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering

Aishwarya Agrawal, Dhruv Batra, Devi Parikh, Aniruddha Kembhavi

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL、cs.AI

Comments 15 pages, 10 figures. To appear in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

Generalized Shared Control versus Classical Shared Control: Illustrative Examples

Pete Trautman

专题命中 其他多模态 ：multimodal(abstract)；multi-modal(abstract)

Humor in Collective Discourse: Unsupervised Funniness Detection in the New Yorker Cartoon Caption Contest

Dragomir Radev, Amanda Stent, Joel Tetreault, Aasish Pappu, Aikaterini Iliakopoulou, Agustin Chanfreau, Paloma de Juan, Jordi Vallmitjana, Alejandro Jaimes, Rahul Jha, Bob Mankoff

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL、cs.AI、cs.MM

Comments 10 pages, in submission