多模态大模型

RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU

Chengyuan Liu, Shihang Wang, Fubang Zhao, Kun Kuang, Yangyang Kang, Weiming Lu, Changlong Sun, Fei Wu

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL

Comments arXiv admin note: substantial text overlap with arXiv:2304.14770

Structural Attention: Rethinking Transformer for Unpaired Medical Image Synthesis

Vu Minh Hieu Phan, Yutong Xie, Bowen Zhang, Yuankai Qi, Zhibin Liao, Antonios Perperidis, Son Lam Phung, Johan W. Verjans, Minh-Son To

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments MICCAI version before camera ready

VRCopilot: Authoring 3D Layouts with Generative AI Models in VR

Lei Zhang, Jin Pan, Jacob Gettig, Steve Oney, Anhong Guo

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments UIST 2024

Can ChatGPT assist visually impaired people with micro-navigation?

Junxian He, Shrinivas Pundlik, Gang Luo

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

ChatGPT Meets Iris Biometrics

Parisa Farmanifard, Arun Ross

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Published at IJCB 2024

Fairness and Bias Mitigation in Computer Vision: A Survey

Sepehr Dehdashtian, Ruozhen He, Yi Li, Guha Balakrishnan, Nuno Vasconcelos, Vicente Ordonez, Vishnu Naresh Boddeti

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments 20 pages, 4 figures

Fact :Teaching MLLMs with Faithful, Concise and Transferable Rationales

Minghe Gao, Shuang Chen, Liang Pang, Yuan Yao, Jisheng Dang, Wenqiao Zhang, Juncheng Li, Siliang Tang, Yueting Zhuang, Tat-Seng Chua

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Solving Short-Term Relocalization Problems In Monocular Keyframe Visual SLAM Using Spatial And Semantic Data

Azmyin Md. Kamal, Nenyi K. N. Dadson, Donovan Gegg, Corina Barbalata

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, Keywords: VSLAM, Localization, Semantics. Presented in 2024 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM)

Heads Up eXperience (HUX): Always-On AI Companion for Human Computer Environment Interaction

Sukanth K, Sudhiksha Kandavel Rajan, Rajashekhar V S, Gowdham Prabhakar

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 48 pages, 16 figures

Enabling On-Device LLMs Personalization with Smartphone Sensing

Shiquan Zhang, Ying Ma, Le Fang, Hong Jia, Simon D'Alfonso, Vassilis Kostakos

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments 5 pages, 3 figures, conference demo paper

OV-Uni3DETR: Towards Unified Open-Vocabulary 3D Object Detection via Cycle-Modality Propagation

Zhenyu Wang, Yali Li, Taichi Liu, Hengshuang Zhao, Shengjin Wang

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted by ECCV2024

DocParseNet: Advanced Semantic Segmentation and OCR Embeddings for Efficient Scanned Document Annotation

Ahmad Mohammadshirazi, Ali Nosrati Firoozsalari, Mengxi Zhou, Dheeraj Kulshrestha, Rajiv Ramnath

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

DISCOVER: A Data-driven Interactive System for Comprehensive Observation, Visualization, and ExploRation of Human Behaviour

Dominik Schiller, Tobias Hallmen, Daksitha Withanage Don, Elisabeth André, Tobias Baur

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detection

Zhenni Yu, Xiaoqin Zhang, Li Zhao, Yi Bin, Guobao Xiao

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments ACM MM 2024

Scaling 3D Reasoning with LMMs to Large Robot Mission Environments Using Datagraphs

W. J. Meijer, A. C. Kemmeren, E. H. J. Riemens, J. E. Fransman, M. van Bekkum, G. J. Burghouts, J. D. van Mil

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments Accepted to the RSS Workshop on Semantics for Robotics: From Environment Understanding and Reasoning to Safe Interaction 2024

Emotion Detection through Body Gesture and Face

Haoyang Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments 25 pages, 4 figures

Towards Context-aware Support for Color Vision Deficiency: An Approach Integrating LLM and AR

Shogo Morita, Yan Zhang, Takuto Yamauchi, Sinan Chen, Jialong Li, Kenji Tei

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)

Yashar Deldjoo, Zhankui He, Julian McAuley, Anton Korikov, Scott Sanner, Arnau Ramisa, René Vidal, Maheswaran Sathiamoorthy, Atoosa Kasirzadeh, Silvia Milano

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments This survey accompanies a tutorial presented at ACM KDD'24

Mapping Land Naturalness from Sentinel-2 using Deep Contextual and Geographical Priors

Burak Ekim, Michael Schmitt

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 6 pages, 3 figures, ICLR 2024 Tackling Climate Change with Machine Learning Workshop

Enhancing Continual Learning in Visual Question Answering with Modality-Aware Feature Distillation

Malvina Nikandrou, Georgios Pantazopoulos, Ioannis Konstas, Alessandro Suglia

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE)

Daniel Sonntag, Michael Barz, Thiago Gouvêa

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments DFKI Technical Report

Perceiver-based CDF Modeling for Time Series Forecasting

Cat P. Le, Chris Cannella, Ali Hasan, Yuting Ng, Vahid Tarokh

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments Accepted in Winter Simulation Conference 2024

Guardrails for avoiding harmful medical product recommendations and off-label promotion in generative AI models

Daniel Lopez-Martinez

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments CVPR 2024 Responsible Generative AI (ReGenAI) workshop

Implementing engrams from a machine learning perspective: XOR as a basic motif

Jesus Marco de Lucas, Maria Peña Fernandez, Lara Lloret Iglesias

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments 9 pages, short comment

DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs

Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project Page: https://deepstack-vl.github.io/

Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics

Haoyang Zheng, Hengrong Du, Qi Feng, Wei Deng, Guang Lin

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 28 pages, 13 figures

Panmodal Information Interaction

Chirag Shah, Ryen W. White

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Cross-spectral Gated-RGB Stereo Depth Estimation

Samuel Brucker, Stefanie Walz, Mario Bijelic, Felix Heide

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

A Versatile Framework for Analyzing Galaxy Image Data by Implanting Human-in-the-loop on a Large Vision Model

Mingxiang Fu, Yu Song, Jiameng Lv, Liang Cao, Peng Jia, Nan Li, Xiangru Li, Jifeng Liu, A-Li Luo, Bo Qiu, Shiyin Shen, Liangping Tu, Lili Wang, Shoulin Wei, Haifeng Yang, Zhenping Yi, Zhiqiang Zou

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments 26 pages, 10 figures, to be published on Chinese Physics C

Cross-domain Learning Framework for Tracking Users in RIS-aided Multi-band ISAC Systems with Sparse Labeled Data

Jingzhi Hu, Dusit Niyato, Jun Luo

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI