多模态大模型

Progress and Opportunities of Foundation Models in Bioinformatics

Qing Li, Zhihang Hu, Yixuan Wang, Lei Li, Yimin Fan, Irwin King, Le Song, Yu Li

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments 27 pages, 3 figures, 2 tables

Preliminary Report on Mantis Shrimp: a Multi-Survey Computer Vision Photometric Redshift Model

Andrew Engel, Gautham Narayan, Nell Byler

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 4 pages, 1 figure, 1 table. Submitted to AI4Differential Equations in Science Workshop at ICLR24. Public repository unavailable while under institutional review

ViT-DD: Multi-Task Vision Transformer for Semi-Supervised Driver Distraction Detection

Yunsheng Ma, Ziran Wang

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 7 pages, 3 figures, 2 tables

A general framework for rotation invariant point cloud analysis

Shuqing Luo, Wei Gao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 5 pages, 1 figure, accepted by ICASSP 2024

Let's Negotiate! A Survey of Negotiation Dialogue Systems

Haolan Zhan, Yufei Wang, Tao Feng, Yuncheng Hua, Suraj Sharma, Zhuang Li, Lizhen Qu, Zhaleh Semnani Azad, Ingrid Zukerman, Gholamreza Haffari

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL

Comments Accepted by EACL 2024 (findings). arXiv admin note: substantial text overlap with arXiv:2212.09072

In-Bed Pose Estimation: A Review

Ziya Ata Yazıcı, Sara Colantonio, Hazım Kemal Ekenel

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted at HCCS24 Workshop @ International Conference on Pervasive Computing and Communications (PerCom 2024)

Autonomous Catheterization with Open-source Simulator and Expert Trajectory

Tudor Jianu, Baoru Huang, Tuan Vo, Minh Nhat Vu, Jingxuan Kang, Hoan Nguyen, Olatunji Omisore, Pierre Berthet-Rayne, Sebastiano Fichera, Anh Nguyen

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Code: https://github.com/airvlab/cathsim

Exploring of Discrete and Continuous Input Control for AI-enhanced Assistive Robotic Arms

Max Pascher, Kevin Zinta, Jens Gerken

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction

Singing the Body Electric: The Impact of Robot Embodiment on User Expectations

Nathaniel Dennler, Stefanos Nikolaidis, Maja Matarić

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments Presented at the RSS Workshop on Social Intelligence in Humans and Robots, 2023

Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directions

Yichi Zhang, Zhenrong Shen, Rushi Jiao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Learning Deformable Hypothesis Sampling for Accurate PatchMatch Multi-View Stereo

Hongjie Li, Yao Guo, Xianwei Zheng, Hanjiang Xiong

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Exploring the intersection of Generative AI and Software Development

Filipe Calegario, Vanilson Burégio, Francisco Erivaldo, Daniel Moraes Costa Andrade, Kailane Felix, Nathalia Barbosa, Pedro Lucas da Silva Lucena, César França

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

SimQ-NAS: Simultaneous Quantization Policy and Neural Architecture Search

Sharath Nittur Sridhar, Maciej Szankin, Fang Chen, Sairam Sundaresan, Anthony Sarah

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Revealing Networks: Understanding Effective Teacher Practices in AI-Supported Classrooms using Transmodal Ordered Network Analysis

Conrad Borchers, Yeyu Wang, Shamya Karumbaiah, Muhammad Ashiq, David Williamson Shaffer, Vincent Aleven

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments Full paper accepted to Learning Analytics and Knowledge (LAK 2024)

Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization

Xuan Long Do, Mohammad Hassanpour, Ahmed Masry, Parsa Kavehzadeh, Enamul Hoque, Shafiq Joty

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL

Comments 23 pages

General Object Foundation Model for Images and Videos at Scale

Junfeng Wu, Yi Jiang, Qihao Liu, Zehuan Yuan, Xiang Bai, Song Bai

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Project homepage: https://glee-vision.github.io

Converting Depth Images and Point Clouds for Feature-based Pose Estimation

Robert Lösch, Mark Sastuba, Jonas Toth, Bernhard Jung

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments to be published in IROS 2023 conference proceedings

S2P3: Self-Supervised Polarimetric Pose Prediction

Patrick Ruhkamp, Daoyi Gao, Nassir Navab, Benjamin Busam

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted at IJCV

Bayesian Learning with Information Gain Provably Bounds Risk for a Robust Adversarial Defense

Bao Gia Doan, Ehsan Abbasnejad, Javen Qinfeng Shi, Damith C. Ranasinghe

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Published at ICML 2022. Code is available at https://github.com/baogiadoan/IG-BNN

Journal ref Proceedings of the 39th International Conference on Machine Learning, PMLR 162:5309-5323, 2022

Test-Time Adaptation for Nighttime Color-Thermal Semantic Segmentation

Yexin Liu, Weiming Zhang, Guoyang Zhao, Jinjing Zhu, Athanasios Vasilakos, Lin Wang

专题命中 其他多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to IEEE Transactions on Artificial Intelligence

Machine Learning-Enhanced Aircraft Landing Scheduling under Uncertainties

Yutian Pang, Peng Zhao, Jueming Hu, Yongming Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

An Intelligent Remote Sensing Image Quality Inspection System

Yijiong Yu, Tao Wang, Kang Ran, Chang Li, Hao Wu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Improving Vision-and-Language Reasoning via Spatial Relations Modeling

Cheng Yang, Rui Xu, Ye Guo, Peixiang Huang, Yiru Chen, Wenkui Ding, Zhongyuan Wang, Hong Zhou

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Discret2Di -- Deep Learning based Discretization for Model-based Diagnosis

Lukas Moddemann, Henrik Sebastian Steude, Alexander Diedrich, Oliver Niggemann

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection

Weijia Zhang, Dongnan Liu, Chao Ma, Weidong Cai

专题命中 其他多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by WACV 2024

Sculpting Efficiency: Pruning Medical Imaging Models for On-Device Inference

Sudarshan Sreeram, Bernhard Kainz

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted at MedNeurIPS 2023

MOSEL: Inference Serving Using Dynamic Modality Selection

Bodun Hu, Le Xu, Jeongyoon Moon, Neeraja J. Yadwadkar, Aditya Akella

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images

Wei Lou, Xinyi Yu, Chenyu Liu, Xiang Wan, Guanbin Li, Siqi Liu, Haofeng Li

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments The second place in NeurIPS 2022 cell segmentation challenge (https://neurips22-cellseg.grand-challenge.org/), released code: https://github.com/lhaof/CellSeg

Solving multiphysics-based inverse problems with learned surrogates and constraints

Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors

Gaurav Datta, Ryan Hoque, Anrui Gu, Eugen Solowjow, Ken Goldberg

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Comments CoRL 2023