多模态大模型

MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems

Markus J. Buehler

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imaging

Zeyu Cai, Can Zhang, Xunhao Chen, Shanghuan Liu, Chengqian Jin, Feipeng Da

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2308.01541

Primitive Simultaneous Optimization of Similarity Metrics for Image Registration

Diana Waldmannstetter, Benedikt Wiestler, Julian Schwarting, Ivan Ezhov, Marie Metz, Spyridon Bakas, Bhakti Baheti, Satrajit Chakrabarty, Daniel Rueckert, Jan S. Kirschke, Rolf A. Heckemann, Marie Piraud, Bjoern H. Menze, Florian Kofler

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection

Junyu Luo, Jiahui Fu, Xianghao Kong, Chen Gao, Haibing Ren, Hao Shen, Huaxia Xia, Si Liu

专题命中 其他多模态 ：cross-modal(abstract)；分类 cs.CV

Comments CVPR 2022, Oral

Argumentative Stance Prediction: An Exploratory Study on Multimodality and Few-Shot Learning

Arushi Sharma, Abhibha Gupta, Maneesh Bilalpur

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CL

VerifAI: Verified Generative AI

Nan Tang, Chenyu Yang, Ju Fan, Lei Cao, Yuyu Luo, Alon Halevy

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL

Comments 8 pages, 4 figures

Artificial Intelligence Index Report 2023

Nestor Maslej, Loredana Fattorini, Erik Brynjolfsson, John Etchemendy, Katrina Ligett, Terah Lyons, James Manyika, Helen Ngo, Juan Carlos Niebles, Vanessa Parli, Yoav Shoham, Russell Wald, Jack Clark, Raymond Perrault

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Learning-Aided Warmstart of Model Predictive Control in Uncertain Fast-Changing Traffic

Mohamed-Khalil Bouzidi, Yue Yao, Daniel Goehring, Joerg Reichardt

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study

Liben Chen, Long Chen, Tian Ellison-Chen, Zhuoyuan Xu

专题命中 其他多模态 ：cross-modal(abstract)；分类 cs.CV

Comments 16 pages, 11 figures

Neural Insights for Digital Marketing Content Design

Fanjie Kong, Yuan Li, Houssam Nassif, Tanner Fiez, Ricardo Henao, Shreya Chakrabarti

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Journal ref International Conference on Knowledge Discovery and Data Mining (KDD'23), Long Beach, CA, pp. 4320-4332, 2023

SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation

Siqi Fan, Zhe Wang, Yan Wang, Jingjing Liu

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Large AI Models in Health Informatics: Applications, Challenges, and the Future

Jianing Qiu, Lin Li, Jiankai Sun, Jiachuan Peng, Peilun Shi, Ruiyang Zhang, Yinzhao Dong, Kyle Lam, Frank P. -W. Lo, Bo Xiao, Wu Yuan, Ningli Wang, Dong Xu, Benny Lo

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Comments This article has been accepted for publication in IEEE Journal of Biomedical and Health Informatics

Journal ref JBHI, 2023

GOATS: Goal Sampling Adaptation for Scooping with Curriculum Reinforcement Learning

Yaru Niu, Shiyu Jin, Zeqing Zhang, Jiacheng Zhu, Ding Zhao, Liangjun Zhang

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Lifting-based variational multiclass segmentation algorithm: design, convergence analysis, and implementation with applications in medical imaging

Nadja Gruber, Johannes Schwab, Sebastien Court, Elke Gizewski, Markus Haltmeier

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Interpretable Visual Question Answering via Reasoning Supervision

Maria Parelli, Dimitrios Mallis, Markos Diomataris, Vassilis Pitsikalis

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction

Zhiying Leng, Shun-Cheng Wu, Mahdi Saleh, Antonio Montanaro, Hao Yu, Yin Wang, Nassir Navab, Xiaohui Liang, Federico Tombari

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accpeted by ICCV 2023

DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders

Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, Xuansong Xie

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments ICCV 2023; Code: https://github.com/piddnad/DDColor

Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation

Cristiano Saltori, Fabio Galasso, Giuseppe Fiameni, Nicu Sebe, Fabio Poiesi, Elisa Ricci

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Comments TPAMI. arXiv admin note: text overlap with arXiv:2207.09778

Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networks

Xin Yang, Yi Lin, Zhiwei Wang, Xin Li, Kwang-Ting Cheng

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Unified Open-Vocabulary Dense Visual Prediction

Hengcan Shi, Munawar Hayat, Jianfei Cai

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

XVTP3D: Cross-view Trajectory Prediction Using Shared 3D Queries for Autonomous Driving

Zijian Song, Huikun Bi, Ruisi Zhang, Tianlu Mao, Zhaoqi Wang

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments 11 pages, 6 figures, accepted by IJCAI 23

Enhancing Visually-Rich Document Understanding via Layout Structure Modeling

Qiwei Li, Zuchao Li, Xiantao Cai, Bo Du, Hai Zhao

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CL

Quantification of Predictive Uncertainty via Inference-Time Sampling

Katarína Tóthová, Ľubor Ladický, Daniel Thul, Marc Pollefeys, Ender Konukoglu

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.CV

Journal ref Lecture Notes in Computer Science, vol 13563. Springer, Cham, 2022

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

Zeyu Cai, Chengqian Jin, Feipeng Da

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments 11 pages, 7 figures

A Probabilistic Approach to Self-Supervised Learning using Cyclical Stochastic Gradient MCMC

Masoumeh Javanbakhat, Christoph Lippert

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.AI

Graph-guided random forest for gene set selection

Bastian Pfeifer, Hubert Baniecki, Anna Saranti, Przemyslaw Biecek, Andreas Holzinger

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Journal ref Sci Rep 12, 16857 (2022)

Learning Ultrasound Scanning Skills from Human Demonstrations

Xutian Deng, Ziwei Lei, Yi Wang, Miao Li

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations

Xutian Deng, Yiting Chen, Fei Chen, Miao Li

专题命中 其他多模态 ：multi-modal(abstract)；分类 cs.AI

Explainable Depression Detection via Head Motion Patterns

Monika Gahalawat, Raul Fernandez Rojas, Tanaya Guha, Ramanathan Subramanian, Roland Goecke

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Combining Vision and EMG-Based Hand Tracking for Extended Reality Musical Instruments

Max Graf, Mathieu Barthet

专题命中 其他多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted for publication at CMMR 2023