arXivDaily arXiv每日学术速递 周一至周五更新

视觉与机器人

自动驾驶

自动驾驶感知、规划、BEV、占用预测、激光雷达和仿真评测。

今日/当前日期收录 3 信号源:cs.RO, cs.CV, eess.IV, cs.AI

1. 感知 2 篇

2603.11417 2026-06-18 cs.CV cs.LG 版本更新 90%

Zero-Shot Cross-City Generalization in End-to-End Autonomous Driving: Self-Supervised versus Supervised Representations

端到端自动驾驶中的零样本跨城市泛化:自监督与监督表示

Fatemeh Naeinian, Ali Hamza, Haoran Zhu, Anna Choromanska

发表机构 * Department of Electrical and Computer Engineering, NYU Tandon School of Engineering(电气工程系,纽约大学Tandon工程学院)

专题命中 感知 :端到端自动驾驶跨城市泛化研究

AI总结 研究端到端自动驾驶模型在跨城市零样本迁移中的泛化能力,发现自监督预训练(如I-JEPA、DINOv2、MAE)相比监督预训练能显著减少位移和碰撞退化,提升闭环评估中的分布外PDMS。

详情
AI中文摘要

端到端自动驾驶模型通常使用监督的ImageNet预训练骨干网络在多城市数据集上训练,但其泛化到未见城市的能力尚未得到充分检验。当训练和评估数据在地理上混合时,模型可能隐含地依赖城市特定线索,掩盖了在真实世界域偏移下泛化到新位置时可能出现的失败模式。在这项工作中,我们将零样本跨城市迁移定义为端到端自动驾驶的受控表示级压力测试,并探究视觉预训练如何影响地理域偏移下的迁移行为。我们通过将自监督骨干网络I-JEPA、DINOv2和MAE集成到规划框架中进行了全面研究。我们在nuScenes上的开环设置和NAVSIM上的闭环评估协议中,在严格的地理划分下评估性能。我们的实验揭示了当模型在不同道路拓扑、交通规则和视觉环境的城市间迁移时存在显著的泛化差距。在开环评估中,监督骨干网络在城市间迁移时表现出严重退化,而某些领域特定的自监督方法可以显著减少位移和碰撞退化。在闭环评估中,自监督预训练在多个单城市训练设置中提高了平均分布外PDMS。我们的结果提供了经验证据,表明表示学习影响跨城市规划的鲁棒性,并促使将零样本地理迁移作为评估端到端自动驾驶系统的重要压力测试。

英文摘要

End-to-end autonomous driving models are typically trained on multi-city datasets using supervised ImageNet-pretrained backbones, yet their ability to generalize to unseen cities remains largely unexamined. When training and evaluation data are geographically mixed, models may implicitly rely on city-specific cues, masking failure modes that would occur under real-world domain shifts when generalizing to new locations. In this work, we formulate zero-shot cross-city transfer as a controlled representation-level stress test for end-to-end autonomous driving and ask how visual pretraining affects transfer behavior under geographic domain shift. We conduct a comprehensive study by integrating self-supervised backbones I-JEPA, DINOv2, and MAE into planning frameworks. We evaluate performance under strict geographic splits on nuScenes in the open-loop setting and on NAVSIM in the closed-loop evaluation protocol. Our experiments reveal a substantial generalization gap when transferring models across cities with different road topologies, traffic conventions, and visual environments. In open-loop evaluation, a supervised backbone exhibits severe degradation when transferring between cities, yet some domain-specific self-supervised methods can substantially reduce both displacement and collision degradation. In closed-loop evaluation, self-supervised pretraining improves average out-of-distribution PDMS in several single-city training settings. Our results provide empirical evidence that representation learning influences the robustness of cross-city planning and motivate zero-shot geographic transfer as an important stress test for evaluating end-to-end autonomous driving systems.

2602.04401 2026-06-18 cs.RO cs.CV 版本更新 80%

Quantile Transfer for Reliable Operating Point Selection in Visual Place Recognition

视觉地点识别中可靠操作点选择的分位数迁移

Dhyey Manish Rajani, Michael Milford, Tobias Fischer

发表机构 * QUT Centre for Robotics(昆士兰理工大学机器人中心) School of Electrical Engineering and Robotics(电气工程与机器人学院) Queensland University of Technology(昆士兰理工大学)

专题命中 感知 :视觉地点识别操作点选择

AI总结 提出一种通过分位数归一化迁移阈值的方法,自动选择视觉地点识别系统的操作点,在100%精度下最大化召回率,无需手动调参。

Comments Accepted to the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2026

详情
AI中文摘要

视觉地点识别(VPR)是全球导航卫星系统(GNSS)受限环境中定位的关键组成部分,但其性能严重依赖于选择平衡精度和召回率的图像匹配阈值(操作点)。阈值通常针对特定环境离线手动调整,并在部署期间固定,导致在环境变化下性能下降。我们提出一种方法,自动选择VPR系统的操作点,以在100%精度下最大化召回率。该方法使用已知对应关系的小型校准遍历,并通过相似度得分分布的分位数归一化将阈值迁移到部署中。这种分位数迁移确保阈值在校准大小和查询子集上保持稳定。在五个基准数据集上使用七种最先进的VPR技术进行的实验表明,我们提出的方法始终优于现有基线,使底层VPR技术在大约两倍的部署场景中(中位数改进)以100%精度运行,同时在该精度下检索到多达29%的正确匹配。该方法通过适应新环境并在操作条件下泛化,消除了手动调整。我们的代码可在该https URL获取。

英文摘要

Visual Place Recognition (VPR) is a key component for localisation in Global Navigation Satellite System (GNSS)-denied environments, but its performance critically depends on selecting an image matching threshold (operating point) that balances precision and recall. Thresholds are typically hand-tuned offline for a specific environment and fixed during deployment, leading to degraded performance under environmental change. We propose a method that automatically selects the operating point of a VPR system to maximise recall at 100% precision. The method uses a small calibration traversal with known correspondences and transfers thresholds to deployment via quantile normalisation of similarity score distributions. This quantile transfer ensures that thresholds remain stable across calibration sizes and query subsets. Experiments with seven state-of-the-art VPR techniques across five benchmark datasets demonstrate that our proposed approach consistently outperforms existing baselines, enabling the underlying VPR technique to operate at 100% precision in approximately twice as many deployment scenarios (median improvement), while retrieving up to 29% more correct matches at that precision. The method eliminates manual tuning by adapting to new environments and generalising across operating conditions. Our code is available at https://github.com/DhyeyR-007/Quantile-Transfer-for-Reliable-VPR.

2. 规划控制 1 篇

2604.25848 2026-06-18 cs.AI 版本更新 75%

A Distributionally Robust Reinforcement Learning Framework for Constrained Urban EV Dispatch

面向约束城市电动汽车调度的分布鲁棒强化学习框架

An Nguyen, Hoang Nguyen, Phuong Le, Hung Pham, Cuong Do, Laurent El Ghaoui

发表机构 * College of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam(VinUniversity 工程与计算机科学学院,河内,越南) Center for Environmental Intelligence, VinUniversity, Hanoi, Vietnam(VinUniversity 环境智能中心,河内,越南)

专题命中 规划控制 :城市电动汽车调度,涉及充电和路径规划

AI总结 针对城市电动汽车调度中充电站和馈线容量约束及不确定需求,提出基于半马尔可夫决策过程与分布鲁棒软演员-评论家算法,通过图卷积编码器和滚动混合整数线性规划保证可行性,在纽约出租车数据仿真中实现最高净利润且零违规。

详情
AI中文摘要

我们研究城市规模的电动汽车(EV)网约车车队控制,其中调度、重新定位和充电决策必须在不确定且空间相关的出行需求和旅行时间下,遵守充电器和馈线限制。我们将问题建模为六边形网格半马尔可夫决策过程(semi-MDP),具有混合动作——用于服务、重新定位和充电的离散动作,以及连续充电功率——和可变动作持续时间。为了保证训练和部署期间的物理可行性,策略在由掩码温度退火actor产生的高层意图上学习。这些意图在每个决策步骤通过一个时间受限的滚动混合整数线性规划(MILP)进行投影,该规划严格强制执行荷电状态、充电端口和馈线约束。为了缓解分布偏移,我们针对一个Wasserstein-1模糊集优化软演员-评论家(SAC)智能体,该模糊集使用图对齐的马氏基础度量来捕捉空间相关性。鲁棒备份使用Kantorovich-Rubinstein对偶、投影次梯度内环和原始-对偶风险预算更新。我们的架构结合了两层图卷积网络(GCN)编码器、双评论家和一个驱动对手的价值网络。基于纽约出租车数据构建的大规模电动汽车车队模拟器上的实验表明,PD-RSAC实现了最高的净利润,达到122万美元,而强启发式、单智能体RL和多智能体RL基线(包括Greedy、SAC、MAPPO和MADDPG)的净利润为58万至70万美元,同时保持零馈线限制违规。

英文摘要

We study city-scale control of electric-vehicle (EV) ride-hailing fleets where dispatch, repositioning, and charging decisions must respect charger and feeder limits under uncertain, spatially correlated demand and travel times. We formulate the problem as a hex-grid semi-Markov decision process (semi-MDP) with mixed actions -- discrete actions for serving, repositioning, and charging, together with continuous charging power -- and variable action durations. To guarantee physical feasibility during both training and deployment, the policy learns over high-level intentions produced by a masked, temperature-annealed actor. These intentions are projected at every decision step through a time-limited rolling mixed-integer linear program (MILP) that strictly enforces state-of-charge, port, and feeder constraints. To mitigate distributional shifts, we optimize a Soft Actor-Critic (SAC) agent against a Wasserstein-1 ambiguity set with a graph-aligned Mahalanobis ground metric that captures spatial correlations. The robust backup uses the Kantorovich-Rubinstein dual, a projected subgradient inner loop, and a primal-dual risk-budget update. Our architecture combines a two-layer Graph Convolutional Network (GCN) encoder, twin critics, and a value network that drives the adversary. Experiments on a large-scale EV fleet simulator built from NYC taxi data show that PD-RSAC achieves the highest net profit, reaching \$1.22M, compared with \$0.58M-\$0.70M for strong heuristic, single-agent RL, and multi-agent RL baselines, including Greedy, SAC, MAPPO, and MADDPG, while maintaining zero feeder-limit violations.