When an Evaluation Rule Writes Training Labels: Measuring Human-Reference Forgiveness in NAVSIM

作者：Jiaxuan Guo, Jingxin Yang, Jiaqi Ye, Youran Sun, Shuo Xin, Kejia Zhang, Haizhao Yang · 单位：WHEN AN EVALUATION RULE WRITES TRAINING LABELS:, Stanford University, University of Maryland, College Park, that it could overlook important failures. In label generation it sets a whole col-, pre-overwrite targets with the released labels on all 103,288 navtrain scenes. The, configuration takes the same label file, the two values are 0.6627 and 0.9761. Con-, trade-off, which concerns evaluation reliability, without measuring its effect on training labels, measure that effect for the released GTRS-Dense trajectory labels. The measurement has two parts:, and 3). Its label generator replaces a component by passing labels throughout a scene’s vocabulary, distinct label rows before and after overwrite within each token. We test the earlier split criterion, a, label files under a stated rule in Appendix D., We recover the pre-overwrite side of the released label file by re-running its gen- · 会议/期刊：arXiv preprint · 方向：cs.LG · 发布日期：2026-09-29