ExPhy: A Benchmark for Explicit Physical Property Learning in Multi-Object Trajectory Forecasting

arXiv:2608.200092026-08-21

能准确预测物体轨迹,不代表模型真懂它的质量、摩擦力和弹性

作者用物理引擎搭建了包含2万4千个多物体碰撞场景的基准ExPhy,不仅提供未来轨迹标签,还为每个物体标注了真实的质量、摩擦系数和恢复系数(弹性)。该基准分为与训练分布相同的测试集,以及物理参数不同、初始状态不同的两种分布外测试集,用来检验模型是否真正学到了物理规律。他们提出的PhyODE模型从观测轨迹中估计物体的物理属性,再用这些属性驱动物理规则进行未来轨迹推演,在最难的长时程、初始状态偏移设置下,相比最强基线将平均轨迹误差和终点误差分别降低了33.1%和31.0%。

论文原文摘要（英文）

Understanding object dynamics requires not only predicting future trajectories but also examining whether a model captures the physical properties that govern motion. However, existing benchmarks rarely expose object-level physical properties as explicit evaluation targets alongside trajectory forecasting. To address this gap, we introduce \emph{ExPhy}, a multi-object trajectory forecasting benchmark containing 24,000 simulated physical scenes with explicit object-level labels for mass, friction, and restitution. ExPhy provides observed and future trajectories together with an in-distribution (ID) split and two out-of-distribution (OOD) splits over physical parameters (OOD-Parameter) and initial states (OOD-Initial) for jointly evaluating trajectory forecasting and physical property estimation. We further instantiate \textsc{PhyODE}, a physics-guided model with an explicit property interface that estimates physical properties from observed trajectories and uses them for differentiable future rollout. On the long-horizon OOD-Initial setting, \textsc{PhyODE} reduces ADE and FDE by 33.1\% and 31.0\%, respectively, compared with the strongest baseline. Zero-shot evaluation on ComPhy further assesses cross-benchmark transfer. Property-level analyses reveal that accurate trajectory forecasting does not necessarily imply accurate recovery of the underlying physical properties. Code and data are available at https://github.com/Zest86/ExPhy.

作者 · Rui Wang, Yeteng Wu, Xianlin Zhang, Mengshi Qi

图片来源： Rui Wang et al., arXiv:2608.20009, CC BY 4.0