매일 아침, 어제의 AI를 한 통으로 정리해 보내드립니다메일로 받아보기

METAL LAB

TelemetrySuffBench: Is Agent Telemetry Sufficient for Failure-Origin Diagnosis?

arXiv:2608.078992026-08-11

arXiv:2608.07899v1 Announce Type: new Abstract: Agent systems increasingly expose execution traces, yet telemetry that reveals a failure may still be inadequate for identifying where that failure originated. We introduce TelemetrySuffBench, a controlled benchmark that separates failure detection, fault-origin localization, and safe abstention under insufficient evidence. The benchmark constructs canonical multi-component traces with delayed-binding faults and renders them as paired coarse views,

저자 · Yuxuan Zhu, Peng Pu

arXiv에서 원문 보기