Specification-delta-driven data governance: an empirical study of the {\guillemotleft}spec-delta{\guillemotright} as the unit of change in lakehouse data platforms

arXiv:2608.198382026-08-21

把数据平台的变更当作可审阅的'规格增量'来管理,而不是靠代码差异——一篇实验设计论文

这篇论文提出了spec-delta(规格增量)的概念:在数据湖仓(一种把原始数据逐层加工成干净、可用数据的分层数据平台)中,每次变更都附带一份精简的、可审阅的需求文档,而不是只靠代码提交请求来审查。作者给出了spec-delta的具体结构、判断哪类变更适合用这种方式的分类表,以及一套对比spec-delta工作流和传统代码审查工作流的对照实验设计。需要说明的是,这篇论文本身还没有真实实验数据,实验室实测部分被明确留待后续完成。

论文原文摘要（英文）

Spec Driven Development SDD has consolidated the idea that the specification rather than the code should be the primary artefact governing AI assisted work. Tools such as GitHub Spec Kit, and proposals such as Constitutional SDD, have formalised this principle in the software domain, while the executable data-contracts literature has extended it to schema and quality enforcement at run time. Nevertheless, the treatment of the specification delta OpenSpec's core idea that every change should produce a reviewable increment of requirements as the unit of change in data platforms remains empirically unexplored, even though many data-platform changes are contractual (new datasets, service-level agreements, metric semantics, access policies) rather than purely code changes. This work formalises the spec-delta concept, proposes a taxonomy of data platform changes according to their suitability for incremental specification, and defines a controlled experiment comparing a spec-delta-driven workflow against a conventional code pull-request workflow without a delta. The response variables are discovery to deployment time, the density of defects reaching the Silver and Gold lakehouse layers, cross-tool metric divergence, and reviewer cognitive load measured with NASA TLX. The paper explicitly reserves a demonstration-and-laboratory section for instantiation on a real lakehouse environment. The contribution is not a tool but reproducible evidence and an applicability guide that helps to avoid the up front over specification antipattern.

作者 · Pablo Ramirez Amador