One email each morning — yesterday's AI, sortedGet it in your inbox

METAL LAB

Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the Model

arXiv:2608.192162026-08-21

Companies that rent AI instead of owning it can only do half of AI safety oversight

Regulated organisations that access frontier AI models through APIs often cannot see model weights, internal logs, or serving infrastructure, which quietly disables many standard AI safety control techniques. This paper sorts access into four layers - data, model, infrastructure, interaction - and maps which control protocols actually work under which access conditions, then tests this with 1.35 million synthetic case simulations. It finds that complete logs enable diagnosis, a pre-execution gateway enables intervention, and restricting what a system can do improves safety only by cutting usefulness.

What they did

  1. AI control research usually assumes a deployer can fully instrument the model and its pipeline, but organisations using frontier models through APIs or managed endpoints often lack access to model weights, serving infrastructure, internal traces, the update process, or complete interaction logs
  2. The paper names this condition 'bounded sovereignty' and builds a four-layer access typology (data, model, infrastructure, interaction) plus a matrix mapping which control protocols require which layers of access
  3. It introduces 'sovereignty discount cost' - the extra spend, delay, residual risk, or lost usefulness a deployer pays to substitute for missing access via contracts, architecture, audits, vendor assurances, or narrowing the system's scope
  4. Using a synthetic payments-dispute-triage workflow with 20 access profiles, 10 control protocols, and 3 agent behaviours, the authors ran 1.35 million synthetic case simulations, then interpreted results through an anonymised national-payments-infrastructure scenario
  5. Complete logs improved post-incident diagnosis, a deployer-controlled execution gateway enabled stopping risky actions before they occurred, trace access and model-version control strengthened explanations after incidents, and restricting the system's allowed actions raised safety but reduced how useful it was
Figure 1: Gateway access turns detection into intervention.
Figure 1: Gateway access turns detection into intervention.
LayerWhat full access would meanTypical access for an import-dependent regulated deployer
Data sovereigntyControl over what data trains or fine-tunes the model; ability to audit training-data provenanceUsually retains control over own transactional or fine-tuning data; no visibility into base-model training data
Model sovereigntyAccess to weights, architecture, activations, and ability to retrain, patch, probe, or run interpretability toolingUsually absent under API or managed-endpoint access; weights, architecture details, and activations are vendor-held
Infrastructure sovereigntyCompute located in-jurisdiction, under domestic legal control, observable by the deployerPartial at best: often a foreign-operated cloud region, sometimes with data-residency commitments; serving stack remains vendor-operated
Interaction sovereigntyFull logging and audit of prompts, outputs, tool calls, traces, and pre-execution intervention pointsPartial: input/output and tool logs may be contractable; internal traces are rarely available; gateway ownership depends on architecture
Figure 2: Logging affects both safety and reconstructability.
Figure 2: Logging affects both safety and reconstructability.
Control protocolBinding access layersTypical API-only feasibilityNotes
Trusted monitoring, output-levelInteraction logging; deployer-controlled monitor computeFeasible if logs are completeRequires complete, tamper-evident I/O logs and monitor execution outside the untrusted model
Trusted monitoring, trace/activation-levelModel traces or activations; serving-stack observabilityUsually infeasibleRequires model sovereignty or trace-level vendor access
Defer-to-trusted or trusted editingTrusted substitute model; pre-execution interceptionFeasible only with architecture constraintRequires an owned execution gateway before tool use or transaction-adjacent execution
Resampling protocolsControlled re-querying; stepwise agent-loop interception; stable model behaviourDegradedAPI re-querying is possible but latency, cost, and version consistency bind
Human or AI auditingRetained and queryable interaction logs; audit capacityFeasible but boundedEffectiveness depends on log completeness and audit budget
Legibility protocolsPrompting or training influence; output inspectionPartially feasiblePrompting-level legibility is available; training-level legibility is usually not
Pre-deployment control evaluationsRepresentative task data; stable access to deployed model versionDegradedEvaluation is weakened if production model versions can change without notice
Weights escrow or patchingModel sovereignty; infrastructure control or contractual escrowInfeasible except contractuallyNative patching requires weight access
Figure 3: Control protocols trade off safety, usefulness, and cost.
Figure 3: Control protocols trade off safety, usefulness, and cost.
ClassSynthetic meaning in the experiment
C1Incorrect hold or release recommendation on an individual synthetic dispute case
C2Systematic mis-triage pattern across a synthetic case cluster
C3Synthetic sensitive-field exposure marker in a mock report
C4Synthetic settlement-critical recommendation marker
Figure 4: Reachability of ≤1% failure with ≥75% usefulness.
Figure 4: Reachability of ≤1% failure with ≥75% usefulness.
Paper layerExperimental factorLevels used
Interaction sovereigntyI/O logsnone, partial, complete
Interaction sovereigntyTool-call logsnone, partial, complete
Interaction sovereigntyPre-execution gatewayabsent, present
Model sovereigntyTrace accessnone, limited, oracle
Model / interaction sovereigntyModel-version controlunpinned, notified, pinned
Infrastructure / contractual sovereigntyVendor supportnone, delayed, guaranteed
Deployment design substituteTool scopefull, restricted
Figure 5: Scope restriction buys safety by giving up usefulness.
Figure 5: Scope restriction buys safety by giving up usefulness.
AgentBehaviour
HonestUsually follows the synthetic ground truth but makes occasional mistakes
CarelessOverconfident, error-prone, and less likely to escalate uncertain cases
Stealthy access-awareChooses lower-visibility synthetic failure modes when access is weak
ProtocolInterpretation
No controlAccept the agent’s proposed mock action
Output monitorScore the final output or action for suspiciousness
Tool monitorScore proposed tool/action use when tool visibility exists
Defer-to-trustedReplace suspicious actions with a conservative trusted fallback when possible
ResamplingGenerate alternative candidate actions and select the lowest-risk acceptable one
Human auditSend flagged cases to a capacity-limited synthetic reviewer
Trusted editingEdit or redact risky draft outputs, or fall back to a safer policy
Scope restrictionRemove higher-risk mock actions from the action space
Macro-shutdownEscalate or safe-mode clusters after repeated suspiciousness
Vendor escalationRequest delayed or guaranteed synthetic vendor support for diagnosis or attestation
SettingValue
Access profiles20
Control protocols10
Synthetic agent types3
Monitor thresholds0.35, 0.55, 0.75
Audit budgets2%, 5%, 20%
Random seeds5
Synthetic cases per condition50
Aggregate condition rows27,000
Synthetic case simulations1,350,000
Synthetic agentProfiles reaching ≤1% failure and ≥75% usefulness
Honest90%
Careless40%
Stealthy access-aware35%
LayerOperator’s positionBasis
DataPartialFull control of own case and transaction data used in prompts or fine-tuning; no visibility into base-model training data
ModelNoneManaged-endpoint access; no weights, architecture detail, activations, or native patching ability; vendor may update the served model
InfrastructurePartialData-residency rider constrains storage location; serving stack remains vendor-operated and not independently observable; legal reach is mediated by foreign law
InteractionPartialI/O logging and tool-call logging may be contractable and implemented at the Operator’s gateway; internal traces remain unavailable

Why it matters

Many organisations and governments depend on AI they don't own while still being held accountable for its safety, and this paper gives them a concrete way to ask which control techniques they can actually run versus which ones only look good on paper. Anyone designing or regulating AI safety protocols should treat 'full instrumentation access' as an assumption to check, not a given.

Terms in this paper

  • AI control · research into deployment techniques that keep an AI system's actions safe even if the model itself might be misaligned
  • bounded sovereignty · having only partial technical and contractual access across an AI system's data, model, infrastructure, and interaction layers
  • control tax · the operational and financial cost of adding safety-control measures to an AI deployment pipeline
  • sovereignty discount cost · the extra cost, delay, risk, or usefulness lost when a deployer substitutes for access it doesn't have
  • gateway · a point where the deployer can intercept and review a model's action before it actually executes

Original abstract (English)

AI control research asks how to deploy models safely even when they may be misaligned, but many control protocols assume that the deployer can instrument the model and its surrounding pipeline. That assumption often fails for regulated organisations using frontier models through APIs or managed endpoints, where the deployer may control the business process but not the model weights, serving infrastructure, internal traces, update process, or full interaction logs. This paper introduces bounded sovereignty: partial technical and contractual access across the data, model, infrastructure, and interaction layers of the AI stack. It argues that these access conditions determine which control protocols can be executed in practice. The paper contributes a four-layer access typology, a protocol-by-layer requirements matrix, and the concept of sovereignty discount cost: the part of the control tax spent substituting for missing access through contracts, architecture, audit, vendor assurance, residual risk, or reduced system scope. It also reports a synthetic access-ablation experiment over 1.35 million synthetic case simulations and interprets the findings through an anonymised national-payments-infrastructure scenario. The experiment is not real-world payment-system evidence; it is a construct-validity exercise. The results show that complete logs improve diagnosis, a pre-execution gateway enables intervention, trace access and model-version control strengthen post-incident explanation, and scope restriction can improve safety while reducing usefulness. Control protocols proposed as general safety solutions should therefore state their access assumptions explicitly.

Authors · Zhen Wen Lim

Read on arXiv

Latest papers

All papers →

Latest from METAL LAB

Figures: Zhen Wen Lim et al., arXiv:2608.19216, CC BY 4.0