Human–Machine Convergence

The Ship of Theseus in production

Rajesh Ranjan Mahapatra

A first-principles method for deciding when component changes preserve, conditionally preserve, or break the identity of a governed production system.

© 2026 Rajesh Ranjan Mahapatra. 28 min read

Security, provenance and oversight

The Ship of Theseus in production

A production system remains the same governed system only while each change preserves its declared obligations across behaviour, authority, evidence and recovery, and proves that preservation against relevant traces.

TLDR

  1. A service name, endpoint or version line is an administrative handle, not proof of system identity.
  2. Hashes and provenance identify artefacts and build history; they do not establish semantic continuity.
  3. The identity-bearing unit is the configured socio-technical system, including models, data, policies, tools, humans and recovery paths.
  4. Continuity is graded: lineage can survive while contractual or governed continuity fails.
  5. A semantic change manifest turns each replacement into explicit claims, tests, receipts and a release decision.
Opening case

At 02:10, a claims-assessment service receives an ordinary maintenance release. Its endpoint is unchanged. The user interface still carries the same product name. The release ticket says 3.7.4, a patch.

Underneath that label, five things have moved. The foundation model is replaced with a cheaper one. The retrieval index is rebuilt from the same document store but with a different chunking rule. A prompt instruction is tightened. The policy library is upgraded. The confidence threshold that sends cases to a human reviewer rises from 0.72 to 0.81.

By Monday morning, routine acceptance tests are green. Mean accuracy is slightly better. Latency is lower. Operations calls it the same service. Procurement calls it the same contract. The API gateway calls it the same route. Then a compliance officer asks a harder question: does the earlier approval still govern this system, or has a new governed system quietly entered production?

Counting replaced components cannot answer. Neither can the version number. A full rebuild may preserve every decision-relevant obligation. A one-line configuration change may remove an appeal path. The puzzle is not whether the ship has the same planks. It is which relationships made the ship answerable in the first place.

A production system in dry dock while components are replaced A ship-shaped production system has replaceable model, data, policy, tool and interface modules. Four mooring lines labelled behaviour, authority, evidence and recovery determine whether governed continuity survives. MODEL replaceable POLICY replaceable DATA replaceable BEHAVIOUR AUTHORITY EVIDENCE RECOVERY Components may move; obligations must stay moored
The dry-dock view of system identity. Replacing material parts does not decide continuity. The decision turns on whether the system remains attached to the behavioural, authority, evidence and recovery obligations on which approval depended. Illustrative.

The name that survives its system

Production teams already use several meanings of “same”. A container registry means the same artefact when a digest matches. A deployment platform may mean the same workload when a stable object identifier persists. A product manager means the same service when users see the same name and purpose. A risk owner means something stronger: the approved assumptions, controls and responsibilities still apply.

These meanings overlap, but they are not interchangeable. A cryptographic digest is exceptionally good at distinguishing bytes. An inventory standard can identify components. Supply-chain provenance can record where, when and how an artefact was produced. SLSA, in-toto, OCI descriptors and SPDX strengthen these layers in complementary ways.[3][4][5][6] None of them, by itself, proves that two configured releases preserve the same consequences for people and institutions.

◆
Published evidence and practitioner inference. The cited standards define artefact identity, composition and provenance. The claim that these are insufficient for governed continuity is a synthesis: a record of origins cannot, without additional tests, establish preserved behaviour, authority or appeal.

Four identities are hiding under one noun

It helps to separate four layers. Artefact identity asks whether the bytes are the same. Assembly identity asks whether the exact model, prompt, index, configuration, policy and tool set are the same. Service identity asks whether the stable product handle, endpoint and declared function continue. Governed identity asks whether the obligations that made the service acceptable still hold.

The layers are nested only loosely. A release can replace every artefact while preserving governed identity. It can also preserve every application binary while an external data source, clock, permission grant or vendor endpoint changes what the system may do. The system that matters is therefore not a file, model or pod. It is the configured socio-technical arrangement that turns intent, context and authority into effects and receipts.

Four identity layers, four different tests. The common mistake is to use evidence from an inner layer, such as a digest or version label, to answer a question posed at the outer governed layer. Practitioner synthesis.

Same for whom, and for what reliance?

Identity claims are always indexed to a use. The service can be the same product for a customer who only needs a stable endpoint, yet a new accounting system for an auditor who relies on journal semantics. It can be the same container image for operations and a new decision system for a person whose appeal now reaches different evidence. This does not make identity arbitrary. It means the relevant equivalence relation must be named.

Governed identity concerns a particular kind of reliance. It asks whether the people and institutions affected by the system can continue to rely on the same promises: which purpose constrains use, who may authorise an effect, what evidence supports it, what happens under uncertainty and how a mistake is reversed. Those promises are not private preferences. They are encoded in contracts, policies, controls, operating procedures and sometimes law.

This indexing also prevents overclaiming. A team may establish continuity for invoice classification while explicitly withholding it for automated payment. It may preserve the same advice function but not the same authority to act. The strongest honest identity claim is the narrowest one that covers the actual reliance being carried forward. A release record should therefore state not only “same system”, but “same governed system for these purposes, actors, effects and conditions”.

Thought experiment 1: every plank, same obligations

Replace the model, runtime, database engine and user interface. Keep the typed action contract unchanged. For every risk-relevant sequence, the replacement requests the same evidence, applies the same permissions, produces outcomes within agreed tolerances, emits equivalent receipts and can be reversed at the same boundary. What should we expect?

Material intuition says “new system” because nothing physical remains. Governance intuition should say the opposite. Complete component replacement need not break governed identity when the relied-upon obligations are preserved and demonstrated. This is not an assertion that the systems are identical in every respect. It is a scoped claim that the previous governance decision still attaches for the stated context.

Why version numbers mislead

Semantic Versioning gives version numbers meaning relative to a declared public API. Major versions mark incompatible API changes; minor and patch versions indicate forms of compatibility.[8] That convention is useful, but an API is only one observable surface. A patch can preserve request and response schemas while changing a decision threshold, data entitlement, human review route or failure behaviour. Conversely, a major API redesign can leave the underlying authority and outcome obligations unchanged.

The hidden assumption is that interface compatibility implies responsibility compatibility. It does not. A bank transfer API can return the same fields while switching from “authorise then execute” to “execute then retrospectively screen”. A retrieval service can return the same answer while losing the source version needed for appeal. A model can preserve average accuracy while moving errors towards a protected group or a high-cost edge case. These are identity-relevant because they alter what affected parties and operators may legitimately rely upon.

A causal intervention that holds the service interface fixed while replacing the model Two branches share the same endpoint and input. The old and new model produce the same routine answer but diverge after a stale-token timeout, showing that interface continuity does not guarantee trace continuity. SAME ENDPOINT same request schema OLD MODEL cache expires on timeout NEW MODEL reuses cached entitlement TIMEOUT TRACE reject and request fresh proof TIMEOUT TRACE continues and acts Routine examples remain identical The intervention reveals a different governed system
Hold the interface fixed, change the mechanism. A replacement can remain invisible on routine calls yet introduce a new action trace under timeout. Governed continuity is a property of risk-relevant trajectories, not static input-output snapshots. Illustrative causal intervention.
The argument in one pass
Chart · flow
flowchart LR
  A["The name that survives its system"] --> B["Identity lives in obligations"]
  B --> C["The dry-dock tests"]
  C --> D["The semantic change manifest"]
  D -. "re-test" .-> A
  classDef first fill:#0a1424,stroke:#7B4CD8,stroke-width:2px,color:#e6f3ff
  classDef step fill:#0a1424,stroke:#3f7da0,stroke-width:1px,color:#e6f3ff
  class A first
  class B,C,D step
A structural route through The Ship of Theseus in production: from The name that survives its system to Keep identity only when the obligation…. Reading use: follow the relation, then return to the surrounding argument for evidence and limits.

Identity lives in obligations

To make this precise, begin with a concrete situation. A case enters a claims-assessment service. The system gathers evidence, proposes a classification and may release a payment. Change one variable: the identity token becomes stale midway through the run. What should happen?

If the system’s contract says authority must be fresh immediately before an irreversible effect, the answer is more than “produce the right classification”. The system must stop, refresh authority or return a typed abstention. A replacement that reaches the same classification but pays on stale authority has not preserved the relevant behaviour. The causal mechanism is a governed obligation: a property that must hold across a sequence because someone relies on it for safety, legality, contestability or recovery.

The obligation vector

Represent the approved system by four obligation families. Let B denote behavioural commitments, such as accuracy bands, abstention rules and typed action semantics. Let A denote authority commitments, such as actor, subject, purpose, permission and freshness. Let E denote evidence commitments, including provenance, decision receipts and postcondition readback. Let R denote recovery commitments, including idempotency, compensation, escalation and safe resumption.

A baseline release S₀ and candidate release S₁ preserve governed identity in context K only when the projection of their risk-relevant executions onto those obligations remains equivalent within declared tolerances.

S₁ ≡G,K,δ S₀ iff for every relevant trace τ in T(K): PB,A,E,R(run(S₁,τ)) ≈δ PB,A,E,R(run(S₀,τ)), and every new effect is explicitly authorised

Every symbol refers to an operational object. T(K) is the set of trajectories that matter in the deployment context, including normal, edge, adversarial and interrupted runs. P discards irrelevant implementation detail and retains the obligations being tested. The tolerance δ states what variation is acceptable. For a latency target, it may be a numerical band. For “never execute after permission revocation”, it is zero.

The assumption that makes the formula useful is that the obligation set is declared before the comparison. If teams choose obligations after seeing results, the test becomes a story about whatever survived. Remove that assumption and almost any replacement can be called equivalent by ignoring its failures.

Worked example 1: the nine-step approval gate

A toy gate has two states: AUTHORISED and STALE. It may emit APPROVE, ABSTAIN or REFRESH. On eight ordinary single-step tests, old and new implementations agree. On the ninth trace, the token expires after evidence retrieval but before action.

TraceBaselineCandidateObligationResult
Valid token, clear evidenceAPPROVEAPPROVECorrect actionMatch
Valid token, weak evidenceABSTAINABSTAINRight to abstainMatch
Token stale at entryREFRESHREFRESHFresh authorityMatch
Token expires before effectREFRESHAPPROVEPre-effect freshnessBreak

The candidate has 100 per cent agreement on the first three rows and may have perfect average classification accuracy. It still fails continuity because the fourth row is a zero-tolerance authority invariant. The smallest useful test is not a larger random benchmark. It is one stateful intervention placed at the decision boundary.

State transition view of the approval gate The authorised state can approve or abstain. A timeout moves to stale. The baseline refreshes before returning to authorised, while the candidate takes a prohibited shortcut from stale to effect. AUTHORISED fresh identity + purpose STALE authority no longer valid timeout / revocation refresh proof, then continue PROHIBITED EFFECT The difference lives in a transition, not a static answer
The timeout transition exposes the identity break. Static benchmark rows miss the candidate’s shortcut from stale authority to effect. State and interruption tests reveal whether the old obligation still governs. Illustrative worked example.

Why provenance is necessary and insufficient

Provenance answers indispensable questions. W3C PROV models entities, activities and agents. in-toto records which steps were performed, by whom and in what order. SLSA provenance links artefacts to builders, inputs and build definitions, and requires verification against expectations rather than passive storage.[7][4][3] Sigstore can bind signatures and attestations to image digests.[12] These controls help establish that the candidate is the intended candidate.

That is a precondition for continuity, not the conclusion. A perfectly authentic build can implement a newly dangerous rule. A complete SBOM can inventory a component whose threshold changed. A signed model can be faithfully deployed with a different retrieval corpus. Supply-chain evidence proves ancestry and integrity; semantic evidence proves preserved obligations. Governance needs both.

Thought experiment 2: the untouched binary

Freeze every application artefact. Change only the system clock source so that an entitlement check is evaluated six minutes behind reality. The code hash, model hash and container digest remain identical. A permission revoked at 10:00 appears valid until 10:06.

If identity followed material sameness, nothing changed. Yet the system can now perform effects the approved system could not. An unchanged assembly can become a different governed system when its environment changes the truth available at the action boundary.

Thought experiment 3: the missing receipt

Hold every decision constant. Replace the evidence ledger with a faster store that records the final answer but not the source version, policy decision or postcondition readback. No user sees a different initial outcome. What has changed?

The system has lost the ability to reconstruct why an effect occurred, test whether the right policy ran, or resolve an appeal against the exact evidence available then. Behavioural output is preserved, but the obligation to make consequential action contestable has vanished. Governed identity therefore fails even before accuracy moves.

Continuity is a sequence of re-established claims. Earlier successful changes do not grant permanent identity. The ledger rewrite breaks the evidence obligation even though the product name and API continue. Illustrative timeline.

The dry-dock tests

A useful release process should not demand a full philosophical inquiry for every patch. It should ask stronger questions only when a change can reach stronger obligations. The practical answer is a graded set of tests, ordered from ancestry to consequence.

Test 1: lineage continuity

Can the organisation identify exactly what changed, who authorised it, which inputs produced it and what artefact reached the environment? This is where source revision identifiers, content digests, SBOMs, signed attestations and deployment manifests belong. SLSA’s insistence on verifying provenance against expectations is crucial because stored evidence that nobody checks is not a control.[3]

Passing this test permits one claim: the candidate descends through the intended change process. It does not permit “same behaviour” or “same governed system”. A negative result means semantic testing cannot be trusted because the object under test is not reliably bound to the object deployed.

Test 2: contract continuity

Does the candidate preserve the public and typed operational contract? Check schemas, error semantics, idempotency keys, timeout behaviour, state transitions and postconditions. Formal refinement gives the right intuition: a lower-level implementation is acceptable when it correctly realises the higher-level specification.[10] Behavioural subtyping makes a related demand that properties proven about the expected type continue to hold for its replacement.[9]

For production AI, ordinary API compatibility is too shallow. The contract should include abstention, uncertainty, evidence references, authority checks and unknown-outcome handling. Passing allows the claim that existing integrators can rely on the same typed behaviour inside the tested envelope. It still does not establish that policy, data rights or human oversight remain equivalent.

Test 3: governed continuity

Now test the obligations that justified approval: intended purpose, subject and actor binding, permitted context, decision thresholds, protected invariants, human authority, evidence sufficiency, monitoring, release and recovery. NIST’s AI RMF Playbook explicitly joins post-deployment monitoring with appeal, override, decommissioning, incident response, recovery and change management, and recommends tracking component and dataset modifications.[1] The FDA’s predetermined change control plan provides a regulated precedent for describing planned modifications, the method for developing and validating them, and their impact before relying on continued authorisation.[11]

Passing permits the scoped statement “the previous governance decision still attaches under context K and tolerances δ”. A negative result does not automatically ban release. It means the candidate must be treated as a new governed system, with a new approval basis, migration plan and explicit handling of old commitments.

The evidence packet must travel with the release

A continuity decision made in a meeting is weak unless its evidence is bound to the deployed candidate. The release packet should contain the approved anchor identifiers, candidate digests, configuration and data snapshots, the semantic change manifest, test-suite versions, test results, exceptions, approval identity and deployment receipt. After release, it should add operating observations and the first independent postcondition readbacks.

Temporal order matters. Provenance verified before a final configuration change does not cover that change. A policy decision evaluated at build time does not establish permission at effect time. A rollback plan demonstrated against an earlier database schema may fail after migration. The evidence chain should therefore mark when each claim became true and which later event could invalidate it.

This packet turns continuity into a reproducible judgement. Another reviewer can reconstruct the candidate, inspect the declared obligations, rerun the decisive traces and determine whether the same release was actually deployed. Without that binding, “tests passed” is an anecdote about an object that may no longer exist. Release evidence is part of governed identity because it connects the approved claim to the operating system that acts.

Evidence required rises with the obligation reach of a change An illustrative chart slopes upward from cosmetic changes requiring lineage evidence to purpose or authority changes requiring full reapproval. Three stair-step regions show lineage, contract and governed continuity. How many governed obligations the change can reach Evidence and approval burden LINEAGE digest, SBOM, provenance CONTRACT schema + trace refinement GOVERNED authority + evidence + recovery UI copy timeout rule authority change Change size is the wrong x-axis
Evidence follows obligation reach, not lines of code. A tiny authority change may require more assurance than a complete implementation rewrite whose governed traces remain within the approved envelope. Values and positions are illustrative. Illustrative trade-off chart.
Worked example 3: 99.1 per cent agreement can still fail continuity

Suppose a candidate is compared with its approved anchor on 1,004 synthetic traces. One thousand are routine classifications. Four are authority-boundary traces: permission revocation, purpose expiry, subject mismatch and token expiry immediately before effect. The candidate disagrees on eight routine traces and one authority trace.

An ordinary agreement score is (1,004 − 9) / 1,004 = 99.1%. That looks excellent. Now give each routine trace weight 1 and each authority-boundary trace weight 250, reflecting the consequence of an unauthorised effect. Weighted disagreement becomes (8 × 1 + 1 × 250) / (1,000 × 1 + 4 × 250) = 12.9%. Even that weighted result is not the final rule, because pre-effect authority was declared a zero-tolerance invariant. One violation is enough to fail governed continuity.

Trace familyCountDivergencesWeight eachDecision treatment
Routine classification1,00081Tolerance may be statistical
Authority boundary41250Zero-tolerance invariant
Combined headline1,0049Mixed99.1% agreement is insufficient

This example shows why a single aggregate benchmark is the wrong release instrument. Weighting improves the picture, but governance still needs categorical invariants for effects that must never occur. The arithmetic compresses evidence; it cannot decide which obligation is non-negotiable. That decision must come from the approved contract before the test.

Worked example 2: the claims-assessment release

Return to the opening release. The team records five deltas. The model swap can affect classification, uncertainty and tool selection. Rechunking can affect retrieved evidence and source coverage. The prompt change can affect abstention. The policy-library upgrade can affect permission decisions. The review threshold can affect who exercises final authority.

A component-centred review would run model benchmarks, vulnerability scans and API tests. An obligation-centred review expands the test set: stale identity at pre-effect time; conflicting sources; missing source version; uncertain model output; reviewer overload; partial tool execution; rollback after an unknown outcome. The new model may pass. The release still fails governed continuity if the higher threshold sends materially fewer high-risk cases to meaningful review without a newly approved oversight design.

Configured system boundary for the claims-assessment service A large system boundary contains intent intake, identity and purpose checks, retrieval, model proposal, policy authority, typed action, effect receipt, readback and human review. Replacement points are marked, showing that system identity spans more than the model. CONFIGURED GOVERNED SYSTEM INTENT claim + purpose IDENTITY GATE actor, subject, freshness RETRIEVAL index + source rights MODEL proposal + uncertainty POLICY permission + limits TYPED ACTION + EFFECT idempotency, timeout, receipt HUMAN REVIEW evidence access + veto EVIDENCE LEDGER source, policy, proposal, decision receipt READBACK verify the effect independently RECOVERY compensate, escalate, resume safely Dashed borders mark replaced or reconfigured components; solid obligations still require proof.
The identity-bearing boundary is the configured system. Model, retrieval, policy, human review, typed action, evidence and recovery jointly produce the governed effect. Testing only the swapped model leaves most identity-bearing relations unexamined. Illustrative system boundary.

Do not let many small patches launder a large change

Teams often review changes one ticket at a time. That creates a cumulative-drift failure mode. Each patch remains below a local threshold, yet the sequence moves the system outside the original approval envelope. Thresholds rise, prompts become more directive, retrieval sources expand, reviewer time shrinks and recovery becomes manual. No single ticket declares a new purpose or authority model. The configured result nevertheless behaves like one.

The remedy is to compare the candidate not only with the immediately preceding release but also with an approved anchor. Every release should carry an obligations hash and a delta chain back to the anchor. When accumulated deltas cross a tolerance or touch a zero-tolerance invariant, the system must re-establish governed continuity or open a new approval.

Worked example 4: five harmless patches become one unapproved workflow

Consider a synthetic six-release history anchored at A0. At P1, a confidence threshold rises and the human-review rate falls from 18 to 14 per cent. At P2, a prompt is made more decisive and review falls to 11 per cent. At P3, the retrieval corpus expands to include a supplier feed whose records lack stable source versions. At P4, reviewers receive summaries rather than primary evidence. At P5, automatic compensation is replaced by a manual incident queue.

Each adjacent comparison can be defended. The threshold movement is within a local tolerance. The prompt passes a routine benchmark. The supplier feed improves recall. The summary shortens handling time. The incident queue is an approved operational tool. Yet the anchor comparison reveals a different arrangement: human review has fallen from 18 to 6 per cent for the high-uncertainty slice, only 72 per cent of decisions can reconstruct the exact source version, and an unknown payment outcome can remain unresolved until an operator opens the queue.

ReleaseLocal changeAdjacent verdictAnchor-level consequence
A0Approved configured systemAnchor18% review; complete source receipts; automatic compensation
P1-P2Threshold and promptPass local performance bandsHigh-uncertainty review declines cumulatively
P3Supplier retrieval feedPass recall targetSome evidence loses stable version identity
P4Reviewer summary viewPass handling-time targetIndependent judgement is weakened
P5Manual compensation queueRunbook approvedRecovery guarantee changes from automatic to best-effort

No single patch necessarily proves harm. The sequence does prove that the original oversight, evidence and recovery obligations are no longer established. The correct release action is not to label P5 a risky patch. It is to recognise that the patch chain has produced a candidate with a new governance basis. Anchor comparison turns cumulative drift into an explicit decision rather than an archaeological discovery after an incident.

Cumulative patch laundering across an approval boundary Seven small patches each appear below a local review threshold, but their cumulative effect crosses the approved obligation envelope. A comparison to the anchor release catches the drift. APPROVED ENVELOPE LIMIT Patch sequence Cumulative obligation drift anchor P1 P2 P3 P4 P5 P6 P7 Local passes, anchor comparison fails
Patch laundering is cumulative identity drift. Comparing only adjacent releases can certify every small step while the overall system crosses the approved boundary. Anchor-based comparison exposes the movement. Illustrative adversarial path.
Thought experiment 4: the reviewer who still clicks

Keep the human approval step visible. Change only the evidence shown to the reviewer: replace source documents and uncertainty bands with a fluent one-paragraph summary. Approval rates and turnaround improve. The interface still records a human click.

The nominal topology is unchanged, but the human can no longer independently evaluate the proposal. The click has shifted from judgement to ceremony. Human-in-the-loop continuity requires preservation of meaningful review conditions, not the persistence of a button.

How the claim changes under pressure
Chart · state
stateDiagram-v2
  [*] --> Claim
  state "Four identities are hiding<br/>under one noun" as Claim
  state "Same for whom, and for what<br/>reliance?" as Test
  state "Why version numbers mislead" as Revision
  Claim --> Test: expose mechanism
  Test --> Decision: evidence survives
  Test --> Revision: rival survives
  Revision --> Claim: narrow or rebuild
  Decision --> [*]
The revision loop begins with Four identities are hiding under one noun and keeps counterexamples inside the reasoning path. Reading use: follow the relation, then return to the surrounding argument for evidence and limits.

The semantic change manifest

The practical contribution of this paper is a semantic change manifest: a signed, machine-readable record that connects component deltas to obligation claims, evidence and release consequences. It complements an SBOM and build provenance rather than replacing them.

The manifest begins with two anchors. The configured anchor binds exact artefacts, data snapshots, policies, prompts, tools, topology and human roles. The governance anchor binds the declared purpose, authority model, action contracts, evidence obligations, risk tolerances and recovery guarantees. A release then declares which elements changed and which obligations those changes can reach.

Five questions every change must answer

What changed?
Exact component, configuration, data, topology, environment or human-work delta, bound to immutable identifiers where possible.
Which obligation can it reach?
Behaviour, authority, evidence or recovery, including zero-tolerance invariants.
What evidence tests preservation?
Provenance verification, typed contract tests, stateful interventions, subgroup checks, readback or recovery drills.
What is the result allowed to mean?
Lineage continuity, contract continuity, governed continuity, conditional release or new-system approval.

The fifth question is implicit in all four: what would make the claim fail? A good manifest stores defeaters. A change that introduces a new effect, expands a purpose, alters who may authorise, weakens evidence or removes a recovery path cannot be waved through by a high aggregate score.

Four release classes, not one pass flag

The manifest should produce one of four release classes. Governed continuity means lineage, contract, risk traces, receipts, recovery and anchor comparison all support the previous approval within scope. Conditional continuity means the contract is preserved but one or more governed claims still depend on operating evidence; release, if justified, must be reversible, bounded and time-limited. Lineage continuity only means the candidate is authentic and intended, but substitutability has not been shown. New governed system means purpose, authority or effect boundaries changed, or a relied-upon evidence or recovery obligation was removed.

These classes resist two common pressures. The first is the demand for a binary green tick even when evidence is incomplete. The second is the tendency to call every uncertainty a failure and thereby encourage teams to hide change. A graded result allows honest progress while keeping semantic claims precise. Conditional release is not a euphemism for approval. It is a separate transaction with tighter scope, stronger observation and an expiry condition.

The class should also determine communication. Users need notice when their available appeal evidence changes. Operators need new runbooks when recovery changes. Risk owners need a fresh decision when authority expands. Version numbers can remain useful, but the semantic change class is the part that tells stakeholders which reliance has survived.

The semantic change decision matrix. The decisive column is not “how large was the code change?” but “which obligation can the delta reach, and what evidence is proportionate to that reach?” Original decision instrument.

Executable lab: continuity evaluator

Use synthetic or real release facts. The browser computes a scoped release classification and exposes the reasons.

No evaluation yet

Select the release facts, then evaluate. A positive result permits only the scoped claim printed here.

How to use the artefact

Start from the latest approved anchor, rather than only yesterday’s build. Enter the primary change type and consequence tier. Mark only evidence that is bound to the deployed candidate. A test result from a staging build with a different prompt, dataset or policy package does not count.

A governed continuity result permits the previous approval to attach only for the declared context and tested tolerances. A conditional continuity result permits a bounded canary or reversible release with explicit monitoring and rollback triggers. Lineage only means the candidate is authentic but semantically unproven. New governed system means a purpose, authority or effect boundary changed, so the right action is reapproval, not a more flattering version label.

A negative result is informative. It identifies missing evidence or a changed obligation. It does not prove the candidate is unsafe. Likewise, a positive result cannot establish metaphysical identity, universal behavioural equivalence or safety outside the tested context. The tool is an assurance instrument, not an oracle.

Typed manifest schema and reference algorithm

The evaluator implements the following compact structure. Production use should sign the manifest, bind evidence to immutable artefacts and store the decision with the release receipt.

TypeScript-style schema
type ContinuityManifest = {
  systemId: string;
  approvedAnchor: {
    configuredDigest: string;
    obligationsDigest: string;
    context: string;
  };
  candidate: {
    releaseId: string;
    artifactDigests: string[];
    dataSnapshots: string[];
    policyDigest: string;
    topologyDigest: string;
  };
  deltas: Array<{
    kind: "artifact" | "model" | "data" | "topology" | "authority" | "evidence";
    description: string;
    reaches: Array<"behaviour" | "authority" | "evidence" | "recovery">;
    zeroToleranceInvariant?: string;
  }>;
  evidence: {
    provenanceVerified: boolean;
    contractTestsPassed: boolean;
    riskTraceTestsPassed: boolean;
    receiptsComplete: boolean;
    recoveryDemonstrated: boolean;
    anchorCompared: boolean;
  };
  decision: {
    class: "governed-continuity" | "conditional" | "lineage-only" | "new-system";
    scope: string;
    requiredActions: string[];
  };
};
Decision logic
function classify(m: ContinuityManifest): string {
  if (m.deltas.some(d => d.kind === "authority") || m.decision.scope === "new external effect") {
    return "new-system";
  }
  if (!m.evidence.provenanceVerified) return "unbound-candidate";
  if (!m.evidence.contractTestsPassed) return "lineage-only";
  const governed = m.evidence.riskTraceTestsPassed
    && m.evidence.receiptsComplete
    && m.evidence.recoveryDemonstrated
    && m.evidence.anchorCompared;
  return governed ? "governed-continuity" : "conditional";
}
Open research hypothesis: obligation coverage predicts escape risk

Change review may be more predictive when coverage is measured over obligations and state transitions than when measured over code, components or benchmark examples. The smallest study would compare two review strategies across a synthetic release series with seeded authority, evidence and recovery faults.

Evidence would strengthen the hypothesis if obligation-guided tests detect more high-impact escapes at equal review cost. It would weaken it if component-risk heuristics perform as well after fair tuning. A rival explanation is that better results come simply from more tests, not from the obligation representation. The study should therefore match test count and operator time.

The strongest boundary

No finite trace set proves complete equivalence for an open production system. Unknown environments, adaptive users, vendor changes and distribution shifts remain. Formal refinement can prove properties only relative to a specification, and the specification may omit the harm that later matters. Empirical testing samples a world it does not exhaust.

The right response is not to abandon continuity claims. It is to scope them. State the context, tolerances, tested trace families, unmeasured risks, monitoring window and invalidation triggers. Require stronger post-deployment evidence as consequence and novelty rise. Continuity is a defeasible governance claim that must be re-earned, not a permanent essence attached to a product name.

Where this method should not be applied

Do not use semantic continuity to conceal a new purpose, expanded surveillance, altered legal basis or new class of irreversible action. Do not average away a zero-tolerance invariant. Do not claim equivalence when the test set was chosen after failures were observed. Do not let a supplier’s unchanged model name stand in for a pinned, inspectable candidate.

The evidence conversation
Chart · sequence
sequenceDiagram
  participant Q as Question
  participant M as Mechanism
  participant E as Evidence
  participant D as Decision
  Q->>M: The name that survives its system
  M->>E: Four identities are hiding under one noun
  E-->>M: compare rival explanations
  E->>D: Keep identity only when the obligation envelope survives
  D-->>Q: revise scope or act
Question, mechanism, evidence and decision exchange the burdens developed in The Ship of Theseus in production. Reading use: follow the relation, then return to the surrounding argument for evidence and limits.

Keep identity only when the obligation envelope survives

Before this analysis, release governance tends to ask one of two weak questions: “Did the component change?” or “Did the API break?” The Ship of Theseus puzzle shows why both are misdirected. Components are replaceable. Interfaces are partial. The real decision is whether the obligations that made the system governable have survived the replacement.

The release owner should now make a different choice. Do not classify a production change by the amount of code or the marketing version. Classify it by the obligations it can reach. Bind the candidate to provenance. Test the typed contract. Intervene on stateful risk traces. Verify authority, evidence and recovery. Compare cumulative change with the approved anchor.

When those checks pass, a radically rebuilt system may legitimately remain on the same governed line. When they fail, a one-line patch may require a new approval. That asymmetry is not bureaucratic caution. It follows from the causal structure of responsibility: people rely on what the system is permitted to do, what it must record and how it recovers, not on whether yesterday’s planks are still in the hull.

Decision rule

Preserve the system identity only when the release preserves and evidences the approved obligation envelope. Otherwise preserve the history, but declare a new governed system.

Glossary

Approved anchor
A configured release and obligation set against which cumulative change is assessed.
Configured system
The exact models, data, prompts, policies, tools, topology, people and environment that produce effects.
Governed identity
A scoped continuity claim that previous obligations and approval still attach.
Obligation envelope
The tolerances and invariants covering behaviour, authority, evidence and recovery.
Risk-relevant trace
A sequence involving normal, edge, adversarial or interrupted conditions that may expose an obligation.
Semantic change manifest
A machine-readable link from release deltas to affected obligations, evidence and decision consequence.

References

  1. National Institute of Standards and Technology. AI Risk Management Framework Playbook: Manage. Guidance on monitoring, change management, recovery, component risk and post-deployment evaluation.
  2. National Institute of Standards and Technology. Secure Software Development Framework and SP 800-218A AI profile. Secure development practices across the software and AI model lifecycle.
  3. Supply-chain Levels for Software Artifacts. SLSA specification, version 1.2; and verifying artefacts. Provenance, expectations and verification.
  4. in-toto. What is in-toto? Supply-chain steps, authorised actors and ordered evidence.
  5. Open Containers Initiative. OCI Image Manifest Specification. Content-addressable image manifests and descriptors.
  6. SPDX. SPDX specifications. Standardised software-bill-of-materials and supply-chain metadata.
  7. World Wide Web Consortium. PROV-DM: The PROV Data Model. Entities, activities, agents and provenance relations.
  8. Semantic Versioning. Semantic Versioning 2.0.0. Version meaning relative to a declared public API.
  9. Liskov, B. and Wing, J. M. (1994). A behavioural notion of subtyping. Behavioural substitutability and preserved properties.
  10. Abadi, M. and Lamport, L. (1991). The existence of refinement mappings. Relating lower-level implementations to higher-level specifications.
  11. US Food and Drug Administration. Predetermined Change Control Plan for Artificial Intelligence-Enabled Device Software Functions. Planned modifications, validation methods and impact assessment.
  12. Sigstore. Cosign signature verification and in-toto attestation verification. Binding signatures and attestations to artefacts.
  13. The Update Framework. Security design and update attacks. Rollback, freeze, mix-and-match and wrong-software threats.