The problem
Screening lists and politically-exposed-person screening clears the easy alerts and leaves a stubborn residual where certainty runs out: the same common name, a partial date of birth, an ownership chain that may or may not connect a customer to a sanctioned official. At a large regulated enterprise, that residual was worked entirely by hand, and it is where cost, risk and regulatory exposure concentrate. A rules-only control is defensible to a regulator but cannot investigate ambiguity, so the manual queue never shrinks.
I designed the architecture: an autonomous multi-agent investigation feeding a deterministic decision gate. Agency lives in the investigation; the verdict stays deterministic.
Why it was hard
The failure modes point in opposite directions. Let a model decide matches and you have an unexplainable control in the most heavily scrutinised corner of the enterprise. Keep everything rules-based and the residual stays manual forever. The design had to hold both: genuine investigative autonomy where the work is reading, tracing and correlating, and mechanical reproducibility where the work is deciding.
Identity resolution itself is adversarial terrain. The entities worth screening hide behind aliases, layered corporate structures and family relationships, and the evidence is spread across registries, filings and adverse media of wildly uneven quality. Long investigations also degrade agent systems in a specific way: early errors and stale retrievals compound through a growing context, which is exactly what a reviewer later cannot untangle.
And every element had to survive scrutiny under model risk requirements: reproducible dispositions, evidence for every claim, a person accountable for every match.
Key decisions
Five candidate architectures were evaluated against weighted criteria and a set of binary boundary tests. One option, and only one, passed every boundary test and led the weighted evaluation: a staged pipeline in which deterministic classification and identity matching take first crack at every case, and only the residual they cannot close reaches the agents.
The disposition is fixed by a deterministic gate: a transparent, calibrated score over independent signal families spanning names and aliases, geography, professional context, network relationships and demographic plausibility, anchored so that several independent signals must corroborate before any recommendation stands. No model output feeds the gate directly, only evidence.
Case state is reconstructive rather than cumulative. Each stage rebuilds a minimal sufficient state from the governed case object: what is established, what is open, what evidence supports each claim, nothing else. Full history lives in the audit log, never in the prompt.
Before a true-match recommendation reaches the gate, an independent reviewer agent re-derives it from the evidence pack alone, without sight of the investigator agent's reasoning. It cannot be persuaded, only convinced by the same facts, which turns agreement into corroboration rather than compliance.
Architecture
Signals arrive from screening systems and case queues. Deterministic screening closes the clear cases. The residual flows to the identity inference agent, which resolves identity ambiguity, traces beneficial ownership through corporate and family structures, reads adverse media, and assembles a cited evidence pack in which every claim maps to a retrieved source. The independent reviewer re-derives the recommendation, the deterministic gate scores it, and a human investigator decides every match and every escalation.
All model calls cross a central gateway carrying prompt management, model routing, data scanning, token metering, long-retention audit and a hard per-case cost ceiling. A hallucination check strips unsupported claims, and a bad citation forces regeneration: the system cannot show a material claim unless it can say, mechanically, where the claim came from.
Trade-offs
The deterministic gate caps how clever the system is allowed to be, and that cap is the feature: fluent reasoning about a possible match is investigation material, never a verdict. Reconstruction over accumulation costs assembly work at every stage, but it keeps token cost roughly linear across a long investigation, stops one bad retrieval contaminating every later step, and makes any stage replayable in isolation, which is the property a model risk reviewer asks for and rarely gets. The independent reviewer roughly doubles inference on high-consequence recommendations; on a restricted parties-adjacent decision, that is cheap insurance.
Governance
Every claim maps to a source. Every disposition is reproducible from the case object and the calibrated score. Every positive and every escalation routes to a person, and the decision log is auditable end to end. The gateway enforces the cost ceiling and the audit trail as infrastructure rather than convention, so no individual build can quietly opt out. This is the shape financial regulators keep asking for: explainability as a data structure, not as prose written after the fact.
Outcome
Analysts move from clearing volume to working the genuinely hard cases, with the investigation done and cited before they open the file. The pattern is extending across the financial-crime estate on the same evidence-first architecture: drafting of suspicious-activity reports, restricted parties decision support, and agent assistance for fraud disputes. Agents recommend and humans decide, everywhere.
What I learned
Separate agency from authority and most of the governance argument dissolves; the fight only exists when one component tries to hold both. Independent derivation is the strongest form of agreement: a reviewer that has read the investigator's reasoning is a reviewer that can be talked into things. And in screening work, the residual is the product. Anyone can automate the easy matches; the value and the risk both live in the cases where certainty runs out.