Concept Systems All articles
Integration Strategy

Auditable by Design: What the New UK Data Regime Asks of Your Interfaces

Concept Systems
Auditable by Design: What the New UK Data Regime Asks of Your Interfaces

Legal commentary on the Data (Use and Access) Act tends to focus on consent wording, regulator powers and the finer points of lawful processing. That is understandable, but it can obscure where the operational work actually lands. For most UK organisations, the difficult questions will not be answered in a policy document. They will be answered at the interface: which system sent which data, for what purpose, to whom, under which notice version, and whether access can be withdrawn when it should be.

The argument here is simple. The Act is not principally an integration statute, but its operating model is deeply integration-shaped. Purpose limitation, records of access, data-sharing arrangements and revocable permissions are not abstract principles. They are API contracts, event schemas, token lifetimes, retention rules and reconciliation reports. Treat them as a legal wrapper around existing systems and the compliance evidence will be thin. Treat them as design requirements for the integration layer and the evidence becomes a by-product of normal operation.

Compliance is a boundary control, not a back-office form

Many organisations can describe their data protection policy. Fewer can answer a more practical question: if a partner received customer data last Tuesday, can you prove exactly which fields were shared, under which purpose, using which version of the customer notice, and when that access ceased?

If the answer depends on a spreadsheet, an email trail and the memory of a delivery manager, the control is not reliable. The Act and the wider UK data regime increase the expectation that organisations can evidence how data moves and how access is constrained. That evidence has to be generated at the point of movement. A report assembled after the fact is a reconstruction, not an audit trail.

This is why the integration layer matters. It is where purpose can be attached to a request, where scope can be limited to a specific subject or dataset, where a partner can be authenticated, and where revocation can be propagated. None of those controls can be applied consistently by a policy team working separately from the systems that actually exchange data.

A worked example: CRM, warehouse and partner

Consider a mid-sized UK housing association with around 40,000 tenants. It runs a CRM for customer records, a data warehouse for reporting, and a partner system for a support service. The current flows are familiar. A nightly CSV extract moves CRM records into the warehouse. A secure file transfer sends a subset of customer data to the partner. A consent or preference flag sits in the CRM and is updated by contact-centre staff.

On paper, the organisation has a data-sharing agreement and a privacy notice. In practice, it has three problems. Revoking a preference takes up to 24 hours to reach the partner because the transfer is a nightly file. The warehouse keeps historical copies with no clear lineage back to the notice version that applied at the time. The partner receives a flat file with no per-subject access control, so the organisation cannot demonstrate that access was limited to the customers who had agreed to the service.

An auditable-by-design version of the same architecture would look different.

First, the organisation would define a canonical customer identifier and a small set of purpose codes. These would be carried in every integration message, not inferred from the destination system.

Second, the partner integration would move from a flat file to a scoped API. The partner would authenticate with short-lived credentials and receive only the subjects and fields required for the service. Access would be time-bound and tied to a service agreement reference.

Third, every movement would emit an audit event with a consistent envelope: event identifier, subject identifier, purpose code, notice version, timestamp, source system, destination system and correlation identifier. The warehouse would store these events in an append-only audit store, separate from analytical tables that can be reshaped or deleted.

Fourth, revocation would be an explicit interface. When a customer withdraws permission, the CRM would publish a revocation event. The integration layer would call the partner revocation endpoint and record the acknowledgement. The warehouse would mark the relevant records as restricted and retain the audit event. The partner would confirm deletion or suppression within an agreed service level.

What auditable by design actually looks like

There are five properties worth designing for.

Traceability. Every exchange has an identifier that can be followed across systems. A subject access request or an internal audit should not require a manual reconstruction from three teams and four log files.

Purpose limitation. Purpose is a field in the message, not a paragraph in a contract. If a partner integration cannot state its purpose code, it is not ready to go live.

Revocability. Withdrawal of consent or a change in permission has a defined propagation path and a measurable service level. A nightly batch may be acceptable for some data, but it is a poor fit where access must stop promptly.

Minimisation. The interface shares the fields required for the purpose, not the whole customer record because it is easier to reuse an existing extract.

Evidence. Audit events are retained according to a defined schedule, protected from alteration, and available to the people who need them. Logs for operators and audit events for accountability are not the same thing.

The uncomfortable part

Most integration teams already have logging. What they often lack is an audit event schema with ownership, versioning and retention rules. They have monitoring for availability, but not for purpose or permission. They have partner file transfers that work, but cannot answer detailed questions about scope and revocation without a manual investigation.

That is the gap the new regime exposes. It is not closed by buying a governance tool or rewriting a privacy notice. It is closed by making the integration layer produce the evidence as a normal consequence of doing its job.

Questions for the integration brief

Before the next compliance milestone, UK organisations should be able to answer a short set of questions. Which interfaces carry personal data, and what purpose code applies to each? Where is the authoritative record of permission, and how quickly does a change reach every downstream system? Can a partner access a single subject without receiving a bulk file? Which audit events are emitted, where are they stored, and who owns their schema? How is notice version recorded at the point of sharing? And can the organisation demonstrate revocation through to partner acknowledgement?

These are not legal questions in isolation. They are integration questions with legal consequences. The organisations that answer them early will find the compliance evidence easier to produce. The ones that leave them until after the deadline will discover that the hardest part of data governance is not writing the policy. It is proving what the interfaces actually did.

All Articles

Related Articles

The Interfaces Nobody Owns: Auditing Integration Debt Before It Becomes an Incident

The Interfaces Nobody Owns: Auditing Integration Debt Before It Becomes an Incident

The 2am Test: Matching Data Movement to the Team That Must Run It

The 2am Test: Matching Data Movement to the Team That Must Run It

Exit Is an Architecture, Not a Clause: Making Cloud Portability an Integration Discipline

Exit Is an Architecture, Not a Clause: Making Cloud Portability an Integration Discipline