Use Cases

AI Agents for KYC Onboarding With a Clear Audit Trail

An AI agent can collect documents, extract fields, and prepare screening files for KYC. A human should own each decision. This guide covers the audit trail, error checks, and a safe pilot.

Chase Dillingham

Chase Dillingham

Founder & CEO, TrainMyAgent

9 min read 7 sources cited
KYC AML Customer Due Diligence Financial Services Audit Trail
Person's hands filling out a tax form beside a calculator and notebook
Photo by Kelly Sikkema on Unsplash

AI agents for KYC onboarding work best as preparers, not deciders. The agent chases documents, pulls out fields, and builds the screening file. A human makes the call.

This split saves the most time with the least regulatory risk. It also gives you a clean audit trail, because every decision has a named person behind it.

I write from a U.S. bank perspective, since that is where the rules are most specific. This is operator advice, not legal advice. Run your design past your compliance team.

Where Onboarding Time Goes

Think of an onboarding file as a pile of small jobs. Most of the time goes to the jobs around the decision, not the decision itself.

The U.S. Customer Due Diligence rule sets four core requirements: identify and verify customers, identify and verify the beneficial owners of companies opening accounts, understand the nature and purpose of the relationship to build a customer risk profile, and monitor on an ongoing basis. For beneficial owners, institutions identify and verify any individual who owns 25 percent or more of a legal entity, plus one individual who controls it.

Now map that to the work for a business customer:

  • Ask the customer for formation documents, IDs, and ownership details.
  • Chase the missing pieces. Again.
  • Read each document and key the data into the system.
  • Work out who owns what, through layers of entities.
  • Run names through screening and sort the hits.
  • Write up the file and route it for approval.

I don’t have a reliable public benchmark for how the hours split across these steps, and I would not trust a vendor number. Time your own process for two weeks. My guess, based on how most teams describe it, is that chasing and rekeying take more hours than the actual risk judgment. Measure it before you build.

Document Chase and Extraction

This is the safest place to start. Nothing here decides anything.

The chase. The agent checks each file against a checklist for the customer type. It spots what is missing or expired. It sends a request through your approved channel, tracks replies, and sends reminders on a schedule you set. When the customer replies, it matches the attachment to the open request.

The extraction. The agent reads each document and pulls fields into a structured record: legal name, registration number, address, officers, ownership percentages, ID numbers and dates. For each field it keeps a pointer to the source page and the text it read. For when to use a language model and when plain OCR is enough, see document extraction: LLM vs OCR.

Rules that keep this safe:

  1. Never overwrite a source document. Store the original untouched.
  2. Show source next to value. A reviewer should see the field and the snippet it came from side by side.
  3. Flag, don’t guess. If a name is smudged or two documents disagree, mark it as a discrepancy. Do not pick one.
  4. Compare across documents. Name spelled differently on the ID and the registry extract? Surface it.

The identification program rules in 31 CFR 1020.220 ask banks to record the identifying information, a description of each document relied on (type, number, place and dates of issuance), the methods and results of verification, and how any substantive discrepancy was resolved. An agent that already tags each field with its source makes that record easier to produce. The discrepancy resolution still needs a person to write it.

Screening Prep

Screening is where the agent saves analysts the most reading, and where it is easiest to go wrong.

Sanctions, watchlist, and adverse media checks produce hits. Many are false matches: same name, different person. An analyst then spends minutes per hit gathering context to say so.

The agent can do the gathering. It should not do the clearing.

What the agent prepares for each hit:

  • The customer’s identifiers: full name, aliases, date of birth, nationality, address, and registration details.
  • The matched record’s identifiers, side by side.
  • Which fields agree and which differ. A different birth year or country is useful evidence.
  • Name variants and transliterations that explain the match.
  • For adverse media, the source, the date, and a short factual summary with the link.
  • A suggested category, such as “likely different person” or “needs review,” with its reasoning.

The suggestion is an input. The analyst reads the evidence and decides.

The federal banking agencies issued an interagency statement on model risk management for BSA/AML systems in April 2021. A few points matter for you. Whether a system counts as a model is a bank-specific call. For automated monitoring, prudent practice includes periodic review and testing of the filtering criteria and thresholds, plus independent validation of the methodology and effectiveness. And banks remain responsible for BSA/AML compliance when they use third-party models, so they should do reasonable due diligence on the vendor and understand how the model works.

Read that as a buyer. If a vendor says “our AI clears alerts,” ask what is validated, by whom, and how you can test it on your data. See questions to ask an AI agent vendor.

Human Disposition: What Stays With People

Here is my line. The agent prepares. A person decides.

Decisions that stay human:

  • Clearing or escalating a screening hit.
  • Approving, declining, or restricting an account.
  • Assigning or changing a customer risk rating.
  • Deciding that activity is suspicious and whether to file.
  • Resolving a discrepancy in identity or ownership.
  • Exiting a relationship.

Why draw the line there? Three reasons.

First, accountability. The interagency statement says banks remain responsible for BSA/AML compliance even when they use third-party models. A named analyst’s sign-off is a clear record of who decided.

Second, timing and confidentiality in suspicious activity work. Under 31 CFR 1020.320, banks file a SAR within 30 calendar days of initial detection, extendable to 60 if no suspect is identified. A SAR, and anything that would reveal its existence, is confidential. The agent should not draft customer-facing messages that touch on this, and its logs need tight access controls.

Third, over-correction. The FATF has said that wholesale cutting loose of entire classes of customers is not in line with its standards. Risk should be judged case by case. An agent that auto-declines by category is a de-risking engine.

For design patterns that put people in the right places, see human-in-the-loop AI agents.

Audit Trail for Examiners

Examiners care whether your process works and whether you can show it. I’d expect that to hold when the process includes an agent.

The FFIEC examination procedures for customer due diligence ask examiners to check things such as these:

  • Written, risk-based CDD procedures.
  • Effective processes to develop customer risk profiles.
  • Guidance for documenting the analysis behind due diligence, including how to resolve insufficient or inaccurate information.

Your agent’s log should let you answer each one with evidence. Log these for every file:

ItemWhat to record
IdentityCase ID, customer ID, agent run ID, agent version
InputsEach document received, with hash and timestamp
ExtractionEach field, its value, and the source page and text
DiscrepanciesWhat conflicted, and who resolved it, with their note
ScreeningLists checked, list version and date, query used, hits returned
Agent suggestionCategory, evidence shown, reasoning
Human decisionReviewer name, decision, time, rationale
OverridesAny case where the reviewer disagreed with the agent
Model and prompt versionsSo you can reproduce what the agent saw
AccessWho viewed or exported the record

Retention matters. The CIP rule requires keeping verification records for five years after the record is made, and identifying information for five years after the account closes. SAR copies and support are kept five years from filing. Set retention to the longest rule that applies and confirm with counsel.

For a fuller log design, see what to log in an AI agent audit trail. Also give the agent its own identity and the minimum access it needs; the guide on non-human identity for AI agents covers that.

Fairness and Error Checks

Agents make mistakes in patterns. Build checks that find the patterns.

Extraction errors. Sample completed files weekly. A second person checks field values against sources. Track the error rate by document type and by field. Names, dates, and ownership percentages deserve the closest look.

Name matching bias. Name matching can behave differently across languages, scripts, and naming conventions. Test your screening prep on names from the populations you actually serve. Compare how often the agent suggests “needs review” across groups, and look for gaps you cannot explain. Do this with your compliance and legal team, since the right fairness tests depend on your products and rules.

Threshold drift. The interagency statement points to periodic review and testing of filtering criteria and thresholds. Put that on a calendar. Re-test after any change to the model, the prompt, or the watchlists.

False positives. I could not find a trustworthy public benchmark for false-positive review rates, so measure your own. Track hits per 1,000 files, share cleared as false matches, minutes per hit with and without the agent’s prep, and how often analysts override the suggestion. A falling minutes-per-hit with a stable override rate is a good sign. A falling override rate with no explanation is a warning: analysts may be rubber-stamping.

Escapes. Sample “cleared” and “approved” files for review by a senior analyst. Count the ones that should have gone the other way. That number is the one regulators care about.

A Safe Pilot Scope

Regulators have said innovation is welcome. A December 2018 joint statement from FinCEN and the federal banking agencies said innovative pilot programs should not by themselves subject banks to supervisory criticism, even if they prove unsuccessful, and that pilots exposing gaps will not necessarily result in supervisory action. Still, tell your regulator-facing team and your compliance officer before you start.

My recommended pilot:

  1. One segment. Pick one customer type, such as domestic small businesses, with a clear checklist. Skip complex ownership structures and high-risk jurisdictions at first.
  2. Prep only. The agent chases, extracts, and prepares. Humans do all dispositions.
  3. Run in parallel. For the first batch, analysts complete files the normal way, and the agent’s output is compared against theirs. Disagreements teach you the most.
  4. Set the success metric up front. For example, analyst minutes per file, share of files complete on first review, and extraction accuracy on key fields. Set a quality floor that must hold.
  5. Set stop rules. Define what error rate ends the pilot.
  6. Keep the log from day one. Build it before the first customer file, not after.
  7. Review weekly with compliance in the room.

Widen scope only when the numbers hold for a stretch you chose in advance. For the broader picture of agents in this sector, read AI agents in financial services.

Bottom Line

Use the agent for the work around the decision: chasing, extracting, and preparing. Keep every disposition with a named person.

Log enough that an examiner can follow any file from document to decision. Measure your own error and false-positive rates instead of trusting a vendor claim.

Next step: pick one customer segment, write the checklist, and design the log before you write any agent code.

FAQ

Can AI do KYC? AI can do much of the preparation: collecting documents, extracting fields, comparing sources, and assembling screening evidence. The decisions should stay with people, and the bank stays responsible for compliance. I would not let an agent clear hits, set risk ratings, or approve accounts on its own.

What stays human? Clearing or escalating screening hits, approving or declining accounts, setting risk ratings, resolving identity or ownership discrepancies, deciding whether activity is suspicious, and exiting relationships. The agent prepares the evidence for each of these.

What do examiners want to see? They want written risk-based procedures, working processes for customer risk profiles, and documented analysis, including how missing or inaccurate information was resolved. For an agent, add the version history, validation of any thresholds, and a record of who decided each case.

How do I reduce false-positive review? Have the agent gather the context an analyst would otherwise hunt for: identifiers side by side, which fields match, name variants, and sourced adverse media. That cuts minutes per hit. Keep the analyst as the decider, and track override rates so you can spot rubber-stamping.

What is a safe pilot? One customer segment, prep-only agent, humans on every decision, a parallel run against analyst work, a fixed success metric and stop rule, and a full audit log from day one. Involve compliance before the first file.

Three Ways to Work With TMA

Need an agent built? We deploy production AI agents in your infrastructure. Working pilot. Real data. Measurable ROI. → Schedule Demo

Want to co-build a product? We’re not a dev agency. We’re co-builders. Shared cost. Shared upside. → Partner with Us

Want to join the Guild? Ship pilots, earn bounties, share profit. Community + equity + path to exit. → Become an AI Architect

Need this implemented?

We design and deploy enterprise AI agents in your environment with measurable ROI and production guardrails.

About the Author

Chase Dillingham

Chase Dillingham

Founder & CEO, TrainMyAgent

Chase Dillingham is the founder and CEO of TrainMyAgent. He spent 15+ years as an enterprise architect deploying production systems. Now he builds AI agent platforms that deliver measurable ROI.

Connect with Chase Dillingham on LinkedIn