Independent Assurance

Know why your AI is right

Back to AI for AML

Using AI for AML requires confidence not only in what the system produces, but in when its output can be relied on, when it should be challenged and where additional review is needed.

What we assess and how

We can help assess whether an AI solution performs reliably for its intended AML use case and whether the surrounding controls are appropriate for how the solution is used.

We test the solution against relevant AML cases, looking for issues such as missed risk indicators, loss of important context, unsupported conclusions and differences in performance across customer or case types. Where weaknesses are identified, we investigate whether they originate from the data, model, prompts or instructions, system configuration, or the way the solution is used in practice.

We also assess whether analysts can trace outputs back to supporting information, understand the basis for the result and recognise when further review or challenge is required.

Tested against relevant AML cases
What we look for
Missed risk indicators
Loss of important context
Unsupported conclusions
Uneven performance across customer or case types
Where it originates
Data
Model
Prompts or instructions
System configuration
Use in practice

Scope and findings

We can provide full-scope validation of AI models or just provide testing of parts of the AI solutions, based on your needs.

Our findings explain where the solution performs well, where weaknesses remain and how those weaknesses could affect AML assessments. We provide prioritised recommendations covering both the solution itself and the controls around it.

Testing over time

Where relevant, we can also establish repeatable testing and evaluation frameworks so that future changes to models, prompts, data sources or other system components can be assessed against an agreed baseline.

Agreed baselineSet once, used for every change
A changeModel, prompts, data sources or other components
AssessedAgainst the baseline before it is used

Independent Assurance can be applied to solutions developed internally, provided by a third party or built by Frank Penny.

What you get

Independent assessment
Performance testing
Risk & control findings
Prioritised recommendations
Assurance report

Let’s up your AI