Standard Chartered
United Kingdom · Banking · 2025
In the AI Verify Foundation's Global AI Assurance Pilot (February to May 2025), PwC acted as independent tester of a generative AI tool Standard Chartered built to draft personalised client emails for wealth relationship managers, a tool that was itself still in an internal pilot. PwC turned the requirements in the tool's system prompts into a structured checklist and ran batch tests on synthetic client profiles and edge cases, using an LLM as a judge to find hallucinations and contradictions against the input data and to score completeness, coherence, engagement and internal compliance, alongside NLP similarity metrics for robustness. Human subject matter experts scored a subset of drafts on the same framework to check that the automated judge was calibrated. The published case study reports the method and the effort involved, not the test results, which it says are confidential.
No outcome disclosed.