AI Tester Accreditation Programme (AI TAP) accredits testing service firms that can technically assess AI systems for safety, reliability, and governance risks. Accredited firms are recognised by AI Verify Foundation as having possessed the technical competencies and operational readiness to evaluate AI systems against a defined scope. AI systems developers and deployers, and their end users will have greater confidence in the AI that have been tested by the accredited firms.
This is the first programme of its kind in Asia, aiming to establish what good AI assurance testing looks like.
As AI adoption accelerates, the importance of having AI systems independently assessed is increasing. However, technical testing services which require specialised expertise remain in nascent supply. Businesses thus face a challenge in selecting qualified third party AI testing firms to technically assess their AI systems. This creates an opportunity for AI Verify Foundation to work with the industry to shape the standards for technical testing.
The programme aims to build a pipeline of competent testing firms that can assess AI systems across industries, from healthcare and finance to recruitment and public services. This will provide businesses greater confidence in the assessments made by accredited testing firms, which they can use to build confidence with their stakeholders.
| Technical Testing Service Providers | Benefits |
|---|---|
| Companies that offer a business service (not just testing product) around the technical testing of Generative AI applications |
|
Interested assurance testing service providers will be assessed according to the following criteria:
| Focus | Evaluation | Objective |
|---|---|---|
| Testing Service Assessment | Technical | Ensure technical competency by validating claimed specific testing services against guidelines e.g., IMDA Starter Kit for Testing LLM-Based Applications for Safety and Reliability |
| Company Assessment | Good Standing | Ensure good standing through relevant track record, with a commitment of business activity in Singapore |
| Financials | Ensure financial sustainability | |
| Operations | Ensure operational readiness and capacity | |
| Business Scope | Ensure declared business scope matches actual capabilities |
Your organisation’s background – Could you briefly share your organisation’s background (e.g. sector, goods/services offered, customers), AI solution(s) that has/have been developed/used/deployed in your organisation, and what it is used for (e.g. product recommendation, improving operation efficiency)?
Your AI Verify use case – Could you share the AI model and use case that was tested with AI Verify? Which version of AI Verify did you use?
Your experience with AI Verify – Could you share your journey in using AI Verify? For example, preparation work for the testing, any challenges faced, and how were they overcome? How did you find the testing process? Did it take long to complete the testing?
Your key learnings and insights – Could you share key learnings and insights from the testing process? For example, 2 to 3 key learnings from the testing process? Any actions you have taken after using AI Verify?