The companies listed below have been accredited by AI Verify Foundation (AIVF) under the AI Tester Accreditation Programme (AI TAP), following an assessment of the companies’ technical competencies in testing AI systems for specified risks and using specified testing methods (see below), and companies’ readiness to provide AI testing services to other organisations such as AI developers and deployers.
AI TAP recognises demonstrated technical testing competencies of accredited testing firms. However, AIVF does not certify that testing conducted by accredited testing firms are independent, nor does it certify that AI systems tested by accredited testing firms are completely safe and reliable.
AI testing and assurance is an emerging and evolving field. Currently, there is a lack of international or industry standards to accredit AI systems testing firms for their technical competence in testing AI systems for safety and reliability. The market consists of a diverse range of service providers with different backgrounds and business models. Some organisations specialise in AI testing and assurance, while others provide AI testing as an extension of broader professional, technology, cybersecurity, audit or other services. Testing approaches, tools and market practices also continue to evolve as AI technologies and their applications develop.
Against this background, AI TAP provides a common basis for recognising demonstrated technical competencies in testing AI systems against specific safety and reliability risks. Accreditation is scoped to the specific risk areas and testing methods, in which each accredited testing firms has claimed, and demonstrated the required expertise and experience. AI TAP does not endorse all services offered by the accredited testing firm.
As part of the technical assessment, accredited testing firms are assessed on their demonstrated capability to test Generative AI systems across 2 dimensions:
Accreditation is granted only for the specific testing methods and risk areas in which the testing firm has demonstrated the required technical competency. The specific testing competencies for which each organisation is accredited are indicated below.
TESTING METHODS
Benchmarking
RISK AREAS
Hallucination & Inaccuracy
Undesirable Content
Bias & Fairness
TESTING METHODS
Benchmarking
Red Teaming
RISK AREAS
Undesirable Content
Bias & Fairness
TESTING METHODS
Benchmarking
Red Teaming
RISK AREAS
Undesirable Content
Bias & Fairness
TESTING METHODS
Benchmarking
Red Teaming
RISK AREAS
Undesirable Content
Bias & Fairness
TESTING METHODS
Red Teaming
RISK AREAS
Undesirable Content
Bias & Fairness
AI TAP seeks to maintain confidence in the accreditation programme as the AI testing ecosystem develops. Organisations that engage an AI TAP-accredited tester and encounter issues relating to the testing services provided may share their feedback with assurance@aiverify.sg.
Feedback received may be considered by AIVF in the administration and continued development of AI TAP, in accordance with the applicable AI TAP terms and processes.
