Test Criteria and Certification of AI Systems

QuantPi is an associated partner in the German Lighthouse Project on the development of testing criteria, audit processes, and certification requirements for AI systems.

With new AI-based business models the proven reliability and comprehensive quality standards of intelligent applications and systems are becoming increasingly important. The testing of AI applications plays a central role in this. What requirements do they have to meet? What are the benefits of tested AI applications?

The EU AI Act is expected to enter into force. Many important guidelines and requirement frameworks for the use of AI systems have been formulated. Yet, legislators, industry, and society agree that the still abstract requirements for trustworthy AI must be made more concrete and operationally implementable.


The Challenge

Quality criteria for an AI application depend heavily on the application context; the corresponding measures vary depending on the AI ​​technology used. This is what happens with an automated analysis of application documents, the requirements differ from those of an image recognition process for detecting damage on car bodies. Practical procedures are needed so that companies from a wide range of industries can use and prepare for the adoption of and compliance with the AI ​​Act.


QuantPi’s Contribution:

Fraunhofer IAIS, together with the German Federal Office for Information Security (BSI) and the German Institute for Standardization (DIN), as well as, other research partners, are developing testing procedures for the certification of artificial intelligence systems.


As an associated partner, QuantPi is proud to support the project in sharing best practices on the operationalization of AI testing in workshops and events. For example, QuantPi’s Chief Scientist and Co-Founder, Dr. Antoine Gautier, gave a talk on unified aspects of conformity assessment of AI in the workshop on foundation models in November 2023.


The aim is to ensure technical reliability and a responsible use of technology. Industrial needs are taken into account through the active involvement of numerous associated companies and organizations, which represent different sectors such as telecommunications, banking, insurance, chemicals and trade.

More Information: