AIOct 7, 2021

Automated Testing of AI Models

arXiv:2110.03320v1
Originality Synthesis-oriented
AI Analysis

This work addresses the need for reliable AI models by providing an incremental extension to an existing testing framework.

The paper extended the AITEST framework to include testing techniques for image and speech-to-text models and interpretability testing for tabular models, making it a more comprehensive tool for AI model testing.

The last decade has seen tremendous progress in AI technology and applications. With such widespread adoption, ensuring the reliability of the AI models is crucial. In past, we took the first step of creating a testing framework called AITEST for metamorphic properties such as fairness, robustness properties for tabular, time-series, and text classification models. In this paper, we extend the capability of the AITEST tool to include the testing techniques for Image and Speech-to-text models along with interpretability testing for tabular models. These novel extensions make AITEST a comprehensive framework for testing AI models.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes