Back To Schedule
Tuesday, September 24 • 1:30pm - 2:15pm
Testing of AI Systems

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
There are two main challenges to testing systems that incorporate elements of artificial intelligence (AI). First, the same input can trigger different responses as an AI system learns and adapts to new conditions, and second, it is difficult to understand what the correct response really should be. Such behavior violates one of the main principles of traditional testing: the repeatability of test case execution. Testers lose confidence in the outcome of their testing when traditional approaches no longer apply. Yury Makedonov explains how testing can be improved if we have direct access to the system’s state (grey box testing). He provides a demonstration of a simple “machine learning” system to show some grey box testing techniques. In the second part of his presentation Yury discusses test data challenges using a “pattern recognition” model as an example. These data handling techniques can be used for both cases of grey box and black box testing (when we can’t access the state of AI system). You can apply these techniques to a wide range of AI systems, ranging from simple machine learning systems to complex neural networks.


Yury Makedonov

Yury Makedonov was trained as a researcher and worked in a research and development institution dealing with composite materials. He has a Ph.D. degree in physics and math, though he is not a rocket scientist anymore; now he is using his skills and knowledge to improve software quality... Read More →

Tuesday September 24, 2019 1:30pm - 2:15pm EDT
Essex Room