About

The 17th edition of the Workshop on Automating Testing (A-TEST 2026) focuses on the challenges of testing AI systems and AI-enabled software. Testing AI systems is difficult because their behaviour is often probabilistic, context-dependent, and continuously evolving. Existing challenges such as reproducibility, test coverage, and the definition of suitable test oracles become significantly harder in AI systems, especially for systems based on generative AI and large language models. The workshop aims to bring together researchers and practitioners from academia and industry to discuss these topics.

Concrete topics of interest for the workshop and its call for papers include, but are not limited to:

• Testing of AI-based and AI-enabled systems
• Test oracles and evaluation for AI systems
• Test coverage and adequacy for AI systems
• Human-in-the-loop test processes
• Measurement, metrics, and benchmarks for AI quality
• Empirical studies and industrial experiences
• Critical thinking in education and training for better testing and responsible usage of AI systems
• Process-based evaluation of testing education

Organization Committee

Pre­vious Edi­tions

The A-TEST workshop has evolved over the years and has successfully run 7 editions since 2009. The first editions went by the name of ATSE (2009 and 2011) took place at the CISTI (Conference on Information Systems and Technologies, http://www.aisti.eu/). The three subsequent editions (2012, 2013 and 2014) at FEDCSIS (Federated Conference on Computer Science and Information Systems, http://www.fedcsis.org). In 2015 there was an ATSE2015 at SEFM year and an A-TEST2015 at FSE.