About

The proposed 16th edition of the Workshop on Automated Testing (A-TEST) extends the previous editions of the A-TEST workshops (previously titled Workshop on Automated Test Execution) by joining with another well-known workshop that focuses on similar topics, i.e, INTUITESTBEDS (International Workshop on User Interface Test Automation and Testing Techniques for Event-Based Software). This unified event combines the strengths of both workshops to create a broader and more meaningful discussion, involving, at the same time, a wider range of researchers from both academia and industry. By bringing together experts from diverse fields, A-TEST aims to encourage richer collaboration and knowledge exchange across the testing community.

The proposed 16th edition of the Workshop on Automated Testing (A-TEST) will focus on the specific theme of automated UI Testing and automated UI-based Testing, including both Character User Interface (CUI) and Graphical User Interface (GUI) testing.

A-TEST 2025 will serve as a unique venue for sharing the latest research, ideas, and techniques surrounding automated UI Testing and automated UI-based Testing. The workshop aims to encourage collaboration and knowledge exchange across the testing community, bringing together experts to discuss advancements, challenges, and future directions.

A-TEST aims to bring together researchers, practitioners, and tool developers working on topics related to:

1. Automated user interfaces (UI) Testing of applications including both CUI and GUI.
2. Automated GUI testing of mobile, desktop, and web applications.
3. Automated testing of applications through their UI, including CUI and GUI.
4. Automated GUI-based testing of mobile, desktop and web applications, and web applications.
5. Automated CUI testing and CUI-based testing of legacy systems.
6. Testing of other types of event-driven software, such as network protocols, embedded software, IoT applications and devices, web services and device drivers.

The relevant topics on UI Testing and UI-based Testing include modeling and model inference, test case generation and execution, test oracles, coverage and metrics, evaluation, analysis and reporting, abstraction and reusability, interoperability and cross-platform testing, prioritization and optimization, and tooling and industrial experiences.

Keynote

Im­por­tant Dates

• Abstract Submission deadline: 10th of Jan 2025
• Submission deadline: 10th of Jan 2025
  
• Author notification: 3rd of Feb 2025
  
• Camera-ready Submission: 8th Mar 2025
• Workshop: 1st of April
  

All dates are 23:59:59 AoE

Venue

Congress Center, University of Naples Federico II, Naples, Italy

ICST 2025 will be held at the Congress Center of the University of Naples Federico II, one of the oldest universities in the world, founded in 1224 by Emperor Frederick II. Known for its rich history, the university has maintained a reputation for academic excellence and innovation throughout the centuries. The university comprises four schools and twenty-six departments, with an academic staff of more than 3,000 individuals and more than 100,000 enrolled students in total. It continues to be a beacon of cultural and educational advancement, fostering both local and international scholarly exchange.

The Congress Center where the conference will take place is located in Via Partenope, 36, right in front of the historical Castel dell’Ovo, the oldest standing fortification in Naples.

Call for Papers

16th edition of the Workshop on Automated Testing (A-TEST) co-located with the 18th IEEE International Conference on Software Testing, Verification and Validation (ICST 2025)

The proposed 16th edition of the Workshop on Automated Testing (A-TEST) will focus on the specific theme of automated UI Testing and automated UI-based Testing, including both Character User Interface (CUI) and Graphical User Interface (GUI) testing.

Topics for submission

We solicit novel papers related to the following topics (not strictly limited) in the context of user interface testing, testing through the user interface, and other event-based systems:

1. Model-Based UI Testing and Model Inference,
2. Test case generation and execution,
3. Test oracles design,
4. Test coverage criteria,
5. Metrics and evaluation for test effectiveness,
6. Scalability and performance optimization of automated UI Testing,
7. Context-Aware UI testing (i.e addressing the challenges of UI state variation during test execution)
8. Data analysis and reporting,
9. Abstraction and re-usability,
10. Interoperability and cross-platform testing,
11. Testing of non-functional requirements through the UI (i.g. security, reliability, usability, and performance)
12. AI and LLMs in Automated UI Testing
13. Automated testing strategies for event-driven software like network protocols, embedded software, and IoT applications and devices
14. Model-based testing for complex event-driven systems, including web services and device drivers
15. Tools and industrial experiences

The workshop will pay special attention to and actively encourage discussion on novel UI Testing and UI-based Testing techniques that leverage Large Language Models (LLMs).

Submission Guidelines

Submissions must conform to the IEEE conference proceedings template, specified in the IEEE Conference Proceedings Formatting Guidelines.

Paper formats:

1. Full paper: (max. 8-10 pages) describing original and completed research – either empircal or theoretical – in A-TEST related techniques, tools, ora industrial case studies;
2. Work-in-progress papers: (max. 4 pages) that describe novel, interesting, and highly potential work in progress, but not necessarily reaching its full completion;
3. Tool papers: (max. 4 pages) presenting some academic testing tool in a way that it could be presented to industry as a start of successful technology transfer;

EasyChair instance of ICST 2025, please select track ‘A-TEST 2025’: https://easychair.org/conferences/?conf=icst2025 .

Submissions will be peer-evaluated. Each submission will undergo a review process, receiving three reviews from members of the program committee, using a standard bidding process. Following reviews, there will be an online discussion, and finally, the organizers will make final decisions on acceptance, using referee reviews and conclusions of the discussions. Submissions accepted for presentation in the workshop will also be published in the workshop’s proceedings, which will appear in the IEEE digital library.

Organization Committee

Marco Da Luca

Programm Committee

• 
• Filippo Ricca

• Università di Genova

  Italy

• 

  Jean-Carlo Rossa-Hauk

  Universidade Federal de Santa Catarina

• 

  Martín Solari

  Universidad ORT Uruguay

  Uruguay

• 

  Tanja E. J. Vos

  Universitat Politècnica de València and Open Universiteit

Pre­vious Edi­tions

The A-TEST workshop has evolved over the years and has successfully run 7 editions since 2009. The first editions went by the name of ATSE (2009 and 2011) took place at the CISTI (Conference on Information Systems and Technologies, http://www.aisti.eu/). The three subsequent editions (2012, 2013 and 2014) at FEDCSIS (Federated Conference on Computer Science and Information Systems, http://www.fedcsis.org). In 2015 there was an ATSE2015 at SEFM year and an A-TEST2015 at FSE.