A-Test banner

The workshop will be held in Singapore

November 17-18, 2022

Co-located with ESEC/FSE 2022 

About

For the past twelve years, the Workshop on Automating Test Case Design, Selection and Evaluation (A-TEST) has provided a venue for researchers and industry members alike to exchange and discuss trending views, ideas, state of the art, work in progress, and scientific results on automated testing.

Following the success of the past years, the 13th edition of A-TEST will continue to be co-located with and organised at ESEC/FSE 2022. A-TEST 2022 is planned to take place over two days preferably in person in Singapore (if the COVID-19 situation allows).

Testing is at the moment the most important and mostly used quality assurance technique applied in the software industry. However, the complexity of software, and hence of their development amount, is increasing.

Even though many test automation tools are currently available to aid test planning and control as well as test case execution and monitoring, all these tools share a similar passive philosophy towards test case design, selection of test data and test evaluation. They leave these crucial, time-consuming and demanding activities to the human tester. This is not without reason; test case design and test evaluation through oracles are difficult to automate with the techniques available in current industrial practices. The domain of possible inputs (potential test cases), even for a trivial method, program, model, user interface or service is typically too large to be exhaustively explored. Consequently, one of the major challenges associated with test case design is the selection of test cases that are effective at finding flaws without requiring an excessive number of tests to be carried out. Automation of the entire test process requires new thinking that goes beyond test design or specific test execution tools. These are the problems that this workshop aims to attack.

The 2022 edition of the A-TEST is organized as a co-located workshop of ESEC/FSE 2022.

Venue

 
The workshop will be a hybrid organization. Please see the ESEC/FSE’22 website for details about the registration.

Im­por­tant Dates

 

  • Abstract Submission deadline: July 24th, 2022 (non mandatory)
  • Submission deadline: July 28th, 2022
  • Author notification: September 2nd, 2022
  • Camera-ready Submission: September 9th, 2022
  • Student Competition Submission: TBD
  • Workshop Notification: August 31st, 2022
  • Workshop: November 17-18, 2022

All dates are 23:59:59 AoE

Call for Papers

 

Authors are invited to submit papers to the workshop, and present and discuss them at the event on topics related to automated software testing. Paper submissions can be of the following types:

Full papers (max 8 pages, including references) describing original, complete, and validated research – either empirical or theoretical – in A-TEST related techniques, tools, or industrial case studies.

Work-in-progress papers (max. 4 pages) that describe novel, interesting, and high-potential work in progress, but not necessarily reaching full completion (e.g., not completely validated)

Tool papers (max. 4 pages) presenting some testing tool in a way that it could be presented to industry as a start of successful technology transfer.

Technology transfer paper (max. 4 pages) describing industry-academia co-operation.

Position papers (max. 2 pages) that analyse trends and raise issues of importance. Position papers are intended to generate discussion and debate during the workshop.

Topics of interest include, but are not limited to:

  • Techniques and tools for automating test case design, generation, and selection, e.g., model-based approaches, mutation approaches, metamorphic approaches, combinatorial based approaches, search-based approaches, symbolic-based approaches, chaos testing, machine learning testing.
  • New trends in the use of machine learning (ML) and artificial intelligence (AI) to improve test automation, and new approaches to test ML/AI-based systems.
  • Test case and test process optimization.
  • Test case evolution, repair, and reuse.
  • Test case evaluation and metrics.
  • Test case design, selection, and evaluation in emerging domains like graphical user interfaces, social networks, the cloud, games, security, cyber-physical systems, or extended reality.
  • Case studies that have evaluated an existing technique or tool on real systems, empirical studies, not only toy problems, to show the quality of the resulting test cases compared to other approaches.
  • Experience/industry reports.
  • Education of (automating) testing.

Call for hands-on

A-TEST also offers an opportunity to introduce novel testing techniques or tools to the audience in active hands-on sessions. The strong focus on tools in this session complements the traditional conference style of presenting research papers, in which a deep discussion of technical components of the implementation is usually missing. Furthermore, presenting the actual tools and implementations of testing techniques in the hands-on sessions allows other researchers and practitioners to reproduce research results and to apply the latest testing techniques in practice. The invited proposals should be:
hands-on proposals (max. 2 pages) that describe how the session (with a preferred time frame of 3 hours) will be conducted.

Submission

All submissions must be in English and in PDF format. At the time of submission, all papers must conform to the ESEC/FSE 2022 Format and Submission Guidelines. A-TEST 2022 will employ a single-blind review process.

Papers and proposals will be submitted through EasyChair: 

https://easychair.org/conferences/?conf=atest22

Each submission will be reviewed by at least three members of the program committee. Full papers will be evaluated on the basis of originality, importance of contribution, soundness, evaluation, quality of presentation, and appropriate comparison to related work. Work-in-progress and position papers will be reviewed with respect to relevance and their ability to start up fruitful discussions. Tool and technology transfer papers will be evaluated based on improvement on the state-of-the-practice and clarity of lessons learned.

Submitted papers must not have been published elsewhere and must not be under review or submitted for review elsewhere during the duration of consideration. To prevent double submissions, the chairs may compare the submissions with related conferences that have overlapping review periods. The double submission restriction applies only to refereed journals and conferences, not to unrefereed pre-publication archive servers (e.g., arXiv.org). Submissions that do not comply with the foregoing instructions will be desk rejected without being reviewed.

All papers must be prepared in ACM Conference Format.

All accepted contributions will appear in the ACM Digital Library, providing a lasting archived record of the workshop proceedings. At least one author of each accepted paper must register and present the paper in person at A-TEST 2022 in order for the paper to be published in the proceedings.

Organization Committee

A-TEST TEAM

General Chairs

Ákos Kiss (University of Szeged, Hungary)

 

Program Co-Chairs

Beatriz Marín (Universidad Politècnica de Valencia, Spain)

Mehrdad Saadatmand (RISE Research Institutes of Sweden, Sweden)

Student Competition Chairs

Niels Doorn (Open Universiteit, The Netherlands)

Jeroen Pijpker (NHL Stenden, The Netherlands)

Publicity & Web Chair

Antony Bartlett (TU Delft, The Netherlands)

All questions about submissions should be emailed to the workshop organisers at atest2022@easychair.org

Pro­­gram­­me Com­­mi­t­tee

 

Rui Abreu INESC-ID & U.Porto
Domenico Amalfitano University of Naples Federico II
Nuno Antunes University of Coimbra
Alexandre Bergel University of Chile
Matteo Biagiola Università della Svizzera italiana
Markus Borg RISE SICS AB
Mariano Ceccato University of Verona
Marcio Eduardo Delamaro University of São Paulo
Julian Dolby IBM
Lydie du Bousquet LIG
Anna Rita Fasolino University of Naples Federico II
Mattia Fazzini University of Minnesota
Alessio Gambi IMC University of Applied Science Krems, Austria
Tamás Gergely Department of Software Engineering, University of Szeged
Mahshid Helali Moghadam RISE Research Institutes of Sweden
Onur Kilincceker Department of Computer Science, Antwerp
Maurizio Leotta Università di Genova
Alexandra Mendes FEUP
Ana Paiva University of Porto
Gordana Rakic Faculty of Science, Novi Sad
Rudolf Ramler Software Competence Center Hagenberg
Filippo Ricca DIBRIS, Università di Genova – Italy
Martin Schneider Fraunhofer
Gerson Sunyé Université de Nantes
Guilherme Travassos COPPE/UFRJ
Jan Tretmans TNO – Embedded Systems Innovation
Michele Tufano College of William and Mary