ITEA is the Eureka Cluster on software innovation
ITEA is the Eureka Cluster on software innovation
ITEA 4 page header azure circular

Failure analysis

Project
18022 IVVES
Description

When failure grouping and similarity scoring is done automatically by a machine, it will free resources from development team member to fix the most important failures in their CI/CD pipeline. It is tedious work for a human to download, open and read all the test failures and analyze which failures belong to the same group. The failureanalysis package solves this problem by processing xunit xml files and failures found within by calculating the similarity score of failures using cosine similarity.

Contact
Mark van Helvoirt, Philips
Email
mark.van.helvoort@philips.com
Technical features

Open Source Code: https://github.com/F-Secure/failures-analysis https://github.com/F-Secure/failures-analysis/issues

Input(s):

  • xunit test result files

Main feature(s):

  • Tests failure analysis provides fast and reliable way to find and group similar failures in your CI pipeline

Output(s):

  • Find similar errors between tests
Integration constraints
  • Python 3.8 or never
  • numpy 1.23.4 or never
  • pandas 1.5.1 or never
  • sklearn 1.1 or never
  • lxml 4.9.1 or never
  • drain3 0.9.11 or never
Targeted customer(s)

Software development team members, like developers and QA people. Teams with CI pipeline with decent amount of test automation result.

Conditions for reuse

Apache License 2.0

Confidentiality
Public
Publication date
29-11-2022
Involved partners
Philips Electronics Nederland BV (NLD)