Reporting overview

An overview of the various reports:

Checklist Analysis Report

The checklist analysis provides a comprehensive insight into the overall situation of the checklists. Analysis is possible over time, by current status, and by frequency of use. Overdue checklists can thus be seen at a glance in order to drive processes forward. The detailed insight into the individual checks of a checklist allows open as well as negative checks to be analyzed in more detail. The same applies to created issues within a checklist.

Dashboard: Checklists Overview

• Number of checklists over time

• Number of checklists by status incl. overdue date

• Checklist frequency

• Checklists incl. planned execution date, status, assigned person as well as test object type and test object

Dashboard: Checklists Details

• Check details: open, answered and negative checks

  Number of negative checks of a checklist in percent

Dashboard: Issues in checklists

• Number of issues per checklist incl. detailed information such as status, planned execution date, overdue date and assigned person

Checklist Process Analysis Report

The checklist process analysis takes a closer look at checklists. The focus is on analyzing cycle times, process compliance, and different process variations. This dashboard can be used to analyze whether checklists have been executed according to expectations or whether further action is required. The evaluation of turnaround time is considered an indicator of process capability and is therefore an important metric in the area of process analysis.

• Dashboard: Checklists: Process cycle time overview

  • Process cycle time over time

    Average cycle time over time

    Average cycle time per test object type and test object

• Dashboard: Process cycle time checklists

  • Process activities incl. cycle time (checklist status)

  • Conformance of process activities

Check Result Analysis

Check result analysis provides detailed analysis of checks. Reporting makes it possible to analyze the number of check results over time, types of check results as well as their validity. In the case of numerical checks, the measurement results of a check can be evaluated on the basis of predefined target values as well as upper and lower limits. Statistical methods are the key here. With the help of a histogram and the box plot, deviations of individual numerical checks can be easily detected and targeted countermeasures can be taken. Differences can be recognized at a glance.

• Dashboard: Measurement results overview

  • Number of checks over time

  • Distribution of check types

  • Distribution of valid results

  • Detailed view of test object type, test object, checklist, check result, time stamp as well as result incl. validity

• Dashboard: Measurement Results Details

  • Negative checks as a percentage and in absolute terms by test object (type), checklist, page/section and check

• Dashboard: Numerical measurement results

  • Numerical checks over time incl. upper and lower limits as well as target value, negative checks in percent and distribution

Issue Analysis Report

Reporting provides insights into the world of issues and is divided into four dashboards. It supports the identification and analysis of issues in terms of number over time, by issue category in the form of a Pareto chart with drill-down function as well as by issue status. This makes it possible to see at a glance which issues still need to be closed and how many, if any, are overdue. The "Trend Chart" uses Six Sigma to show the course of the issues across all recorded data. Both the Pareto and the Trend Chart provide fundamental tools for controlling and minimizing risks in quality management.

• Dashboard: Issue Overview

  • Number of issues over time and by status

    Distribution by issue category and detailed information by test object

• Dashboard: Issue Details

  • Resolution times by test object type and test object

  • Relationship between number of issues and resolution time

  • Detailed information such as issue title, issue description, test object, planned execution date (incl. overdue date), status

• Dashboard: Issue Category

  • Distribution of issues by issue category

  • Resolution time by issue category

• Dashboard: Trend Chart

  • Trend of number of issues by category, test object type, test object, etc.

Issue Process Analysis Report

Through the Issue Process Analysis Reporting, the incurred issues can be analyzed in a fine-granular manner. In addition to insight into the lead times as well as the process conformity, valuable knowledge can be gained about the adherence to process conformity, the duration of the lead time until the correction of an Issue as well as the analysis of the different process variants. In addition, it can be seen whether the issues were closed in a compliant manner according to the dual control principle (issue resolved and verified).

• Dashboard: Issue: Process Lead Times Overview

  • Process throughputs over time

  • Average lead time by issue category

  • Average cycle time per test object type and test object

• Dashboard: Issue: Process cycle times

  • Process activities incl. lead time (checklist status)

  • Conformity of the process activities

• Dashboard: Issue: Process cycle times

  • Compliance with the dual control principle

  • Compliance with process conformity

Scoring Analysis

Scoring analysis is one of the most important quantitative analysis methods for decision-making in a company. By storing weightings for individual check results, it is possible to evaluate individual checklists on the basis of stored point numbers. Checks that have been carried out more than once are highlighted and can therefore be examined in more detail later on. This makes it possible to evaluate and analyze audits carried out in the company.

• Dashboard: Scoring Overview

  • Number of checklists over time incl. percent achieved

  • Checklists by status

  • Distribution of Checklists according to compliance with target value

  • Detailed information: Checkliste with achieved score according to test object type, test objects, executing person, status as well as planned execution date incl. overdue date.

• Dashboard: Scoring Details

  • Number of checklists over time incl. percent achieved

  • Percent achieved by section and check result

  • Detailed information on achieved score by test object type, test objects, executing person, status as well as planned execution date incl. overdue date, section, check result, target value, actual value, multiple execution

Statistical Result Analysis

With the help of the control chart, the digital business processes can be monitored and continuously checked over a defined period of time as part of the process analysis or risk analysis. The control chart compares the recorded data with the defined target values, warning limits, and intervention limits. In this way, it can be decided whether and to what extent countermeasures need to be taken. The detailed analysis of the measurement results with the most important key figures on maximum, minimum, median, average as well as the standard deviation provide informative information and statistical parameters about the recorded values of the selected check.

• Dashboard: Quality Control Chart Overview

  • checks incl. warning and intervention limits

  • Cpk value

  • Maximum, minimum, median, average as well as standard deviation

  • Distribution within as well as outside the warning and action limits

• Dashboard: Quality Control Chart Detail

  • Cpk, Cp, Cpu, Cpo

  • Checks by Cpk value

    • Checks below a Cpk value of 1.33 are highlighted in color.

Process Mining

Process Mining deals with the systematic analysis and evaluation of ACTUAL processes in the company. The process mining report enables the discovery of processes and the verification of conformities, whereby improvements in processes can be initiated. The aim is to identify inefficiencies such as repetitions or high throughput times as well as non-compliant process steps so that these can be eliminated and the competitive position strengthened. Based on the identification of the causes of process deviations, optimization potential is identified and improvement measures are derived. The additional process transparency achieved thus brings considerable added value for companies.

• Dashboard: Test object types and test objects

  • Throughput times of test object types and their test objects

• Dashboard: Checklist

  • Execution sequence of checklists incl. number of variants

  • Processing times and idle times of checklists

• Dashboard: Pages

  • Execution sequence of pages/sections incl. number of variants

  • Throughput as well as idle times of pages/sections

• Dashboard: checks

  • Execution order of checks incl. number of variants

  • Rework

• Dashboard: Checklist-Conformaty

  • Execution order as well as conformance of checklist activities

    • Example: Checklist was created -> Checklist was closed -> Checklist was opened -> Checklist was closed

  • Compliance with the dual control principle

Custom Field Analysis Report

Custom field analysis provides comprehensive insight into checklists as well as issues related to the custom fields. In doing so, checklists can be analyzed over time by current status as well as frequency of use by custom field. Furthermore, it gives a detailed insight into the individual checks of a checklist. Thus, open as well as negative checks are analyzed in more detail. Additionally, you can see which custom fields have the most negative checks on average.

• Dashboard: Custom Field Checklist Overview

  • Number of executed checklists by custom field (over time)

  • Number of executed checklists by test objects and checks

• Dashboard Custom Fields Checklist Details

  • Number of executed checklists by custom field (over time)

• Dashboard Custom Fields Issue Overview

  • Number of issues (over time and distribution) per custom value and status

  • Number of resolution time per custom value

• Dashboard Custom Fields Issue Detailsf

  • Number of issues by custom value per test object type and test object

  • Number of issues by custom values per issue category

Management Analysis Report

Management reporting refers to data-driven management. The most important key figures of the checklist, issue, inspection result and process analysis are combined. This enables a quick insight into the collected data. The most essential KPIs are compared over years to identify trends in the data.

• Dashboard: Checklists Overview

  • Number of checklists, test objects and tests.

• Dashboard: Issues Overview

  • Number of issues and resolution time in h.

• Dashboard: Measurement Results Overview

  • Number of test results, test objects, and the number of negative test results.

• Dashboard: Issue Process Overview

  • Number of process activities, process variants, process runs, and the ⌀ turnaround time in h.

• Dashboard: Checklists Process Overview

  • Number of process activities, process variants, process runs, and the ⌀ cycle time in h.