Changing application quality metrics settings

The Application Quality settings provides configurable options related to quality metrics. You can change the default settings for metrics displayed to meet your business needs.

Note: To change settings to enable the EnableBuiltOnAppSelectionForQuality toggle that allow you to select which built-on applications are included, your operator ID must have the SysAdm4 privilege.

On the Application Quality settings landing page, you can modify the following settings for application quality:

  • Application(s) included – If you want the test coverage report to include only rules from the current application, select Current application only. If you want the test coverage report to also include rules from built-on applications, select Include built-on applications. By default, only the current application is selected. If you enable the EnableBuiltOnAppSelectionForQuality toggle, you can select which built-on application will be included.
    Note: If a master user starts an application-level coverage session for an application, then that user's configuration of this setting is in effect for all users that execute test coverage for the duration of the session.
  • Ignore test rulesets when calculating Guardrail score – When you enable this setting, the guardrail score is calculated without taking test rulesets into account. This is the default behavior. When you disable this setting, test rulesets are taken into account when calculating the guardrail score.
  • Quality trends – Use this setting to change the date range of the trend graphs on the Application Quality, Application: Test coverage and Application: Unit testing landing pages. The default value is Last 2 weeks.
  • Test case execution – Use this setting to change the number of days, from the time that they are executed that tests are treated as executed by the Application Quality dashboard and coverage reports. By default, a test executed later than the last seven days is excluded from the Application Quality dashboard and in reports.
  • Scenario test case execution – Use this setting to add a delay (in milliseconds) to the execution of all the steps in all the scenario tests in an application. For more information, see Delaying scenario test execution.
  • Re-run tests automatically on failure – Use this setting to automatically rerun scenario tests if they fail, up to a maximum of two times. For more information, see Automatically rerunning failed scenario tests.