AIOps 2.1 - Test Summary Report

‎Definitions and Acronyms Used

List the definitions and acronyms used in this document in alphabetical order

Acronym / Item

Expansion / Definition

PWF

Packaged WorkFlow

‎Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of AIOps Release 2.1.0/2.1.1.

Executive Summary

End to end functional and regression testing of AIOps is completed.

Period of Testing: 27th August 2021 to 4th October 2021

Test Execution Summary

Sl No.

Area

Execution Status

Comments

1

AIOps PWF

Completed

 

Jira Defects Tested

N/A

Outstanding Defects in Release 2.1

AIOps 2.1 Open Defects

 

Areas not tested

N/A

Known Issues / Limitations

Module

Limitations(Deferred Defects)

AIOps PWF

  • Dashboard Alert Pattern – Range indicator of alert Pattern is not positioned centrally to widget or vertically to the right of widget

  • Sync with ITSM for ticket updates will be affected, when there are multiple projects’ API channels in use simultaneously.

  • Alert Processing report from Alert console will show error message to choose shorter time range when API scanner channel polls empty results continuously for long time.

  • Email Channels should be created and authenticated from service account in incognito window to have it working.

  • Multi realm projects’ dashboard should be accessed from different browsers if accessed simultaneously

  • Email Template - fields been missed in incoming alert template, data in other fields gets added with wrong data.

  • Email Verba Template - Alert id, More information URL is not captured in Elastic search. Alert Attribute if not hostname OID, is not captured.

  • Email Template - Additional details if added to solarwinds mail format, gets added to previous field data in ES

  • Alert listing - Auto Refresh - No maximum limit validation available. Entering larger value does not work as expected.

  • AIOps currently support iHUB channel’s – Queue, API Scanner and Email only. Queue channel - Add/Edit is possible only via API.

  • Same email id cannot be configured in multiple source emails of Extract email workflow.

Test Result Reference

AIOps PWF 

# of User Stories

# of Test Cases

# of Open Defects (Critical/High/Med/Low)

Total

Fully
Passed

Partially
Passed

Total

Passed %

Critical

High

Medium

Low

Release 2.1.0/2.1.1

24

24

0

359

99%

0

0

3

2

Regression Release 2.1

 

 

 

718

99%