ITOps 1.4-Test Summary Report

Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of ITOps Release 1.4.

Executive Summary

End to end functional and regression testing of ITOps is completed.

Period of Testing: 20th Apr 2021 to 21st May 2021

Test Execution Summary

Sl No.

Area

Execution Status

Comments

1

ITOps PWF

Completed

*Surge Testing-  in-progress in PT

Jira Defects Tested 

ITOps

Jira ID

Test Status

Comments

SDI-959

Verified – QA Passed

 

SDI-961

Verified – QA Passed

 

SDI-893

Verified – QA Passed

 

SDI-970

Verified – QA Passed

 

SDI-973

Verified – QA Passed

 

SDI-972

Verified – QA Passed

 

SDI-729

Verified – QA Passed

 

SDI-978

Verified – QA Passed

 

SDI-1021

Verified – QA Passed

 

SDI-1013

Verified – QA Passed

 

SDI-1036

Verified – QA Passed

 

SDI-914

Verified – QA Passed

 

SDI-979

Verified – Reopened

 

Outstanding Defects in Release 1.4

 

ITOps 1.4 Open Defects

 

Areas not tested

N/A

Known Issues / Limitations

Module

Limitations(Deferred Defects)

ITOps PWF

  • Dashboard Alert Pattern - With top 5 alerts for each day with different alert names coming in for different days, selecting large duration in date filter - X axis data goes not readable
  • Email Template - fields been missed in incoming alert template, data in other fields gets added with wrong data.
  • Email Verba Template - Alert id, More information URL is not captured in Elastic search. Alert Attribute if not hostname OID, is not captured.
  • Email Template - Additional details if added to solarwinds mail format, gets added to previous field data in ES
  • Alert listing - Auto Refresh - No maximum limit validation available. Entering larger value does not work as expected.
  • ITOps currently support iHUB channel’s – Queue, API Scanner and Email only. Queue channel - Add/Edit is possible only via API. 
  • Same email id cannot be configured in multiple source emails of Extract email workflow.
  • Dashboard - Since SLA values are not available in ES from service now- MTTR, Resolution SLA and Top 10 alerts widgets related to SLA not validated.

Test Result Reference

ITOps PWF 

 # of User Stories

# of Test Cases

# of Open Defects

(Critical/High/Med/Low)

Total

Fully 

Passed

Partially  Passed

Total

Passed %

Critical

High

Medium

Low

Release 1.4

7

6

1

309

90%

0

2

29

7

 

 

Regression Release 1.4

 

273

98%

 

 

 

Feedback

Copyright © 2021 UST Global. All Rights Reserved.