Smart Vision v2.3-Test Summary Report

Contents

 

  1. Purpose
  2. Executive Summary
  3. Test Execution Summary
    1. Jira Defects Tested
  4. Outstanding Defects in Release 2.3
  5. Areas not tested
  6. Known Issues / Limitations
  7. Test Result Reference

Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of release 2.3 for Smart Vision PWF.

Executive Summary

End to end functional and regression testing of Smart Vision PWF is completed.

Period of Testing: 7th May 2020 to 20th May 2021

Test Execution Summary

Sl No.

Area

Execution Status

Open Defects if any

1

Smart Vision 2.3

Completed

 

Jira Defects Tested

Smart Vision

Jira ID

Test Status

Comments

SDI-1034

Verified – QA Passed

SDI-1033

Verified – QA Passed

SDI-1030

Verified – QA Passed

SDI-1028

Verified – QA Passed

SDI-1026

Verified – QA Passed

SDI-976

Verified – QA Passed

SDI-969

Verified – QA Passed

SDI-330

Verified – QA Passed

SDI-1029

Verified – QA Passed

Outstanding Defects in Release 2.3

Innovation Engineering - Smart Vision - All Documents (sharepoint.com)

Areas not tested

N/A

Known Issues / Limitations

Module

Limitations

Invoice Extraction PWF

  • OCR data is incorrect, point and crop will not work properly
  • Accuracy Issue associated with tesseract model, hence documents whose rotation angle is 180 will be inverted
  • Extraction is not possible for FOI which are in dark background
  • Accuracy issue for line item data
  • Invoice extraction in DU is failing intermittently with errors
  • When a batch is processed in DU there is a delay in reflecting the invoice count in run list and updating the flags
  • 2 to 3 minutes delay is observed in updating accuracy analytics after the corrections
  • DUT Model prediction is not accurate when integrated in DU

 

Test Result Reference

Invoice Extraction PWF 

 # of User Stories

# of Test Cases

# of Open Defects (Critical/High/Med/Low)

Total

Fully
Passed

Partially
Passed

Total

Passed %

Critical

High

Medium

Low

Release 2.3

20

19

1

110

95.00%

0

0

6

3

Regression

 

160

90.00%

0

0

13

5

Feedback

Copyright © 2021 UST Global. All Rights Reserved.