SmartVision 2.6 - Test Summary Report


Contents

  1. Definitions and Acronyms Used
  2. Purpose
  3. Executive Summary
  4. Test Execution Summary
    1. 3.1 Jira Defects Tested
  5. Outstanding Defects in Release 2.6
  6. Areas not tested
  7. Known Issues / Limitations
  8. Test Result Reference

Definitions and Acronyms Used

List the definitions and acronyms used in this document in alphabetical order

Acronym / Item

Expansion / Definition

PWF

Packaged Workflow

 

 

Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of release 2.6 for Smart Vision PWF.

Executive Summary

Regression testing of Smart Vision PWF is completed.

Period of Testing: 7th February 2022 to 14th February 2022

Test Execution Summary

Sl No.

Area

Execution Status

Open Defects if any

1

Smart Vision 2.6 Regression

Completed

8

3.1 Jira Defects Tested

 

ID

Title

Status

57893

2.3/Preprod/SmartVisionDelivery (4280) : RPFC AP: Reject / Escalate Reason is not visible when the screen size is 100%

QA Verified

71347

2.5/Stage/Smart vision Task Lost Error

QA Verified

72237

2.5/Pre-prod/Smartvision 6641: Delivery Line item fields moved to Insight in 2.5 in custom models

QA Verified

72255

2.5.0/Stage/SV - The insight fields became blank soon after the 'approval' of invoice

QA Verified

72257

2.5/Preprod/SmartvisionDelivery 6648 RPFC AP: User was not able to submit an old file(Softvalidation_flag)

QA Verified

72404

2.5/Preprod/Smartvision 6674 Navistar: User was not able to Split and create a new invoice.

QA Verified

72492

2.5/Preprod/Smartvsion 6666 Navistar: Save and Submit did not respond when there were UI validation error.

QA Verified

74696

2.5/Prod/Smartvision (7032) RPFC: Upgrading the model of the projects without impacting the existing DU project configurations

QA Verified

75148

2.5/Preprod/SmartVision Issue with DU project import api

QA Verified

75744

2.5/Prod/SmartVision (7058) RPFC AP : Date format has changed and special characters missing in Address

QA Verified

75750

2.5/Prod/DU (7013) POP POD Extraction issue 21ID22506 was extracted as 211D22506

QA Verified

75752

2.5/Prod/DU (7074) RPFC AP Production : Task Lost, Job failed - No active task found for job

QA Verified

75861

2.5/Prod/SmartvisionDelivery (7077) Navistar - Line Items disappear when external service validation error in pdf view

QA Verified

 

Outstanding Defects in Release 2.6

 

Innovation Engineering - Smart Vision - All Documents (sharepoint.com)

 

Areas not tested

N/A

Known Issues / Limitations

Module

Limitations

Invoice Extraction PWF

  • Delay in image rotation and in point and select feature when applied over the rotated document.

  • Delay in loading documents in document listing page

  • Minor alignment issues in document review page when user tries to ‘Dock to Right’

  • OCR data is incorrect, point and crop having open issues like delay and new document issues

  • Document specific failures when OCRmyPDF is selected.

  • Accuracy Issue associated with tesseract model, hence documents whose rotation angle is 180 will be inverted

  • Extraction is not possible for FOI which are in dark background

  • Accuracy issue for line item data

  • Invoice extraction in DU is failing intermittently with errors

  • When a batch is processed in DU there is a delay in reflecting the invoice count in run list and updating the flags

  • 2 to 3 minutes delay is observed in updating accuracy analytics after the corrections

  • DUT Model prediction is not accurate when integrated in DU

  • Intermittently document review page is showing blank after approval of document

 

 

Test Result Reference

Invoice Extraction PWF 

# of User Stories

# of Test Cases

# of Open Defects (Critical/High/Med/Low)

Total

Fully
Passed

Partially
Passed

Total

Passed %

Critical

High

Medium

Low

Release 2.6 - Regression

00

00

0

318

98.00%

0

0

6

2