SmartVision 2.4 Test Summary Report

Contents

Purpose
Executive Summary
Test Execution Summary
JIRA Defects Tested
Outstanding Defects in Release 2.4
Areas not Tested
Known Issues/Limitations
Test Result Reference

Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of release 2.4 for Smart Vision PWF.

Executive Summary

End to end functional and regression testing of Smart Vision PWF is completed.
Period of Testing: 2nd June 2020 to 27th July 2021

Test Execution Summary

Sl No.	Area	Execution Status	Open Defects if any
1	Smart Vision 2.4	Completed	44

JIRA Defects Tested

TFS ID	Description	Testing Status
54279	4066 Navistar : Wrong invoice count displayed in delete confirmation pop-up	QA Passed
54365	4067 RPFC: Date formatting missing in Pre-prod DU	QA Passed
44421	SDI-797 Navistar - Invoice went missing after successful extraction in DU	QA Passed
54371	4073 Navistar : Insight field value is disappearing when user clicks on edit value of next field.	QA Passed
56988	2.3/Prod/SmartVisionDelivery: 4155 Navistar-invoice extraction failed in DU due to Celery task failed ,Task timed out	QA Passed
56614	2.3/Prod/SmartVisionDelivery (4110) Navistar : First Invoice page was not switching when user clicked next button on review page	QA Passed
55919	2.3/Preprod/SmartVisionDelivery : 4084 Both buttons, Save and Close button are appearing in Insight field	QA Passed
57041	Populate Reject code and reason in send api - hotfix	QA Passed
55919	2.3/Preprod/SmartVisionDelivery : 4084 Both buttons, Save and Close button are appearing in Insight field	QA Passed
56819	2.3/Prod/SmartVisionDelivery (4122) Navistar: Point and select value copied was retained even for next invoice	QA Passed
55922	2.3/Preprod/SmartVisionDelivery : 4077 Value is not copying to insight field when using point and select option	QA Passed
53028	2.3.1/QAPaaS/SV: (4120) Point and select is not working on the first click	QA Passed
57476	2.3/PreProd/SmartVisionDelivery (4237) RPFC_AP: Negative signs are removed during extraction	QA Passed
52895	Bug 52895: (3814,3919,3945) Invoice failed in DU with - Unexpected system failure during step du.batch.tilt_correct	QA Passed
57173	Bug 57173: 2.3/preprod/SmartVisionDelivery (4214) : Navistar : Line item section move middle of the screen when using Dock to option	QA Passed
59320	2.3/Prod/SmartVisionDelivery (4370) Navistar : Review screen page was not loaded on clicking eye icon	QA Passed
57174	2.3/Preprod/SmartVisionDelivery (4217) Navistar : New document details was added with Corrected Approval data category while download invoice details	QA Passed
56821	2.3/Prod/SmartVisionDelivery (4123) Navistar-Reviewed invoice field value not found in the response of generatereport API	QA Passed

Outstanding Defects in Release 2.4

Outstanding defects available @ Sharepoint

Areas not Tested

Known Issues/Limitations

Module

Limitations

Invoice Extraction PWF

OCR data is incorrect, point and crop having open issues
Accuracy Issue associated with tesseract model, hence documents whose rotation angle is 180 will be inverted
Extraction is not possible for FOI which are in dark background
Accuracy issue for line item data
Invoice extraction in DU is failing intermittently with errors
When a batch is processed in DU there is a delay in reflecting the invoice count in run list and updating the flags
2 to 3 minutes delay is observed in updating accuracy analytics after the corrections
DUT Model prediction is not accurate when integrated in DU
Master config enhancement, Image Caching and Batch navigation US are having open issues

Test Result Reference

Invoice Extraction PWF	# of User Stories			# of Test Cases		# of Open Defects (Critical/High/Med/Low)
Invoice Extraction PWF	Total	Fully Passed	Partially Passed	Total	Passed %	Critical	High	Medium	Low
Release 2.4	26	25	1	160	85.00%	0	0	8	3
Regression				160	78.00%	0	0	21	12