Smart Vision 2.5 - Test Summary Report

Contents

Definitions and Acronyms Used
Purpose
Executive Summary
Test Execution Summary

Jira Defects Tested

Outstanding Defects in Release 2.5
Areas not tested
Known Issues / Limitations
Test Result Reference

Definitions and Acronyms Used

List the definitions and acronyms used in this document in alphabetical order

Acronym / Item	Expansion / Definition
PWF	Packaged Workflow

‎

Purpose

The purpose of this document is to summarize the end to end testing activities performed by QA team as part of release 2.5 for Smart Vision PWF.

Executive Summary

End to end functional and regression testing of Smart Vision PWF is completed.

Period of Testing: 16^th August 2021 to 19^th October 2021

Test Execution Summary

Sl No.	Area	Execution Status	Open Defects if any
1	Smart Vision 2.5	Completed	27

Jira Defects Tested

ID	Title	Status
60308	2.3/Prod/SmartVisionDelivery (4524) RPFC - Production: Error 'value' while approving file	QA Verified
60946	2.3/Prod/SmartVisionDelivery (4585) RPFC AP: No date invoice was loaded with current date	QA Verified
60948	2.3/Prod/SmartvisionDelivery (4556) Navistar : Split was not happening properly	QA Verified
61487	2.3/Production/SmartVisionDelivery (4644) Constant growth in du-rest memory and subsequent restarts	QA Verified
62411	2.3/Production/SmartVisionDelivery (4794) : RPFC AP Production: IndexError : list index out of range during step du.batch.inv.image_ocr	QA Verified
64281	2.4/Prod/SmartvisionDelivery(4994,5161,5359,5383,5491):Navistar,RPFC - du extraction failed due to version conflict ( du.batch.inv.page_split)	QA Verified
64586	2.4/Prod/SmartVisionDelivery (5037)RPFC AR Production Cluster 2- Validation URL not shown in UI	QA Verified
66610	2.4/Prod/Smartvision (5222)RPFC CS Production: Category total count is mismatch with file listed under it	QA Verified
67752	2.4/Prod/SmartVision (5368) - Navistar:System Failure_ModuleNotFoundError	QA Verified
68055	2.4/Prod/SmartvisionDelivery 5370,5384(Navistar,RPFC)Missing File in DU :Zip File extraction failed due to ConflictError	QA Verified
68309	2.4/Stage (5452)IQVIA-invalid preprocessors submitted error on saving from DU project Extraction Info tab	QA Verified
66768	2.4/Prod/SmartvisionDelivery (5223) RPFC CS Production: Redirecting to another project when refresh the page	QA Verified
53804	4027 Navistar-invoice extraction failed in DU with evaluate Zero Division Error: float division by zero	QA Verified

Outstanding Defects in Release 2.5

Innovation Engineering - Smart Vision - All Documents (sharepoint.com)

Areas not tested

N/A

Known Issues / Limitations

Module

Limitations

Invoice Extraction PWF

Delay in image rotation and in point and select feature when applied over the rotated document.
OCR data is incorrect, point and crop having open issues like delay and new document issues
Document specific failures when OCRmyPDF is selected.
Accuracy Issue associated with tesseract model, hence documents whose rotation angle is 180 will be inverted
Extraction is not possible for FOI which are in dark background
Accuracy issue for line item data
Invoice extraction in DU is failing intermittently with errors
When a batch is processed in DU there is a delay in reflecting the invoice count in run list and updating the flags
2 to 3 minutes delay is observed in updating accuracy analytics after the corrections
DUT Model prediction is not accurate when integrated in DU

Test Result Reference

Invoice Extraction PWF	# of User Stories			# of Test Cases		# of Open Defects (Critical/High/Med/Low)
Invoice Extraction PWF	Total	Fully ‎Passed	Partially ‎Passed	Total	Passed %	Critical	High	Medium	Low
Release 2.5	29	29	0	318	100.00%	0	0	3	7
Regression				282	100.00%	0	0	6	11