Smartops Release Notes

Click here to see this page in full context

UST SmartOps™ uses cognitive automation to intelligently and continuously accelerate business opportunities by reducing costs, streamlining efficient operations, and uncovering unrealised growth revenues for your business.

SmartVision Release 2.4

Release Date: 28 July 2021

Document Type Classifier

Handwritten Classifier

Document Quality Classifier

Ability to attach custom Post Processors


Accuracy improvements for Pre-trained models

Scale SV PWF to support multiple document types

Multiple feature enhancements in Document review screen

Overview

In 2.4 release, we are adding Document Type Classifier that would help you to process multiple document types within a single DU project. Keyword based & AI driven document type classifiers can segregate documents into multiple buckets like Invoices, Purchase Orders, Adjustments Notes etc. AI based Handwritten Classifier will classify handwritten prescription notes from printed ones. Additionally, we are enhancing the Document Quality Classifier to provide a better prediction of the quality of documents. Hereafter DU has the flexibility to perform custom post processing from projects.

SmartVision PWF would be scaled to support multiple document types within the same SV project. There are multiple enhancements planned in Document Review screen – ability to navigate across batches, multi-select feature for add/delete operations in review pane, enhanced PDF view, ability to adjust the display order of fields of interest. Going forward, Invoice duplicate validation (based on invoice number & vendor code) can be configured during project setup.

Capability to retain a subset of data during data archival process is implemented. Updates to UI library components is done for an improved user experience. Platform upgrades to concurrency feature is adapted in SmartVision PWF as well.

It also includes accuracy improvements for pre-trained models under Australia locale – Invoices, Purchase Orders, Remittance Advices & Adjustment Notes

Document Type Classifier

Classification of documents is critical for most business processes and organizations which continuously look for ways to systematically handle it. In this release we are adding two types of document classifiers

Zero shot document classifier - Follows a natural language inference based zero shot text classification approach
Keyword/Regex based classifier – Classification based on the keywords or expressions input by the user

CMS classifier is upgraded to accept new keywords from the user. This would continue to be used in legal domain for classification of MSA, SOW & Addendums.

Upon classification, for each document type, user has the provision to configure the fields of interest for extraction.

Handwritten Classifier

AI driven classifier to systematically segregate the handwritten documents from printed ones. In 2.4, support is available only for prescription notes. DU includes a provision to exclude these documents from extraction pipeline – instead of configuring the fields, user can select “no extraction” option.

Document Quality Classifier

Document Quality Classifier is enhanced to predict the quality in reference to the fields of extraction. This would help us better correlate the extraction accuracy with the quality of the document. The documents are classified as good/medium/bad quality and is displayed in the Advanced Analytics Dashboards.

Ability to attach custom post processors in project

Diversity of documents across customers makes it necessary to apply customer specific post processing to improve the extraction accuracy. Hence the DU field config is upgraded to include additional parameters that allow project specific overrides. For example, “post_skip_lines_keywords” can be used to exclude specific rows from the table after extraction.

Improvements to Orientation Correction pre-processor

Added support for Searchable PDF
Improved results on files with 90 degree orientation

Accuracy improvements to the pre-trained models

Invoice model for Australia locale [AUS/Finance/Invoice]
Claim Adjustment Note for Australia locale [AUS/Finance/Adjustment Notes]
Remittance Advice for Australia locale [AUS/Finance/Remittance Advice]
Purchase Order for Australia locale [AUS/Finance/Purchase Order]
New Invoice model for US locale [Local model]

Scale SV PWF to support multiple document types

In 2.4 release, SV PWF is upgraded to support multiple document types if the underlying DU project supports extraction for multiple document types. User will have the provision to configure the fields of interest, validations & transformations for each document type during the project set up. Document listing page will display the document type and Preview screen would display the fields of interest depending upon the document type. In case of incorrect classifications, user will have the provision to manually update the document type and enter the corresponding fields of interest.

Documents that are excluded from DU extraction will also be listed in PWF dashboard. Manual fields if configured will be listed in the preview screen. User can review and approve or reject these documents.

All the functionalities available in SV PWF will be enhanced to support multiple document types within the same SV project. The document download from the application is changed to Excel spreadsheet and data for each document type will be populated in separate tabs.

Feature Enhancements in SV PWF

Enable Batch navigation in preview screen
As of today, preview screen allows navigation of documents within a batch. User needs to switch batch to document listing page to pick the next page. This frequency becomes high in scenarios where the batch has very less documents and thereby impacts the productivity of the reviewer. To circumvent this situation, we are adding the capability to switch across batches from the preview screen. Batches which has any errors would be highlighted in preview screen as well to notify the reviewer.
Provision to define the display order of Insights & Table Fields of Interest [FOI)
Going forward, user will have the provision to define the FOI display order as part of the project creation. While adding the extraction fields of interest in DU, user can drag & adjust the FOIs in the desired order. This order would be used for display purpose in preview screen.
Enhancement to multi-select option in review pane to support add & delete operations
User can bulk select rows using the multi-select and either delete or add to line items. In case of a table with lot of noise, user can opt to add the relevant rows to line item table rather than spending time on clean up.
Navigation pane converted as floating menu to improve the PDF view
Enhancements in Data Archival
Provision to configure the below during archival process
- Specify project
- Project specific timelines
- Retain project specific data during archival
Technical Improvements
- UI library component updates to adhere to UX standards and improve on overall application user experience
- Adopted platform upgrades to concurrency feature in SV PWF. Concurrent execution of workflows is allowed by default, but this feature will enable us to control the concurrent execution if needed.
- Adapt the master configuration enhancements in platform – change from static to dynamic configurations.
- Transaction support for listeners, REST services
- Avoid Elastic index refresh during updates

(3945) Navistar: DU- Message lost failure
(3814) Navistar: DU- Invoices taking longer in progress state than expected
(4080) Navistar - Able to select future date in picker for Advanced Filter
(4121) Navistar : Field name is not displayed in boarder when clicks on edit button.
(4262) Navistar : Edit mode was enabled in Line item section even for next invoice
(4085) Navistar : Not able to edit the field value on review page by double clicking on field.
(4217) Navistar : New document details was added with Corrected Approval data category while download invoice details
(4214) Navistar : Line item section move middle of the screen when using Dock to option
(3919) Navistar du extraction failed due to TesseractNotFoundError
(4123) Navistar-Reviewed invoice field value not found in the response of generatereport API
(4779) RPFC AP Production: ValueError
(4452) RPFC AP Production: failure in processing invoice in DU
(4451) RPFC AP Production: failure in processing invoice in DU
(4374) RPFC - Rotated PDF processing failure in DU