Validating Modelpack

This page will provide a walk-through for validating the performance of Vision models that have been trained using Modelpack in EdgeFirst Studio, through the QuickStart Guide or Training Modelpack. This page will focus only on the validation of Modelpack.

Select the Validator Tool

Select Validator from the tool options.

Tool Options

Specify the Project

Specify the project to run validation at the center of the top menu bar.

Project Selection

Create Validation Session

Create a new validation session by clicking the create button on the top right of the page.

Create New Session

Configure the settings on the left panel by specifying the name of the validation session, the model file to validate, and the dataset to deploy. Next configure the settings on the right panel by specifying the validation parameters.

Note

Additional information on these parameters are provided by hovering over the info button.

Validation Options

Start the Session

Start the session by clicking the START SESSION button on the bottom right.

Start the Session

Session Progress

The validation session has now started while the progress is tracked on the left panel and additional information and status is shown on the right panel.

Validation Session

Validation Session Fields

Completed Session

Once completed, the status will be shown as complete.

Completed Session

Validation Metrics

The metrics are shown by clicking the button that views the validation charts on the top left of the session card.

Validation Metrics

Note

See Validation Metrics for further details.

Comparing Metrics

It is also possible to compare validation metrics for multiple sessions.
This is done by checking the checkboxes on the top left of the session cards.

Comparing Sessions

Compare the validation sessions by clicking the COMPARE VALIDATE SESSION button on the top left. This will display the validation metrics side by side for the specified validation sessions.

Metrics Side-by-Side