Validating ModelPack

This page will provide a walk-through for validating the performance of Vision models that have been trained using ModelPack in EdgeFirst Studio, through the end-to-end worklows or Training ModelPack. This page will focus only on the validation of Vision models. Please see the link attached for instructions on Validating Fusion Models.

Select the Validator Tool

Select "Validate Sessions" from the tool options.

Specify the Project

Specify the project to run validation at the center of the top menu bar.

Create Validation Session

Create a new validation session by clicking the "NEW SESSION" button on the top right.

Configure the settings on the left panel by specifying the name of the validation session, the model file to validate, and the dataset to deploy. Next configure the settings on the right panel by specifying the validation parameters. Additional information on these parameters are provided by hovering over the info button.

Start the Session

Start the session by clicking the "START SESSION" button on the bottom right.

Session Progress

The validation session has now started while the progress is tracked on the left panel and additional information and status is shown on the right panel.

Completed Session

Once completed, the status will be shown as complete.

Validation Metrics

The metrics are shown by clicking the button that views the validation charts on the top left of the session card.

See Validation Metrics for further details.

Comparing Metrics

It is also possible to compare validation metrics for multiple sessions.
This is done by checking the checkboxes on the top left of the session cards.

Compare the validation sessions by clicking the "COMPARE VALIDATE SESSION" button. This will display the validation metrics side by side for the specified validation sessions.

Next Steps

Now that you have validated your Vision model, follow these next steps for deploying your Vision model.