Validating Fusion Models

This page will provide a walk-through validating the performance of Fusion models that have been trained in EdgeFirst Studio, through the end-to-end workflows or Training Fusion. This page will focus only on the validation of Fusion models. For instructions on how to validate Vision models, please see Validating ModelPack.

Checkout our video tutorial above as part of the EdgeFirst Studio Series to showcase the steps for running Fusion validation in EdgeFirst Studio. Otherwise, follow the steps below with section specific timestamps of the video.

Select the Validator Tool

Select "Validate Sessions" from the tool options.

Tool Options

Specify the Project

Specify the project to run validation at the center of the top menu bar.

Project Selection

Create Validation Session

Create a new validation session by clicking the "NEW SESSION" button on the top right of the page.

Create New Session

Configure the settings on the left panel by specifying the name of the validation session, the model file to validate, and the dataset to deploy. Next configure the settings on the right panel by specifying the validation parameters.

Additional information on these parameters are provided by hovering over the info button. The only augmentation available for this type of validation is blur. See Vision Augmentations for further details.

Validation Options

Start the Session

Start the session by clicking the "START SESSION" button on the bottom right.

Start the Session

Session Progress

The validation session has now started while the progress is tracked on the left panel and additional information and status is shown on the right panel.

Validation Session

Completed Session

Once completed, the status will be shown as complete.

Completed Session

Validation Session Attributes

Validation Metrics

The metrics are shown by clicking the button that views the validation charts on the top left of the session card.

Validation Metrics

The metrics provides the precision, recall, F1, and IoU scores of the model at the specified window sizes. Additional charts are provided for the precision vs. recall and bird’s eye view heatmaps describing where the model performs well and where the model makes errors.

See Validation Metrics for further details.

Comparing Metrics

It is also possible to compare validation metrics for multiple sessions.
This is done by checking the checkboxes on the top left of the session cards.

Comparing Sessions

Compare the validation sessions by clicking the "COMPARE VALIDATE SESSION" button. This will display the validation metrics side by side for the specified validation sessions.

Metrics Side-by-Side

Next Steps

Now that you have validated your Fusion model, follow these next steps for deploying your Fusion model.