Validating Fusion Models
This page will provide a walk-through validating the performance of Fusion models that have been trained in EdgeFirst Studio, through the QuickStart Guide or Training Fusion. This page will focus only on the validation of Fusion models.
Note
Checkout our video tutorial above as part of the EdgeFirst Studio Series to showcase the steps for running Fusion validation in EdgeFirst Studio. Otherwise, follow the steps below with section specific timestamps of the video.
Select the Validator Tool
Select Validator from the tool options.
Specify the Project
Specify the project to run validation at the center of the top menu bar.
Create Validation Session
Create a new validation session by clicking the create button on the top right of the page.
Configure the settings on the left panel by specifying the name of the validation session, the model file to validate, and the dataset to deploy. Next configure the settings on the right panel by specifying the validation parameters.
Note
Additional information on these parameters are provided by hovering over the info button.
The only augmentation available for this type of validation is blur. See Vision Augmentations for further details.
Start the Session
Start the session by clicking the START SESSION button on the bottom right.
Session Progress
The validation session has now started while the progress is tracked on the left panel and additional information and status is shown on the right panel.
Completed Session
Once completed, the status will be shown as complete.
Validation Metrics
The metrics are shown by clicking the button that views the validation charts on the top left of the session card.
The metrics provides the precision, recall, F1, and IoU scores of the model at the specified window sizes. Additional charts are provided for the precision vs. recall and bird’s eye view heatmaps describing where the model performs well and where the model makes errors.
Note
See Validation Metrics for further details.
Comparing Metrics
It is also possible to compare validation metrics for multiple sessions.
This is done by checking the checkboxes on the top left of the session cards.
Compare the validation sessions by clicking the COMPARE VALIDATE SESSION button on the top left. This will display the validation metrics side by side for the specified validation sessions.
