Skip to content

EdgeFirst Studio: From Start to Deployment

This page will walk you through a high-level overview of getting started with EdgeFirst Studio by introducing the concepts used in Studio and their corresponding UI elements and then using those concepts and elements as part of an high-level workflow from collecting and curating datasets to training, validating, and deploying EdgeFirst models.

Projects, Datasets, and Training Session

This section breaks down important concepts used in EdgeFirst Studios, namely:

  • projects: high-level collections of sensor datasets, training sessions, and other automation and management tasks associated with the dataset inputs and model outputs.
  • datasets: a collection of sensor data, such as images, videos, radar cubes, etc. logically grouped together by the user. Usually, each dataset contained within a project will come from a single recording session.
  • training sessions: the functionality to convert datasets recorded into vision- and radar-based models that can be deployed back to the edge devices

These concepts and their respective UI elements will be used in guided workflow below, and follow from the steps shown in Getting Started. Additional UI breakdowns of EdgeFirst Studio can be found in Navigating EdgeFirst Studio.

Projects

As you saw from the initial workflow, when you first login, you will be greeted by the "Projects" page which contains a sample project called "Sample Datasets". The following figure describes the UI elements of the "Project" card. Take special note of the icons to the left of the project attributes (datasets, trainers, etc.) as these are the buttons that lead into further parts of the project.

Project Attributes
Project UI Breakdown

A project will contain datasets and information about the operations done with those datasets, such as: training sessions, automation tasks, labeling/annotation tasks, and validation sessions. The "Sample Datasets" project has two datasets and two training sets associated with it.

To return to this splash page from any other page, you can: * click your browser's "Back" button until back here * click the Apps Apps Button waffle button and select the "Projects" menu item. * click on the "Au-Zone" Home button in the top-left corner.

Datasets

From the "Projects" page, we can click on the "Datasets" Dataset Button button to see the two datasets associated with this project: "Raivin Pedestrians (ultra-short range) 2025.03" and "COCO 2017". These public datasets are readily available for user onboarding and trials, but these datasets are READ-ONLY datasets. By default, users can view the datasets. Otherwise, in order to have full access to the dataset, users MUST copy the dataset into the project they've created.

Public Datasets
Public Datasets

The "Raivin Pedestrians (ultra-short range) 2025.03" dataset contains 3D bounding box annotations which are use only for training Fusion models. The "COCO 2017" dataset contains 2D bounding box annotations which are only valid for training Vision models.

The following figure breaks down the elements of a "Dataset" card.

Dataset Attributes
Dataset Card UI Breakdown

For an in-depth tutorial for managing datasets in EdgeFirst Studio from capture and annotation to export and deployment, see our Dataset Tutorials.

Training Sessions

The sample project will contain completed training sessions using the public datasets provided. The training session shown below is based on training a Fusion model from the public dataset Raivin Pedestrians (ultra-short range) 2025.03.

Sample Training Session
Sample Training Session

The following figure describes the attributes of any given training session.

Training Session Attributes
Training Session Attributes

For more details regarding deploying training sessions, please see Training Modelpack for training Vision models and Training Fusion for training Fusion models.

Validation Sessions

The sample project will contain completed validation sessions using the models trained in the training sessions. The validation session shown belows is based on the training session from training a Fusion model using the dataset Raivin Pedestrians (ultra-short range) 2025.03.

Sample Validation Session
Sample Validation Session

The following figure describes the attributes of any given validation session.

Validation Session Attributes
Validation Session Attributes

For more details regarding deploying validation sessions, please see Validating Modelpack for validating Vision models and Validating Fusion for validating Fusion models.

Hands-on Workflow

This workflow continues from the steps shown in Getting Started which requires the user to have signed up for EdgeFirst Studio, logged in to EdgeFirst Studio, and created their first project.

This workflow is a tutorial for showing the process of recording data from scratch, annotating data in EdgeFirst Studio, training and validating models, and then finally deploying models in an EdgeFirst Platform.

Note

This tutorial will provide examples on training, validating, and deploying Vision models described in Modelpack Tutorials.

If you have an EdgeFirst Platform, please proceed to step 1. Otherwise, proceed to step 5 for using a provided public dataset. However, feel free to follow along all the steps laid out to become familiar with the workflow.

1. Record Data

When starting from scratch, it is common to start recording your own data to build your own dataset. This step requires an EdgeFirst Platform for recording data. However, we also provide Public Datasets for users without an EdgeFirst Platform.

Deploying an EdgeFirst Platform will allow users access to the following page for recording data.

WebUI Service PageW
Preview: WebUI Service

For instructions on capturing and recording data, refer to the Capture/Record Data Tutorial.

2. Download Recorded Data

Once data is recorded which is stored as an MCAP file, download the MCAP file.

Recorded MCAP
Preview: Download MCAP

For instructions on downloading the recorded MCAP file, refer to the Download Captured Data Tutorial.

3. Upload Recorded Data to EdgeFirst Studio

Once an MCAP file has been downloaded, upload the MCAP recording to EdgeFirst Studio.

Upload MCAP
Preview: Upload Feature

For instructions on uploading the recorded MCAP file to EdgeFirst Studio, refer to the Upload Recorded Data Tutorial.

4. Annotate Dataset

Once an MCAP recording has been uploaded to EdgeFirst Studio, we can then run auto-annotations on the recording to reduce the effort needed from the user. Otherwise, the user can manually annotate the dataset.

Restore Snapshot
Preview: Restore for Auto-Annotations Feature

For instructions on annotating the uploaded data, refer to the Annotating Data Tutorial.

5. Combine Multiple Datasets

This step utilizes the copy dataset feature in EdgeFirst Studio. This feature allows copying of read-only datasets into your own dataset to give write permissions. This feature can also copy multiple datasets into a single container to expand the overall dataset.

Copy Dataset Options
Preview: Copy Datasets

For users that do not have an EdgeFirst Platform, but would like to use the public read-only datasets provided, follow the instructions for Copying Datasets into a dataset container with write access.

For users that followed steps 1-4 and would like to expand their dataset, follow the instructions for Combining Datasets

6. Split Dataset

Before training your model, it is highly suggested to split your dataset into dedicated training and validation groups. This intention is to reserve samples only for training and samples only for validation.

Groups Field
Preview: Dataset Split

For instructions on splitting the dataset in train and validation groups, refer to the Splitting Datasets Tutorial

7. Train Model

Once you have a proper dataset that is fully annotated and split into training and validation groups, you can now start training your model.

Training Options
Preview: Training Options

Since the dataset provided in the demo contains 2D annotations (bounding boxes and segmentation masks) we can train a Vision model using Modelpack. For instructions to train a Vision model, please refer to Training Modelpack Tutorial

8. Validate Model

Once the model is trained, you can now start validating the performance of the model to verify if the model is ready for deployment.

Validation Options
Preview: Validation Options

For instructions to validate a Vision model, please refer to Validating Modelpack Tutorial

9. Deploy Model

Once the model has been validated and deemed the performance to be reasonable for deployment, you can now deploy the model on an EdgeFirst Platform and start running inference on the model.

coming soon