Deploying ModelPack
Now that you have validated your Vision Model, this page will provide a walk-through for deploying Vision models in an EdgeFirst Platform.
This page will showcase two types of deployments.
Download the Model
Download the model from EdgeFirst Studio into the EdgeFirst Platform. There are two methods for downloading the model. The first method is to download the model from EdgeFirst Studio and then SCP the model file to the EdgeFirst Platform. The second method is to use the EdgeFirst Client to download the model directly in the device.
Download and SCP
As mentioned under the Trained Models section, the trained models can be downloaded by clicking the "View Session Details" button.
This will open the session details and the models are listed on the right with downward arrow buttons that downloads the models to your PC. In this example, we will be deploying the TFLite model on device.
Once the model is downloaded in your PC, you can SCP the model to the EdgeFirst Platform by using this command template.
scp <path to the downloaded TFLite model> <destination path>
An example command is shown below.
scp modelpack.tflite torizon@verdin-imx8mp-15140753:~
For more information, please visit Secure Copy.
Download using the Client
This method expects you to have connected to the EdgeFirst Platform via SSH. The EdgeFirst Client will already come pre installed in the device. You can verify the installation with the client version command.
$ edgefirst-client version
Deep View Enterprise 3.7.0e
Next login to the client with the command.
$ edgefirst-client login
Username: user
Password: ****
You will now be able to download the model on the device by the download-artifact command.
edgefirst-client download-artifact <session ID> <model name>
The download-artifact expects three arguments.
- session ID: Pass the trainer or validation session ID associated with the models.
- model name: Pass the specific model that will be downloaded to the device.
- download path (optional): Specify the path to the download the model. If not provided, it will download to the current working directory.
Please see EdgeFirst Client For more information on using the client via command line.
Visit the WebUI Service
Visit the WebUI service by entering the URL https://<hostname>/ in your browser.
Note
Replace <hostname> with the hostname of your device.
You should be greeted with the following page.
For more information, please see the Web UI Walkthrough.
Update the Model Path
Once you are in the WebUI main page, specify the path to the model in the device.
Click the settings icon on the top right corner of the page.
Select "Model Settings".
Configure the path to the model in your device as specified under "MODEL:". Once configured, click "Save Configuration" to save your changes.
Enable and Start the Services
Ensure that the Camera, Model, and Recorder services are enabled. To verify, go back to the settings and click on the "Service Status" button.
You will be greeted with the "Service Overview" page. Ensure that the "camera" and "model" services are enabled and running by toggling the "Enable" and "Start" button as shown. Only "Enable" the "recorder" service as shown. We will start the recorder service in MCAP Recording.
Live View (Segmentation App)
Once the model and camera services are enabled, go back to the main page and then select the "Segmentation" application as shown.
This will run inference on the model specified to generate segmentation masks on the detected objects. In this case, the model is identifying people in the video feed. Examples are shown below.
MCAP Recording
Once the model, camera, and recorder services are enabled, go back to the main page and then select the "MCAP" application as shown.
You will be greeted with the MCAP recording page.
Toggle the "Recording" button as shown to start recording the video feed. To stop the recording, toggle the same button and then the recording will be stored as an MCAP file.
For more information on MCAP recordings, please see the MCAP Recording Service.
Inference Visualization in Foxglove
The MCAP recordings are listed under the list of "MCAP Files" which can then be downloaded to your PC.
Once the MCAP recording has been downloaded, we can use Foxglove Studio to see the playback of MCAP recordings and the model inference. The following preview is a frame from the MCAP with the model inference masks overlaid on top of the video.
For more information on the MCAP playback in Foxglove Studio, please see the link attached.