FPGA an 02039 1 2 Lattice SensAI Studio User Guide
FPGA an 02039 1 2 Lattice SensAI Studio User Guide
Application Note
FPGA-AN-02039-1.2
June 2023
Lattice sensAI Studio User Guide
Application Note
Disclaimers
Lattice makes no warranty, representation, or guarantee regarding the accuracy of information contained in this document or the suitability of its
products for any particular purpose. All information herein is provided AS IS, with all faults and associated risk the responsibility entirely of the Buyer.
Buyer shall not rely on any data and performance specifications or parameters provided herein. Products sold by Lattice have been subject to limited
testing and it is the Buyer's responsibility to independently determine the suitability of any products and to test and verify the same. No Lattice
products should be used in conjunction with mission- or safety-critical or any other application in which the failure of Lattice’s product could create a
situation where personal injury, death, severe property or environmental damage may occur. The information provided in this document is
proprietary to Lattice Semiconductor, and Lattice reserves the right to make any changes to the information in this document or to any products at
any time without notice.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
2 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
Contents
Acronyms in This Document ................................................................................................................................................. 8
1. Introduction .................................................................................................................................................................. 9
1.1. Pre-requisites ...................................................................................................................................................... 9
1.1.1. Hardware Requirement .................................................................................................................................. 9
1.1.2. Software Requirements.................................................................................................................................. 9
1.2. Limitations or Known Issues.............................................................................................................................. 10
1.3. Stop and Remove Older Version of Webapp .................................................................................................... 10
2. sensAI Studio Installation Configuration .................................................................................................................... 11
2.1. Public Dataset Configuration ............................................................................................................................ 11
2.2. Server IP Configuration ..................................................................................................................................... 11
2.3. HTTPs Support Configuration ............................................................................................................................ 11
2.4. NFS Configuration ............................................................................................................................................. 13
2.5. Kubernetes Configuration ................................................................................................................................. 14
3. Deploying sensAI Studio ............................................................................................................................................. 15
3.1. Deployment ....................................................................................................................................................... 15
4. Getting Started ........................................................................................................................................................... 16
4.1. Logging in the Web Application ........................................................................................................................ 16
4.2. Logging Out of the Web Application ................................................................................................................. 18
4.3. Changing the Password ..................................................................................................................................... 18
5. Dashboard .................................................................................................................................................................. 20
6. Project ........................................................................................................................................................................ 21
6.1. Viewing Project Details ..................................................................................................................................... 21
6.2. Updating Project Details ................................................................................................................................... 22
6.3. Adding Project ................................................................................................................................................... 22
6.3.1. Model Zoo .................................................................................................................................................... 23
6.3.2. Local Model .................................................................................................................................................. 24
6.3.3. Other Repo ................................................................................................................................................... 28
6.4. Project Graph .................................................................................................................................................... 28
6.5. Download Project Zip ........................................................................................................................................ 29
7. Workspace .................................................................................................................................................................. 30
7.1. Adding Public Workspace .................................................................................................................................. 30
7.2. Adding Custom Workspace ............................................................................................................................... 31
8. Dataset........................................................................................................................................................................ 32
8.1. Viewing Dataset Details .................................................................................................................................... 32
8.2. Adding Dataset .................................................................................................................................................. 33
8.2.1. Public ............................................................................................................................................................ 33
8.2.2. URL ............................................................................................................................................................... 34
8.2.3. AWS .............................................................................................................................................................. 34
8.2.4. GCP ............................................................................................................................................................... 35
8.2.5. Uploading Dataset ........................................................................................................................................ 36
8.2.6. Stream Dataset ............................................................................................................................................. 37
8.2.6.1. Manual Capture ................................................................................................................................... 37
8.2.6.2. Continuous Capture ............................................................................................................................. 37
8.2.6.3. Video Stream........................................................................................................................................ 38
8.3. Editing Dataset .................................................................................................................................................. 38
8.4. Visualizing the Dataset ...................................................................................................................................... 40
8.4.1. Changing Existing Class................................................................................................................................. 41
8.4.2. Resizing Existing Bounding Box .................................................................................................................... 42
8.4.3. Drawing a New Bounding Box ...................................................................................................................... 43
8.4.4. Deleting a New Bounding Box ...................................................................................................................... 43
8.5. Auto-Annotation ............................................................................................................................................... 43
8.6. Converting Annotation ...................................................................................................................................... 45
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 3
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
4 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
Figures
Figure 2.1. Public Dataset Configuration ............................................................................................................................ 11
Figure 2.2. Public Dataset Path Selection Reference .......................................................................................................... 11
Figure 2.3. Server IP Configuration ..................................................................................................................................... 11
Figure 2.4. Https Configuration for API PATH ..................................................................................................................... 12
Figure 2.5. Https Configuration in ltf.config ....................................................................................................................... 12
Figure 2.6. Https Configuration in docker-componse.yaml ................................................................................................ 12
Figure 2.7. Web Server Frontend Port Proxy Configuration for https ................................................................................ 12
Figure 2.8. Web Server Backend Port Proxy Configuration for https ................................................................................. 13
Figure 2.9. Web Server TensorBoard Port Proxy Configuration for https .......................................................................... 13
Figure 2.10. Web Server JupyterLab Port Proxy Configuration for https ........................................................................... 13
Figure 2.11. NFS Configurations ......................................................................................................................................... 14
Figure 2.12. Kubernetes Configurations ............................................................................................................................. 14
Figure 3.1. Deploying sensAI Studio ................................................................................................................................... 15
Figure 4.1. Login Page ......................................................................................................................................................... 16
Figure 4.2. Password Change Window ............................................................................................................................... 16
Figure 4.3. User Volume Configuration .............................................................................................................................. 17
Figure 4.4. Web Tour .......................................................................................................................................................... 17
Figure 4.5. Sign Out Window .............................................................................................................................................. 18
Figure 4.6. Change Password Option .................................................................................................................................. 18
Figure 4.7. Change Password Window ............................................................................................................................... 19
Figure 5.1. Dashboard Page ................................................................................................................................................ 20
Figure 6.1. Project Page ...................................................................................................................................................... 21
Figure 6.2. View Project ...................................................................................................................................................... 21
Figure 6.3. Update Project .................................................................................................................................................. 22
Figure 6.4. Add New Project ............................................................................................................................................... 22
Figure 6.5. Clone Project..................................................................................................................................................... 23
Figure 6.6. Pull Project ........................................................................................................................................................ 23
Figure 6.7. Create Local Model Project............................................................................................................................... 24
Figure 6.8. Local Project Training Example ......................................................................................................................... 26
Figure 6.9. Local Project TensorBoard Example ................................................................................................................. 27
Figure 6.10. Local Project Freeze Example ......................................................................................................................... 27
Figure 6.11. Download Model JSON ................................................................................................................................... 28
Figure 6.12. Project Graph .................................................................................................................................................. 29
Figure 6.13. Project Page .................................................................................................................................................... 29
Figure 7.1. Workspace Page ............................................................................................................................................... 30
Figure 7.2. Add Public Workspace ...................................................................................................................................... 30
Figure 7.3. Add Custom Workspace ................................................................................................................................... 31
Figure 8.1. Dataset Page ..................................................................................................................................................... 32
Figure 8.2. Dataset View ..................................................................................................................................................... 32
Figure 8.3. Dataset Type Selection ..................................................................................................................................... 33
Figure 8.4. Create Public Dataset ....................................................................................................................................... 33
Figure 8.5. Create Dataset from URL .................................................................................................................................. 34
Figure 8.6. AWS Credential File .......................................................................................................................................... 34
Figure 8.7. AWS Dataset Creation ...................................................................................................................................... 35
Figure 8.8. GCP Credential File ........................................................................................................................................... 35
Figure 8.9. GCP Dataset Creation ....................................................................................................................................... 36
Figure 8.10. Upload Dataset ............................................................................................................................................... 36
Figure 8.11. Manual Capture .............................................................................................................................................. 37
Figure 8.12. Continuous Capture ........................................................................................................................................ 38
Figure 8.13. Video Stream .................................................................................................................................................. 38
Figure 8.14. Edit Dataset .................................................................................................................................................... 39
Figure 8.15. Dataset Edit Options ....................................................................................................................................... 39
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 5
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
6 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 7
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
8 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
1. Introduction
The Lattice sensAI™ Studio is a user interface-based tool for training, validating, and compiling Machine Learning (ML)
models optimized for Lattice FPGAs. The tool makes it easy to take advantage of transfer learning to deploy ML models.
It allows you to select from a range of models pre-trained to cover popular use cases, bring your own data for
additional training, validate the quality of training using TensorBoard, and compile for Lattice FPGAs.
The features of the Lattice sensAI Studio are:
• Model Zoo with variety of models based on multiple architecture
• Option to bring your own model and environment into framework
• Easy to use dataset pre-processing such as labeling, annotation conversion, augmentation
• Model training, freezing, TensorBoard
• Different types of transfer learning
• Storage management
• Informative dashboard for better visualization
• Support to compile model for various Lattice provided FPGAs
• JupyterLab interface for code editing
• User management and collaboration
• DIY installation and setup with docker container on CPU/GPU PC/Server/Cloud
• Support for Distributed Machine Learning training on cloud using Kubernetes
This document describes the installation/configuration, usage, and troubleshooting of the Lattice sensAI Studio.
1.1. Pre-requisites
The hardware, software, connection, and general requirements for this demonstration are provided in the following
sections.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 9
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
10 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
• Update the absolute path of local dataset parent at both locations as mentioned in the image above.
Note: This is only required if you want to make any dataset public.
• Check the reference image below for path selection. As Figure 2.2 shows, there are multiple datasets available in
dataset folder. You can add parent path where all datasets are present.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 11
Lattice sensAI Studio User Guide
Application Note
Here “/api” is where a request is passed from frontend to backend. Same needs to be configured in the web server
configuration (for example, in nginx conf).
Apart from the configurations above, a web server also needs to be configured to redirect request from API path to API
port and vice versa. Below are some example configurations for setting up a proxy.
• Proxy ‘/’ to frontend server port (SERVER_PORT). See the example below:
Figure 2.7. Web Server Frontend Port Proxy Configuration for https
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
12 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
• Proxy API path (for example, /api) to backend server port (BACKEND_SERVER_PORT)
Figure 2.8. Web Server Backend Port Proxy Configuration for https
Figure 2.9. Web Server TensorBoard Port Proxy Configuration for https
Figure 2.10. Web Server JupyterLab Port Proxy Configuration for https
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 13
Lattice sensAI Studio User Guide
Application Note
Refer to AWS Kubernetes (EKS) Cluster Creation for example of creating cluster on AWS cloud.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
14 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
3.1. Deployment
• Deploy the webapp with the command below:
# docker-compose --env-file ltf.config up -d
Note: ‘-d’ is for running app as daemon. To debug and get logs, run command without ‘-d’.
• Go to http://<SERVER_IP>:< SERVER_PORT> in the browser to launch sensAI Studio. For HTTPs cases, use the web
address specified as BACKEND_SERVER_ADDRESS to access application.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 15
Lattice sensAI Studio User Guide
Application Note
4. Getting Started
This section provides information on how to use the Lattice Machine Learning Training Framework.
Note: For the fresh install, the initial database setup takes some time. If you notice a login error at first login, wait
for some time and try again.
2. Type in the new password and select the “I agree terms and conditions” box when you are asked to change the
password during the first login.
3. Click on Change.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
16 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
4. If the login is successful, the user is directed to the volume configuration page. Users can provide their own NFS
details if they want to store data on NFS. If the user selects default, the user data is stored in volume configured by
the system admin in docker-compose.yaml.
5. After the volume configuration, the user is redirected to the Dashboard page. For first time users, you can view the
web tour before moving to any other window. This helps you go through all the major parts of the web application.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 17
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
18 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 19
Lattice sensAI Studio User Guide
Application Note
5. Dashboard
The Dashboard module has different kinds of graphs available. These graphs allow you and the admin user to have a
better visualization of the statistics. By default, you are redirected to the Dashboard page after logging into the web
application. You can also go to Dashboard at any time by clicking on Dashboard from all the page links available in the
main menu.
These graphs provide different information about projects, workspaces, datasets, jobs, memory usage, and so on.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
20 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
6. Project
The Project page contains all the existing projects you created.
2. Click on the icon to view the project details based on project type, as shown in Figure 6.2.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 21
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
22 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 23
Lattice sensAI Studio User Guide
Application Note
7. To create new sections, click on Add Section. These sections are reflected in the section list of the job created, and
can also be used for Training, TensorBoard, and Freezing. For each section, you can provide the command to run by
adding the Command field.
The command can also have other required/optional parameters. These parameters can be provided by adding
parameters under a specified section.
To add a new parameter, click on Add Parameter.
Note: There are different fields of parameters:
• Visible name – This is the name which is provided to user during Job creation.
• Argument – The argument provided with section command (--<argument>).
• Default Value – Default value shown for parameter during the job creation.
• Type – Type of argument. The possible options are listed below:
• file – Used for execution script. This file parameter can be a log file, the input files needed while running
section command.
• str – String Parameter
• int – Integer Parameter
• dir – Directory. When dir is selected as type, the framework automatically selects the path based on the
Sub Type.
• If Sub Type is dataset, the framework automatically identifies the path of the selected dataset.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
24 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
• If Sub Type is artefacts, the framework automatically identifies the path of the job artefacts. This is
used for model output directory.
• If Sub Type is checkpoint, the framework automatically identifies the path of the job artefacts. This is
used for checkpoint path. The artefacts and checkpoint path can be the same. Checkpoint subtype is
used for transferring learning where pre-trained checkpoints are copied to.
• transfer learning – You can provide the link to the pre-trained checkpoint zip for transfer learning. This
shows the option to do transfer learning from pre-trained checkpoints while creating the job.
• checkboxes – This can be used for layer freezing. This option can only be used from JSON upload. Refer to
the sample JSON format for details on how to use this. All option values are passed to the command
separated by a comma.
• workspace – This option is used for sections other than training (for example, freezing). This provides you
an option to select the workspace other than the training workspace.
Figure 6.8, Figure 6.9, and Figure 6.10 show the reference examples for the Training, TensorBoard and Freezing
sections.
8. Once all settings are completed, click on Save to create the project.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 25
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
26 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 27
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
28 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 29
Lattice sensAI Studio User Guide
Application Note
7. Workspace
The Workspace page contains all the workspaces you created. Initially, there is a default workspace.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
30 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 31
Lattice sensAI Studio User Guide
Application Note
8. Dataset
The Dataset page contains all the datasets you created.
2. Click on the icon to view the dataset details, as shown in Figure 8.2.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
32 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
8.2.1. Public
To add a Public dataset:
1. Select the Public option.
2. Provide the Dataset Name and Description.
3. Select Label Type and Dataset Path. If you do not select Other as label type, click on Validate to validate the
dataset.
4. Click on Save.
5. Once the dataset is created, it is reflected in the Dataset page.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 33
Lattice sensAI Studio User Guide
Application Note
8.2.2. URL
To add dataset using Dataset URL:
1. Select the URL option.
2. Provide the Dataset Name and Description.
3. Select Label Type and provide the Dataset URL. If you do not select Other as label type, click on Validate to
validate the dataset.
4. Click on Save.
5. Once the dataset is created, it is reflected in the Dataset page.
8.2.3. AWS
To add dataset from AWS S3 bucket:
1. Select the AWS option.
2. Provide Dataset Name and Description.
3. Select Label Type.
4. Provide Bucket Name and Dataset Path (Dataset path inside the AWS bucket).
5. Click on Attach Files and upload the credential file in .txt format. The format for the same is given below.
6. Tick the Copy dataset to local option to download the dataset (It might take some time depending on dataset size
and network bandwidth). This is optional and required if you want to copy dataset to the user volume (to save
training time).
7. Click on Validate to validate the dataset.
8. Click on Save.
9. Once the dataset is created, it is reflected in the Dataset page.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
34 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
8.2.4. GCP
To add the dataset from Google Cloud Platform (GCP):
1. Select the GCP option.
2. Provide Dataset Name and Description.
3. Select Label Type.
4. Provide Bucket Name and Dataset Path (Dataset path inside the GCP bucket).
5. Click on Attach Files and upload the service account credentials in .json format. The format of the same file is given
below.
6. Tick the Copy dataset option to download the dataset (It might take time depending on dataset size and network
bandwidth). This is optional and required if you want to copy dataset to the user volume (to save training time).
7. Click on Validate to validate the dataset.
8. Click on Save.
9. Once the dataset is created, it is reflected in the Dataset page.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 35
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
36 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 37
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
38 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 39
Lattice sensAI Studio User Guide
Application Note
3. Click on Visualization.
The window displays the dataset images with bounding boxes drawn, based on labels from the dataset (Figure 8.18).
Different classes are displayed with different colors.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
40 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
You have a different option to save the modified annotation, change the class, draw new boxes, resize the existing box,
or delete the existing box in the top panel (Figure 8.19).
You can also jump to a specific image by clicking on the Go to image option. Different classes are marked with different
box colors, which can be viewed from bottom panel.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 41
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
42 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
8.5. Auto-Annotation
You can create a dataset from plain images and generate auto-annotated dataset using pre-trained models. To do this,
perform the steps below:
1. Create a compressed file (zip/tar) from the images, and create a dataset as mentioned in the GCP section:
a. Select the GCP option.
b. Provide Dataset Name and Description.
c. Select Label Type.
d. Provide Bucket Name and Dataset Path (Dataset path inside the GCP bucket).
e. Click on Attach Files and upload the service account credentials in .json format. The format of the same
file is given below.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 43
Lattice sensAI Studio User Guide
Application Note
2. Tick the Copy dataset to local option to download the dataset (It might take some time depending on the dataset
size and network bandwidth). This is optional and required if you want to copy dataset to the user volume (to save
training time).
3. Click on Validate to validate the dataset.
4. Click on Save.
5. Once the dataset is created, it is reflected in the Dataset page.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
44 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
9. Select the required model from the list and click on Start. Once annotation starts, the progress can be seen, as
shown in Figure 8.28.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 45
Lattice sensAI Studio User Guide
Application Note
3. Select the current label format as From and the required label format as To.
4. Click on Start.
5. Once conversion starts, the progress can be seen in the window, as shown in Figure 8.31.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
46 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
You can click on the Refresh icon to refresh the processing status. You can also visualize logs by clicking on the Log
button (if required).
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 47
Lattice sensAI Studio User Guide
Application Note
Notes:
• User Dataset is available in /lattice/dataset/<dataset-name> location. For example, if dataset name is
human_dataset, the root directory is /lattice/dataset/human_dataset.
• You can use your projects paths from this option using the same way as a dataset (for example,
/lattice/projects/<proj-name>).
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
48 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
You can click on the Refresh icon to refresh the processing status.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 49
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
50 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
9. Jobs
The Jobs Page contains all the jobs you created.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 51
Lattice sensAI Studio User Guide
Application Note
9.1.1. Logs
Once the job is started, the log appears in the log tab as shown in Figure 9.3. To stop the training (if required), click on
Stop.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
52 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
9.1.2. Freeze
To freeze the model:
1. Go to the Freeze tab in the Job window and it shows the freeze command.
2. Click on Freeze to freeze the model and run the freezing command, which displays the logs, as shown in Figure 9.5.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 53
Lattice sensAI Studio User Guide
Application Note
9.1.3. TensorBoard
To open the TensorBoard, select the TensorBoard tab in the Job window and click on Launch. This displays the
TensorBoard window, as shown in Figure 9.7.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
54 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 55
Lattice sensAI Studio User Guide
Application Note
4. Click on Save to run the job. Based on the selected command, the application generates the firmware binary for
the selected device and/or run hardware simulation. You can also see the logs in the log window, as shown in
Figure 9.10.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
56 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
The user has the option to download the model as Encrypt Model (pb/h5) by selecting encryption and providing
encryption password, as shown in Figure 9.13.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 57
Lattice sensAI Studio User Guide
Application Note
This encrypted model can be passed to Lattice sensAI compiler as it is to generate firmware binary. Lattice sensAI
compiler can decrypt the model and parse it.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
58 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 59
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
60 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 61
Lattice sensAI Studio User Guide
Application Note
10. Code
The Code page can be used to explore and update/modify the training code in projects. To navigate the Code page, the
JupyterHub instance is launched and the interface is displayed as shown in Figure 10.1.
Note: If JupyterHub is not launched, click on Refresh.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
62 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 63
Lattice sensAI Studio User Guide
Application Note
3. Provide the required details and click on Save to create the user.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
64 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 65
Lattice sensAI Studio User Guide
Application Note
3. Enter the group name and description. Select the users, depending on the requirement, from the drop-down
menu.
4. Click on Save to create the group.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
66 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
3. Select the users to add or remove, and click on Update as shown in Figure 12.5.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 67
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
68 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 69
Lattice sensAI Studio User Guide
Application Note
2. Select duration and click on the icon to save the configuration. The icon switches to Edit as shown in
Figure 13.4.
Once configuration is completed, the admin can remove the configuration by clicking on the Delete icon or modify it by
clicking on the Edit icon.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
70 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 71
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
72 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 73
Lattice sensAI Studio User Guide
Application Note
16. Troubleshooting
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
74 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
Note: The user needs to make sure there is no extra folder when creating zip. In the above example, the user needs to
create zip from ImageSets and the training folder (not from the KITTI_Dataset folder). So when extracted, it contains
ImageSets and training in main dataset folder.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 75
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
76 FPGA-AN-02039-1.2
Lattice sensAI Studio User Guide
Application Note
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
FPGA-AN-02039-1.2 77
Lattice sensAI Studio User Guide
Application Note
Revision History
Revision 1.2, June 2023
Section Change Summary
Introduction Updated the description of the hardware component required by the software in the
Hardware Requirement section.
© 2022-2023 Lattice Semiconductor Corp. All Lattice trademarks, registered trademarks, patents, and disclaimers are as listed at www.latticesemi.com/legal.
All other brand or product names are trademarks or registered trademarks of their respective holders. The specifications and information herein are subject to change without notice.
78 FPGA-AN-02039-1.2
www.latticesemi.com