RZ/V AI Software Overview

Index

• Introduction
• User Journey
• Where to Start Your Development
• Deliverables
  • Board
  • Software/Tool
• Reference

Introduction

Among other devices provided by Renesas Electronics, RZ/V series is specialized to AI by embedding the Renesas DRP-AI accelerator delivering high performance at low power consumption.
AI application development requires a lot of work, starting with preparing an AI development environment.
Furthermore, development tasks often have to be repeated many times to achieve the target accuracy.
When AI model is ready to be used in actual user applications, the time and money spent here has been a major hurdle.

Renesas provides RZ/V AI Applications, which can significantly shorten this AI development phase.
In addition, since AI Applications are developed using open source, they can be used not only for evaluation purposes but also for your mass production development.

To expand AI development, Renesas also provide other development environments/tools, i.e., RZ/V AI Transfer Learning Tool to re-train the AI models used in AI Applications, etc..
This page explains about the summary of those AI software for RZ/V series.

User Journey

Overview

Following diagram shows the user journey overview for RZ/V AI Software user.

AI Software Development Flow

For each phase in user journey overview diagram, development flow and related software are shown below.
For more details on each software, please check its documentation listed in Software/Tool Deliverables List.

Where to Start Your Development

Following diagram guides you to which software to start the development.
Click the button of your selected software and follow the instructions.

Click

Click

Click

Click

Click

Click

Click

AI Partner

RZ/V AI Applications are free of charge and open source software, which can be used not only for evaluation purposes but also for your mass production development.
However, they only provide fixed AI models/dataset.
You can change the AI models/dataset by using our other software, i.e., RZ/V AI Transfer Learning Tool and DRP-AI TVM.

If you do not have your own AI model, or prefer to use exisiting AI models created by reliable developers, you are recommended to ask our partners.
Our partners include as follows.

• AI application developers
• AI model experts (performance/accuracy optimization, etc.)
• System integrators

Our partners and their solutions are isted in Renesas RZ Partner Ecosystem Solutions page.

To make an enquiry regarding AI partner, please use "Support Tickets" > "Submit a Ticket" from following page.
Renesas Technical Support

DRP-AI TVM

DRP-AI TVM is a Machine Learning Compiler plugin for Apache TVM with AI accelerator DRP-AI, which is a tool to compile your own AI models (including BYOM) to get the executable format on RZ/V series.

RZ/V AI Applications (Apps) provide a set of pre-compiled AI models by validated DRP-AI TVM version and the application source code.
In following cases, you need to compile them with DRP-AI TVM.

• To change the AI models of RZ/V AI Apps.
• To use completely different models, such as BYOM or OSS,

DRP-AI TVM is automatically installed in RZ/V AI SDK and users are able to use it on its own.
To see how to use DRP-AI TVM, please refer to the DRP-AI TVM Web.

DRP-AI TVM Web

Note

RZ/V AI Apps and RZ/V AI SDK usually use the validated version of DRP-AI TVM, which means that RZ/V AI Apps may not be compatible with the latest version of DRP-AI TVM.
The version installed in AI SDK can be checked in the following page.
RZ/V AI SDK Overview

To use the latest DRP-AI TVM, please refer to the Getting Started in DRP-AI TVM Web to construct the environment with RZ/V AI SDK and DRP-AI Translator.

RZ/V AI Transfer Learning Tool (TLT)

RZ/V AI Applications (Apps) provide a set of pre-compiled AI models, which are already trained with specific dataset selected for each use-case.
In following cases, you need to re-train the AI model.

• To change the AI target classes.
• To improve the accuracy of AI models.

RZ/V AI TLT is a GUI Tool to re-train the AI models used in RZ/V AI Apps with different datasets.
It requires a Linux PC with GPU that can display the desktop screen.

To use RZ/V AI TLT, please refer to following guide.
RZ/V AI Transfer Learning Tool
How to Re-train AI model
How to use RZ/V AI TLT?


Please note that it may not support the latest RZ/V AI Apps.
For more details, please check the guide above.

RZ/V AI Applications and RZ/V AI SDK

RZ/V AI Applications (Apps) provides following set of files that can be used AS IS for each use-case.

• Pre-trained AI model objects
• Pre-build application binary
• Application source code

It is provided on GitHub with free of charge and open-source software licenses.
RZ/V AI Applications
Check the list of RZ/V AI Applications.

RZ/V AI Software Development Kit (AI SDK) is an AI application development environment for specific Evaluation Bord Kit of RZ/V series.
It includes the pre-build binary of bootloader, Linux Kernel and cross compiler, which contain a complete set of libraries to run RZ/V AI Apps.
RZ/V AI SDK Overview
Check the specification of RZ/V AI SDK.

With RZ/V AI Apps and RZ/V AI SDK, users can start their AI development quickly and easily.
First, please follow the Getting Started Guide to run the RZ/V AI Apps on the board with RZ/V AI SDK.
Getting Started
How to startup RZ/V board?
How to run RZ/V AI Applications?


After the Getting Started, please select and try RZ/V AI Apps to expand your AI development.

AI Navigator (e² studio plugin)

AI Navigator is a set of plugins for Renesas IDE e² studio for RZ/V AI.
It allows users to run following software on IDE.

• RZ/V AI Applications (Apps)
• RZ/V AI SDK
• RZ/V AI Transfer Learning Tool (TLT)
• DRP-AI TVM

AI Navigator: IDE for AI Applications

To use AI Navigator, users are required to install Renesas e² studio for Linux.
Details are explained in the following page.
AI Navigator Quick Start Guide
How to develop and run RZ/V AI Applications on e² studio?


Please note that it may not support the latest RZ/V AI Apps.
For more details, please check the Quick Start Guide above.

RZ/V AI SDK Source Code

RZ/V AI SDK is an AI application development environment which is built for specific Evaluation Bord Kit of RZ/V series.
If you would like to change RZ/V AI SDK, you need to customize and build the AI SDK, which is based on Yocto Project (Linux OS Distribution).
Changing AI SDK includes following examples.

• To change the memory map of the board.
• To develop your own board with RZ/V series.
• To add extra camera drivers, graphic libraries, other OSS libraries, etc..

The Linux source code is provided as RZ/V AI SDK Source Code.

The instructions to build the RZ/V AI SDK Source Code are provided in each How to Build AI SDK page.
Please refer to following guides based on your target device.
RZ/V2L AI SDK Source Code
How to Build RZ/V2L AI SDK
RZ/V2H AI SDK Source Code
How to Build RZ/V2H AI SDK
RZ/V2N AI SDK Source Code
How to Build RZ/V2N AI SDK

RZ/V AI Applications Demo

RZ/V AI Applications Demo is a microSD card image that contains the RZ/V AI Applications.
Users can try the RZ/V AI Applications without having RZ/V AI SDK environment.

To use RZ/V AI Applications Demo, please refer to following guides based on your target board.
RZ/V2L AI Applications Demo
How to Use Guide

RZ/V2H AI Applications Demo
How to Use Guide

Deliverables

Board

Following evaluation boards are supported.

Board	Details	Kit	Link
RZ/V2L Evaluation Board Kit (EVK)	Evaluation Board Kit for RZ/V2L. Includes following items. MIPI Camera Module(Google Coral Camera) Note that the CMOS sensor (OV5645) in the camera is no longer available, and should not be used for mass production. Any software support provided is for evaluation purposes only. MicroUSB to Serial Cable for serial communication.		Board and Software Get the board and software for RZ/V series.
RZ/V2H Evaluation Board Kit (EVK)	Evaluation Board Kit for RZ/V2H. To use MIPI camera, please refer to e-CAM22_CURZH provided by e-con Systems.
RZ/V2N Evaluation Board Kit (EVK)	Evaluation Board Kit for RZ/V2N. To use MIPI camera, please refer to e-CAM22_CURZH provided by e-con Systems.

For more details on these devices, please refer to RZ/V series.

Software/Tool

Followings are list of AI software/tool provided Renesas.

Items	Details	Link
RZ/V AI Applications (AI Apps)	AI Apps are sets of following software that can be used as is for each use-case. Pre-trained AI model objects Pre-build application binary Application source code Users can select the category of applications and access the applications provided on GitHub.	About AI Applications AI Applications
RZ/V AI SDK	Binary development environment for AI Applications that is build for specific RZ/V EVK.	AI SDK Overview Getting Started
RZ/V AI SDK Source Code	Source code of RZ/V AI SDK that user can customize Linux environment.	How to Build RZ/V2L AI SDK How to Build RZ/V2H AI SDK How to Build RZ/V2N AI SDK
RZ/V AI Applications Demo	microSD card image that contains the RZ/V AI Applications. Users can try the AI Applications without having AI SDK environment.	How to Use Guide for RZ/V2L How to Use Guide for RZ/V2H
RZ/V AI Transfer Learning Tool (TLT)	GUI Tool to re-train the AI models used in RZ/V AI Applications with different datasets.	How to Re-train AI model
DRP-AI TVM	Machine Learning Compiler plugin for Apache TVM with AI accelerator DRP-AI, which is a tool to compile your own AI models (including BYOM) to get the executable format on RZ/V series. Note: AI SDK also includes DRP-AI TVM. However it is not the latest version. If you would like to use the latest DRP-AI TVM, please follow the guide in DRP-AI TVM Web to construct the environment.	DRP-AI TVM Web
AI Navigator (e2 studio)	A set of plugins for Renesas IDE, e2 studio, that allows users to use following software on GUI environment. RZ/V AI Applications RZ/V AI SDK RZ/V AI TLT DRP-AI TVM	AI Navigator Quick Start Guide

Reference

Renesas also provides other software packages related to RZ/V AI SDK.
Please refer to the Reference to Related Software/Documentation.

Back to Home >