Provided by Renesas Electronics Corporation
To keep you updated,
Watch our GitHub repository
Watch
This project is maintained by renesas-rz
Hosted on GitHub Pages — Theme by orderedlist
AI SDK is build for specific board.
Its version varies depending on the supported board.
| Supported Board | Supported AI SDK ver. | RUHMI (DRP-AI TVM) ver. | DRP-AI Translator ver. |
|---|---|---|---|
| RZ/V2L Evaluation Board Kit | RZ/V2L AI SDK v7.00 | v2.6.1 | v1.90 |
| RZ/V2H Evaluation Board Kit | RZ/V2H AI SDK v6.00 | v2.5.1 | i8 v1.04 |
|
RZ/V2N Evaluation Board Kit RZ/V2N Fast Prototyping Board |
RZ/V2N AI SDK v6.30 | v2.5.1 | i8 v1.04 |
Learn more about the RZ/V series.
| Software | Provided on | Details |
|---|---|---|
| AI Applications | GitHub |
This software is a set of following files that runs on the evaluation board kit.
|
| RZ/V AI SDK | Renesas Website |
This software is a development environment for AI Applications. Provided as a zip file. "Getting Started" page (this page) explains how to use RZ/V AI SDK to run the AI Applications. |
| RZ/V AI SDK Source Code |
Renesas Website |
This software is the source code of RZ/V AI SDK that includes Yocto Linux recipe. Provided as a zip file. Details and instructions are explained in the following pages. |
| Equipment | Details |
|---|---|
| RZ/V2L Evaluation Board | Evaluation board itself. |
| MIPI Camera Module | Google Coral Camera.Note that the CMOS sensor (OV5645) in the camera is no longer available, and should not be used for mass production. |
| MicroUSB to Serial Cable | For serial communication between PC and the board. |
| Equipment | Details |
|---|---|
| RZ/V2H Evaluation Board | Evaluation board itself. |
| Equipment | RZ/V2N Evaluation Board (CPU board) Model Number |
Details |
|---|---|---|
| RZ/V2N Evaluation Board V1.0 | RTK0EF0186C02000BJ | Evaluation board itself. |
| RZ/V2N Evaluation Board V2.0 | RTK0EF0186C02001BJ | Evaluation board itself. |
| Equipment | Details |
|---|---|
| RZ/V2N Fast Prototyping Board | Evaluation board itself. |
Please prepare the following equipments for your board.
| For | Equipment | Details |
|---|---|---|
| RZ/V2L | RZ/V2L EVK |
Evaluation Board Kit for RZ/V2L. Includes followings.
|
| AC Adapter | USB Power Delivery adapter for the board power supply. | |
| MicroHDMI Cable |
Used to connect the HDMI Monitor and the board. RZ/V2L EVK has microHDMI port. |
|
| USB Camera |
Optional. AI Applications support USB camera input. Supported resolution: 640x480 Supported format: 'YUYV' (YUYV 4:2:2) |
|
| Windows PC |
Optional. Used as the serial communication console for QSPI Bootloader. Operating Environment : Windows 11 |
|
| RZ/V2H | RZ/V2H EVK | Evaluation Board Kit for RZ/V2H. |
| AC Adapter |
USB Power Delivery adapter for the board power supply. 100W is required. |
|
| HDMI Cable |
Used to connect the HDMI Monitor and the board. RZ/V2H EVK has HDMI port. |
|
| USB Camera |
Since RZ/V2H EVK does not include camera module, this will be the standard camera input source. Supported resolution: 640x480 Supported format: 'YUYV' (YUYV 4:2:2)
To use MIPI camera, please refer to e-CAM22_CURZH provided by e-con Systems.
|
|
| RZ/V2N |
RZ/V2N EVK or FPB-RZV2N |
Evaluation Board Kit for RZ/V2N. |
| AC Adapter |
USB Power Delivery adapter for the board power supply. 60W is required for EVK. 45W is required for FPB. |
|
| HDMI Cable |
Used to connect the HDMI Monitor and the board. RZ/V2N EVK/FPB has HDMI port. |
|
| USB Camera |
Since RZ/V2N EVK/FPB does not include camera module, this will be the standard camera input source. Supported resolution: 640x480 Supported format: 'YUYV' (YUYV 4:2:2)
To use MIPI camera, please refer to e-CAM22_CURZH provided by e-con Systems.
|
|
| Common | USB Cable Type-C | Connect AC adapter and the board. |
| HDMI Monitor | Used to display the graphics of the board. | |
| microSD card |
Must have over 16GB capacity of blank space. Operating Environment: Transcend UHS-I microSD 300S 16GB |
|
| Linux PC |
Used for Setup microSD card and RZ/V AI SDK Setup. Operating Environment: Ubuntu 22.04 |
|
| SD card reader | Used for setting up microSD card. | |
| USB Hub | Used to connect USB Keyboard and USB Mouse to the board. | |
| USB Keyboard | Used to type strings on the terminal of board. | |
| USB Mouse | Used to operate the mouse on the screen of board. |
v4l2-ctl command.
Please install following software on Linux PC.
RZ/V AI SDK provides following packages for each supported board.
| Name | Package | Details |
|---|---|---|
| RZ/V2L AI SDK RZ/V2H AI SDK RZ/V2N AI SDK | RTK0EF0*SJ.zip | Package used for AI development. For this Getting Started, please download RZ/V2L AI SDK RZ/V2H AI SDK RZ/V2N AI SDK from the link below. Once downloaded, please check the Release Note included in the package. |
|
RZ/V2L AI SDK
RZ/V2H AI SDK
RZ/V2N AI SDK
Source Code |
RTK0EF0*SJ_linux-src.zip | Package used for Linux development. Please refer to following pages for more details on this package. |
This step explains how to extract the RZ/V AI SDK zip file.
mkdir -p ai_sdk_workexport WORK=<path to the working directory>/ai_sdk_workcd ${WORK}unzip <Path to the file>/RTK0EF0*.zip -d ${WORK}ls ${WORK}/ai_sdk_setup board_setup documents references r11an0*.pdfThis step explains how to setup the RZ/V AI SDK environment.
cd ${WORK}/ai_sdk_setupsudo docker build -t rzv2l_ai_sdk_image --build-arg PRODUCT="V2L" .sudo docker build -t rzv2h_ai_sdk_image --build-arg PRODUCT="V2H" .sudo docker build -t rzv2n_ai_sdk_image --build-arg PRODUCT="V2N" .mkdir ${WORK}/ai_sdk_setup/datarzv2*_ai_sdk_container is a name of docker container, which can be changed by user.
sudo docker run -it --name rzv2l_ai_sdk_container -v $(pwd)/data:/drp-ai_tvm/data rzv2l_ai_sdk_imagesudo docker run -it --name rzv2h_ai_sdk_container -v $(pwd)/data:/drp-ai_tvm/data rzv2h_ai_sdk_imagesudo docker run -it --name rzv2n_ai_sdk_container -v $(pwd)/data:/drp-ai_tvm/data rzv2n_ai_sdk_image$(pwd)/data is mounted to /drp-ai_tvm/data on the Docker container by the above command option.
exitsudo docker start -i rzv2l_ai_sdk_containersudo docker start -i rzv2h_ai_sdk_containersudo docker start -i rzv2n_ai_sdk_container
You have finished the RZ/V AI SDK environment setup.
You are ready to build the AI applications!
This step explains how to build AI application.
To see the overview about AI Applications, please refer to About AI Applications page.
git clone https://github.com/renesas-rz/rzv_ai_sdk.gitIn AI Applications, there are two types of applications.
| Application | GitHub Repository | Details | Example |
|---|---|---|---|
| <Application 1> |
|
These repositories provide the complete instruction in each application documentation. |
R01_object_detection |
| <Application 2> |
|
This repository only contains AI Applications for RZ/V2L EVK.
|
01_Head_count |
README.md document provided in application directory and follow the instruction in the chapter called "Application: Build Stage" (or similar) to build the application.sudo docker start -i rzv2l_ai_sdk_containersource /opt/rz-vlp/5.0.11/environment-setup-cortexa55-poky-linuxcd /drp-ai_tvm/datagit clone https://github.com/Ignitarium-Renesas/RZV2L_AiLibrarycd RZV2L_AiLibrary/01_Head_count/Head_count_cammake command.
makeRZV2L_AiLibrary/01_Head_count/
Head_count_cam/exe.
| Type | Description | RZ/V2L EVK |
|---|---|---|
| eSD Bootloader | The board boots up using the bootloader written on microSD card. Linux kernel and filesystem are also on microSD card. |
✔ |
| QSPI Bootloader | The board boots up using the bootloader written in Flash ROM on the board. Linux kernel and filesystem are on microSD card. |
✔ |
| Type | Description | RZ/V2H EVK |
|---|---|---|
| eSD Bootloader | The board boots up using the bootloader written on microSD card. Linux kernel and filesystem are also on microSD card. |
✔ |
| xSPI Bootloader | The board boots up using the bootloader written in Flash ROM on the board. Linux kernel and filesystem are on microSD card. |
✔ |
| Type | Description | RZ/V2N EVK-ver1 | RZ/V2N EVK-ver2 | FPB-RZV2N |
|---|---|---|---|---|
| eSD Bootloader | The board boots up using the bootloader written on microSD card. Linux kernel and filesystem are also on microSD card. |
✔ | ✔ | ✔ |
| xSPI Bootloader | The board boots up using the bootloader written in Flash ROM on the board. Linux kernel and filesystem are on microSD card. |
✔ | ✔ | - |
| eMMC Bootloader | The board boots up using the bootloader written in eMMC on the board. Linux kernel and filesystem are on microSD card. |
✔ ( Link ) | ✔ ( Link ) | - |
bmap-tools is installed on Linux PC.bmap-tools, install it using following command on Host PC (Not in the docker container).sudo apt install bmap-tools${WORK}/board_setup/eSD.zip.cd ${WORK}/board_setup
unzip eSD.zip${WORK}/board_setup/eSD directory.
${WORK}/board_setup/QSPI.zip.cd ${WORK}/board_setup
unzip QSPI.zip${WORK}/board_setup/QSPI directory.
| File | Description |
|---|---|
| core-image-weston-smarc-rzv2l.rootfs.wic.bmap | SD card image |
| core-image-weston-smarc-rzv2l.rootfs.wic.gz |
${WORK}/board_setup/xSPI.zip.cd ${WORK}/board_setup
unzip xSPI.zip${WORK}/board_setup/xSPI directory.
| File | Description |
|---|---|
| core-image-weston-rzv2h-evk.rootfs.wic.bmap | SD card image |
| core-image-weston-rzv2h-evk.rootfs.wic.gz |
${WORK}/board_setup/xSPI.zip.cd ${WORK}/board_setup
unzip xSPI.zip${WORK}/board_setup/xSPI directory.
| File | Description |
|---|---|
| core-image-weston-rzv2n-evk.rootfs.wic.bmap | SD card image |
| core-image-weston-rzv2n-evk.rootfs.wic.gz |
lsblkNAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 30.9G 0 disk
├─sda1 8:1 0 512M 0 part /boot/efi
├─sda2 8:2 0 1K 0 part
└─sda5 8:5 0 30.3G 0 part /
sr0 11:0 1 1024M 0 romlsblkNAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 30.9G 0 disk
├─sda1 8:1 0 512M 0 part /boot/efi
├─sda2 8:2 0 1K 0 part
└─sda5 8:5 0 30.3G 0 part /
sdb 8:16 1 29.7G 0 disk
└─sdb1 8:17 1 29.7G 0 part
sr0 11:0 1 1024M 0 rom/dev/sdb: The device name for the entire microSD card.
/dev/sdb1: The partition name in microSD card. There may be multiple sdb* depending on the microSD card.
df -h/media/user/9016-4EF8" in the following example.
Filesystem Size Used Avail Use% Mounted on
:
snip
:
/dev/sdb1 15G 32K 15G 1% /media/user/9016-4EF8/dev/sdb" as microSD card device name.
sudo umount /media/user/9016-4EF8cd ${WORK}/board_setup/eSD
sudo bmaptool copy --bmap core-image-weston-smarc-rzv2l.rootfs.wic.bmap core-image-weston-smarc-rzv2l.rootfs.wic.gz /dev/sdbcd ${WORK}/board_setup/QSPI
sudo bmaptool copy --bmap core-image-weston-smarc-rzv2l.rootfs.wic.bmap core-image-weston-smarc-rzv2l.rootfs.wic.gz /dev/sdbcd ${WORK}/board_setup/eSD
sudo bmaptool copy --bmap core-image-weston-rzv2h-evk.rootfs.wic.bmap core-image-weston-rzv2h-evk.rootfs.wic.gz /dev/sdbcd ${WORK}/board_setup/xSPI
sudo bmaptool copy --bmap core-image-weston-rzv2h-evk.rootfs.wic.bmap core-image-weston-rzv2h-evk.rootfs.wic.gz /dev/sdbcd ${WORK}/board_setup/eSD
sudo bmaptool copy --bmap core-image-weston-rzv2n-evk.rootfs.wic.bmap core-image-weston-rzv2n-evk.rootfs.wic.gz /dev/sdbcd ${WORK}/board_setup/xSPI
sudo bmaptool copy --bmap core-image-weston-rzv2n-evk.rootfs.wic.bmap core-image-weston-rzv2n-evk.rootfs.wic.gz /dev/sdb/dev/sdb to your microSD card device name.df -hFilesystem Size Used Avail Use% Mounted on
:
snip
:
/dev/sdb1 24M 8.2M 16M 35% /media/user/bootloader
/dev/sdb2 12G 2.1G 8.4G 20% /media/user/rootFilesystem Size Used Avail Use% Mounted on
:
snip
:
/dev/sdb1 20M 5.5M 15M 28% /media/user/bootloader
/dev/sdb2 11G 2.0G 8.4G 20% /media/user/rootFilesystem Size Used Avail Use% Mounted on
:
snip
:
/dev/sdb1 18M 3.9M 15M 22% /media/user/bootloader
/dev/sdb2 12G 2.4G 8.9G 22% /media/user/root/dev/sdb" as microSD card device name.
sudo eject /dev/sdb/dev/sdb to your microSD card device name.sudo mkdir /mnt/sd -p
sudo mount /dev/sdb2 /mnt/sd/dev/sdb to your microSD card device name.sudo mkdir /mnt/sd/home/weston/tvmtvm can be determined by user.Option 1: <Application 1>
README.md document provided in application directory and follow the instruction in the chapter called "Application: Deploy Stage" (or similar) to deploy the application.
sudo cp $WORK/ai_sdk_setup/data/<Path to target file>/<filename> /mnt/sd/home/weston/tvm Option 2: <Application 2>
Run the following command to copy the whole repository to the root filesystem.sudo cp $WORK/ai_sdk_setup/data/<Path to repository>/RZV2L_AiLibrary /mnt/sd/home/weston/tvm -rsync sudo umount /mnt/sdsudo eject /dev/sdb/dev/sdb to your microSD card device name.
After Step 7, users should have completed followings.
README.md) of applications on GitHub.
[ WARN:0@xx.xxx] global cap_gstreamer.cpp:1777 open OpenCV | GStreamer warning: Cannot query video position: status=0, value=-1, duration=-1shutdown command on board console.
sudo -i shutdown -h now
shutdown command on board console.
sudo -i shutdown -h now
shutdown command on board console.
sudo -i shutdown -h now