Renesas
RZ/V AI

5.00

The best solution for
starting your AI applications.

Provided by Renesas Electronics Corporation




To keep you updated,
Watch our GitHub repository
Watch



This project is maintained by renesas-rz

Hosted on GitHub Pages — Theme by orderedlist

RZ/V2H AI Applications Demo
How to Use Guide



This page explains how to use RZ/V2H AI Applications Demo on the RZ/V2H Evaluation Board Kit.
Supported version: RZ/V2H AI SDK v5.00


Overview

This page explains how to setup the RZ/V2H Evaluation Board Kit (EVK) using the demo binary file.
Unlike the procedure described in Getting Started, this page does not build the AI Software Development Kit (AI SDK) environment, so you can easily try running the AI Applications.

In this guide, you will be able to learn followings.

  • Prepare microSD card to set up operating environment
  • Run AI Applications on the board

The goal of this guide is to run the application and display the captured data with AI inference results on an HDMI monitor as shown below.

demo_example_v2h

To see a list of applications included in this demo, see List of RZ/V2H AI Applications Demo.

For more information about the RZ/V series, click here.


Preparation

This chapter describes the procedures up to the first startup of the RZ/V2H Evaluation Board Kit.

Step 1: Hardware Preparation

To start using RZ/V2H AI Applications Demo, we need to get the board.
Renesas provides ideal board kit for RZ/V evaluation.

Click the button below to get the RZ/V2H board.


Please prepare the following equipments for your EVK.
Equipment Details
RZ/V2H EVK Evaluation Board Kit for RZ/V2H.
AC Adapter USB Power Delivery adapter for the board power supply.
100W is required.
HDMI Cable Used to connect the HDMI Monitor and the board.
RZ/V2H EVK has HDMI port.
USB Camera Since RZ/V2H EVK does not include camera module, this will be the standard camera input source.
Some applications allow multiple USB camera inputs.
Supported resolution: 640x480
Supported format: 'YUYV' (YUYV 4:2:2)
MIPI Camera Optional. Some applications allow MIPI camera input.
Operating Environment: e-CAM22_CURZH camera.
To get the e-CAM22_CURZH, please see e-con Systems.
USB Cable Type-C Connect AC adapter and the board.
HDMI Monitor Used to display the graphics of the board.
Supported resolution: 1920x1080
microSD card Must have over 16GB capacity of blank space.
Operating Environment: Transcend UHS-I microSD 300S 16GB
Linux PC Used for Setup microSD card.
Operating Environment: Ubuntu 20.04
SD card reader Used for setting up microSD card.
USB Hub Used to connect USB Camera and USB Mouse to the board.
USB Mouse Used to operate the mouse on the screen of board.


Step 2: Demo file extraction to microSD card

  1. If you have not yet obtained the demo file, click on the link below to download it.

    Download Link

    Note In this section, we use a Linux PC to prepare the microSD card.
    If you want to use a Windows PC, we have experience in writing disk images by following steps.
    1. Extract the *.wic.gz compressed file using software such as 7-Zip.
    2. Write the extracted disk image file to the microSD card using the applications such as:

  2. Place the downloaded Zip file into a Linux PC and unzip it using the following command in a terminal.

    unzip RTK0EF0197F05000SJ.zip
    Make sure the following folders and files are generated after unzipping the file.
    Demo File Structure
    Folder Name Folder Content Description
    licenses/ linux_licenses.zip Linux license information.
    r11an0940ej0500-rzv2h-ai-apps-demo(Linux License List).pdf List of Linux license information included in Demo microSD card image. Copyright information is not included.
    sd_image/ rzv2h_ai_applications_demo_v5.00.wic.gz Gzip file containing the Demo microSD card image.
    rzv2h_ai_applications_demo_v5.00.wic.bmap Bmap file for copying the Demo microSD card image.
    r11an0884ej0500-rzv2h.pdf ReadMe document describing the contents of the Demo zip file.

  3. To write the microSD card image, install bmap-tools on the Linux PC with the following command.

    sudo apt install bmap-tools

  4. Run the following command to check the device connected to the Linux PC before inserting the microSD card.

    lsblk
    Then, insert the microSD card into the Linux PC and run the same command (lsblk) again.
    Confirm that the microSD device name (/dev/sdb) has been added to the terminal after inserting the card, as shown in the console window below.

    demo_lsblk_check
    Note The microSD card device name may vary depending on the PC environment.
    In this manual, we use /dev/sdb as the microSD card device name.

  5. To use bmap-tools, microSD card partitions must be unmounted. Follow the steps below to unmount.
    1. Run the following command to check the automatically mounted microSD card partitions.

      df -h

    2. Check the output and find the mount point from the device name found above (/dev/sdb).
      Here "/media/user/9016-4EF8" is the mount point.

      Filesystem      Size  Used Avail Use% Mounted on
      :
      snip
      :
      /dev/sdb1        15G   32K   15G   1% /media/user/9016-4EF8
      Warning Here, we use /dev/sdb as microSD card device name.
    3. Unmount the SD card partition if it is mounted.

      sudo umount /media/user/9016-4EF8
      Note If there are more than one partitions on microSD card, unmount all partitions.

  6. Using the device name (/dev/sdb), write the disk image file into the microSD card.

    cd sd_image
    sudo bmaptool copy --bmap rzv2h_ai_applications_demo_v5.00.wic.bmap rzv2h_ai_applications_demo_v5.00.wic.gz /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.
    Note Writing the microSD card image takes several minutes.

  7. Execute the following command to eject the microSD card.

    sudo eject /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.


This completes the board setup. Let’s move on to the next chapter and run the applications.


Running Applications

This chapter describes how to run the AI Applications in the demo file.

Step 1: Boot process

Once the Preparation chapter is complete, you can boot the board in the following way.

  1. Insert the microSD card to the Board.
    Note Use the microSD card slot SD1 on the Board as shown in the figure.

  2. Change DSW1 and DSW2 setting as shown in the figure.

  3. Connect the USB mouse and USB camera(s) via USB hub.
    Note 1 Up to 3 USB camera inputs are supported.
    Note 2 There are USB 2.0 port and USB 3.0 port on RZ/V2H EVK.
    Please connect your USB camera to appropriate port according to its requirement.
    Here, USB camera is connected to USB 2.0 via USB hub.

  4. [Optional] Connect the MIPI camera to the CN7 on the Board.
    1. Pull up the edge of CN7.
    2. Insert the cable.
    3. Push down the edge of CN7.

  5. Connect the HDMI monitor to the Board.

  6. Connect the power cable to the Board.

  7. Turn the SW3 to ON.

  8. Turn the SW2 to ON to power on the Board
boot
  1. The GUI home screen appears on the HDMI monitor.
    See the figure below for window layout.

    GUI Home Screen
    demo_gui_home


Step 2: Demo execution

  1. The list of AI applications included in the Demo is shown below. Select the application you want to run from the list.
    List of RZ/V2H AI Applications Demo
    Category Application Name Details Supported
    Camera Devices
    User Interface
    Agriculture Defense wild animals for crop GitHub Link USB CUI
    Fruit and Vegetable Plant Disease Check GitHub Link USB GUI
    Ranch Livestock Management GitHub Link USB CUI
    Smart Building Elevator passengers Counting GitHub Link USB CUI
    Conference Room Usage Monitor GitHub Link USB CUI
    Lighting Control GitHub Link USB CUI
    Security Area Intrusion Detection GitHub Link USB CUI
    Wear management at construction sites GitHub Link USB CUI
    Touchless Controller for elevator GitHub Link USB CUI
    Employee ID check for Restricted Area GitHub Link USB GUI
    Multi-Camera Parking Lot Management GitHub Link USB / USBx2 / USBx3 / MIPI CUI
    Smart City Congestion Detection in Railway Station GitHub Link USB CUI
    Prohibited Area Management GitHub Link USB CUI
    Distracted driving detection GitHub Link USB CUI
    Duration monitoring for surveillance camera GitHub Link USB CUI
    Passport check support GitHub Link USB GUI
    Bus passenger counting GitHub Link USB CUI
    Backtravel Detection GitHub Link USB CUI
    Bird Damage Prevention GitHub Link USB CUI
    Blind Spot Monitor GitHub Link USB CUI
    Preceding Vehicle Movement Alert GitHub Link USB CUI
    Emergency Vehicles Detector GitHub Link USB CUI
    Illegal Bicycle Approach Detection GitHub Link USB CUI
    Bicycle Rental Stock Management GitHub Link USB CUI
    Illegal Bicycle Parking Monitor Support GitHub Link USB CUI
    Infrastructure Defect Prevention GitHub Link USB CUI
    Crime Prevention Support for School GitHub Link USB CUI
    Multi-Camera Vehicle Detector GitHub Link USB / USBx2 / USBx3 / MIPI CUI
    Car Accident Prevention Alert GitHub Link USB / USBx2 / USBx3 / MIPI CUI
    Driving Support with Road Lane Segmentation GitHub Link USB CUI
    Visual Walking Support GitHub Link USB CUI
    Healthcare Physical Condition Monitor GitHub Link USB CUI
    Yoga Pose Monitor GitHub Link USB CUI
    Smart Home Air Conditioner Control GitHub Link USB CUI
    Pet Detection in Kitchen and Child's Room GitHub Link USB CUI
    Touchless Controller for Kitchen Appliance GitHub Link USB CUI
    Food Package Expiry Date Check GitHub Link USB CUI
    Industrial Work Area Personnel Management GitHub Link USB CUI
    Access Control GitHub Link USB CUI
    Helmet and safety vest wearing monitor GitHub Link USB CUI
    Touchless Controller for Industrial machine GitHub Link USB CUI
    Driver Monitoring System GitHub Link USB CUI
    Species check support in Fish Factory GitHub Link USB CUI
    Defect Inspection Support GitHub Link USB CUI
    Aquaculture Industrial Support GitHub Link USB CUI
    Retail Congestion Detection GitHub Link USB CUI
    Smart POS GitHub Link USB CUI
    Marketing Interest Analysis GitHub Link USB CUI
    Staying and flow line monitoring GitHub Link USB CUI
    Exhibition Participants Monitoring GitHub Link USB CUI
    Store Crime Prevention GitHub Link USB CUI

  2. After following the boot procedure in the previous section, you can start the application using the GUI.

    1. Scroll the application list on the left of the screen and click the application name.

    2. The application panel page on the right automatically shows the application that you clicked.
      You can also scroll the panel page manually.
      Note If you are using a USB mouse, please drag to scroll the pages as the mouse wheel is not available.

    3. Press the "Start" button in the panel to run the application.

  3. On monitor, the application will automatically start.
    Note 1 Some applications require GUI control.
    See the link in the User Interface column of List of RZ/V2H AI Applications Demo.
    Note 2 The termination button on application window may temporarily disappear.
    Please wait a few seconds until the screen display gets stable.
    Note 3 If the running application encounters any errors (e.g. the camera is not connected), the application will automatically exit and return to the home screen.

  4. To terminate the application, follow the instruction below.
    • For CUI application, press the blue Termination Button in the bottom right-hand corner.
    • For GUI application, double click the application window.


Step 3: Shutdown process

To power-off the RZ/V2H EVK, follow the procedures below.

  1. On the home screen, click the X button at the top right-hand corner.

    demo_gui_shutdown_btn_v2h

  2. On the screen, check that shutdown procedure runs and the HDMI display is blacked out.

  3. Turn SW2 to OFF.

  4. Turn SW3 to OFF.

    board