Renesas
RZ/V AI

4.00

The best solution for
starting your AI applications.

Provided by Renesas Electronics Corporation




To keep you updated,
Watch our GitHub repository
Watch



This project is maintained by renesas-rz

Hosted on GitHub Pages — Theme by orderedlist

RZ/V2H AI Applications Demo
How to Use Guide



This page explains how to use RZ/V2H AI Applications Demo on the RZ/V2H Evaluation Board Kit.
Supported version: RZ/V2H AI SDK v4.00


Overview

This page explains how to setup the RZ/V2H Evaluation Board Kit (EVK) using the demo binary file.
Unlike the procedure described in Getting Started, this page does not build the AI Software Development Kit (AI SDK) environment, so you can easily try running the AI Applications.

In this guide, you will be able to learn followings.


The goal of this guide is to run the application and display the captured data with AI inference results on an HDMI monitor as shown below.

demo_example_v2h

To see a list of applications included in this demo, see List of RZ/V2H AI Applications Demo.

For more information about the RZ/V series, click here.


Preparation

This chapter describes the procedures up to the first startup of the RZ/V2H Evaluation Board Kit.

Step 1: Hardware Preparation

To start using RZ/V2H AI Applications Demo, we need to get the board.
Renesas provides ideal board kit for RZ/V evaluation.

Click the button below to get the RZ/V2H board.


Please prepare the following equipments for your EVK.
Equipment Details
RZ/V2H EVK Evaluation Board Kit for RZ/V2H.
AC Adapter USB Power Delivery adapter for the board power supply.
100W is required.
HDMI Cable Used to connect the HDMI Monitor and the board.
RZ/V2H EVK has HDMI port.
USB Camera Since RZ/V2H EVK does not include camera module, this will be the standard camera input source.
Supported resolution: 640x480
Supported format: 'YUYV' (YUYV 4:2:2)
USB Cable Type-C Connect AC adapter and the board.
HDMI Monitor Used to display the graphics of the board.
microSD card Must have over 16GB capacity of blank space.
Operating Environment: Transcend UHS-I microSD 300S 16GB
Linux PC Used for Setup microSD card.
Operating Environment: Ubuntu 20.04
SD card reader Used for setting up microSD card.
USB Hub Used to connect USB Camera and USB Mouse to the board.
USB Mouse Used to operate the mouse on the screen of board.


Step 2: Demo file extraction to microSD card

  1. If you have not yet obtained the demo file, click on the link below to download it.

    Download Link

    Note In this section, we use a Linux PC to prepare the microSD card. If you want to use a Windows PC, we have experience in writing disk images by following steps.
    1. Extract the *.wic.gz compressed file using software such as 7-Zip.
    2. Write the extracted disk image file to the microSD card using the applications such as:

  2. Put the downloaded Zip file into a Linux PC and unzip it using the following command in a terminal.

    unzip RTK0EF0197F04000SJ.zip
    Make sure the following folders and files are generated after unzipping the file.
    Demo File Structure
    Folder Name Folder Content Description
    licenses/ linux_licenses.zip Linux license information.
    r11an0841ej0400-rzv2h-ai-sdk(Linux License List).pdf List of Linux license information included in Demo microSD image. Copyright information is not included.
    sd_image/ ai_applications_demo_v4.00.wic.gz Gzip file containing the Demo microSD image.
    ai_applications_demo_v4.00.wic.bmap Bmap file for copying the Demo microSD images.
    r11an0884ej0400-rzv2h.pdf ReadMe document describing the contents of the Demo zip file.

  3. To write the microSD card image, install bmap-tools on the Linux PC with the following command.

    sudo apt install bmap-tools

  4. Run the following command to check the device connected to the Linux PC before inserting the microSD card.

    lsblk
    Then, insert the microSD card into the Linux PC and run the same command (lsblk) again.
    Confirm that the microSD device name (/dev/sdb) has been added to the terminal after inserting the card, as shown in the console window below.

    demo_lsblk_check
    Note The microSD card device name may vary depending on the PC environment.
    In this manual, we use /dev/sdb as the microSD card device name.

  5. To use bmap-tools, microSD card partitions must be unmounted. Follow the steps below to unmount.
    1. Run the following command to check the automatically mounted microSD card partitions.

      df -h

    2. Check the output and find the mount point from the device name found above (/dev/sdb).
      Here "/media/user/9016-4EF8" is the mount point.

      Filesystem      Size  Used Avail Use% Mounted on
      :
      snip
      :
      /dev/sdb1        15G   32K   15G   1% /media/user/9016-4EF8
      Warning Here, we use /dev/sdb as microSD card device name.
    3. Unmount the SD card partition if it is mounted.

      sudo umount /media/user/9016-4EF8
      Note If there are more than one partitions on microSD card, unmount all partitions.

  6. Using the device name (/dev/sdb), write the disk image file into the microSD card.

    cd sd_image
    sudo bmaptool copy --bmap ai_applications_demo_v4.00.wic.bmap ai_applications_demo_v4.00.wic.gz /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.
    Note Writing the microSD card image takes several minutes.

  7. Execute the following command to eject the microSD card.

    sudo eject /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.


This completes the board setup. Let’s move on to the next chapter and run the applications.


Running Applications

This chapter describes how to run the AI Applications in the demo file.

Step 1: Boot process

Once the Preparation chapter is complete, you can boot the board in the following way.

  1. Insert the microSD card to the Board.
    Note Use the microSD card slot SD1 on the Board as shown in the figure.

  2. Change DSW1 and DSW2 setting as shown in the figure.

  3. Connect the USB mouse and USB camera via USB hub.
    Note There are USB 2.0 port and USB 3.0 port on RZ/V2H EVK.
    Please connect your USB camera to appropriate port according to its requirement.
    Here, USB camera is connected to USB 2.0 via USB hub.

  4. Connect the HDMI monitor to the Board.

  5. Connect the power cable to the Board.

  6. Turn the SW3 to ON.

  7. Turn the SW2 to ON to power on the Board
boot
  1. The GUI home screen shown below appears on the monitor.
    The home screen consists of the following sections.
    • Top:
      Title and Version of this Demo system.
    • Left:
      List of names and categories of AI Applications included in the Demo.
    • Right:
      Panels with application descriptions and run buttons.

    GUI Home Screen
    demo_gui_home_v2h


Step 2: Demo execution

  1. The list of AI applications included in the Demo is shown below. Select the application you want to run from the list.
    List of RZ/V2H AI Applications Demo
    Category Application Name Details Supported
    Camera Devices
    Agriculture Defense wild animals for crop GitHub Link USB
    Ranch Livestock Management GitHub Link USB
    Smart Building Elevator passengers Counting GitHub Link USB
    Conference Room Usage Monitor GitHub Link USB
    Lighting Control GitHub Link USB
    Security Area Intrusion Detection GitHub Link USB
    Touchless Controller for elevator GitHub Link USB
    Smart City Congestion Detection in Railway Station GitHub Link USB
    Prohibited Area Management GitHub Link USB
    Distracted driving detection GitHub Link USB
    Duration monitoring for surveillance camera GitHub Link USB
    Bus passenger counting GitHub Link USB
    Backtravel Detection GitHub Link USB
    Bird Damage Prevention GitHub Link USB
    Blind Spot Monitor GitHub Link USB
    Emergency Vehicles Detector GitHub Link USB
    Illegal Bicycle Approach Detection GitHub Link USB
    Bicycle Rental Stock Management GitHub Link USB
    Illegal Bicycle Parking Monitor Support GitHub Link USB
    Infrastructure Defect Prevention GitHub Link USB
    Crime Prevention Support for School GitHub Link USB
    Smart Home Air Conditioner Control GitHub Link USB
    Pet Detection in Kitchen and Child's Room GitHub Link USB
    Touchless Controller for Kitchen Appliance GitHub Link USB
    Food Package Expiry Date Check GitHub Link USB
    Industrial Work Area Personnel Management GitHub Link USB
    Touchless Controller for Industrial machine GitHub Link USB
    Access Control GitHub Link USB
    Driver Monitoring System GitHub Link USB
    Defect Inspection Support GitHub Link USB
    Aquaculture Industrial Support GitHub Link USB
    Retail Congestion Detection GitHub Link USB
    Staying and flow line monitoring GitHub Link USB
    Marketing Interest Analysis GitHub Link USB
    Exhibition Participants Monitoring GitHub Link USB
    Store Crime Prevention GitHub Link USB
  2. After following the boot procedure in the previous section, you can start the application using the GUI.
    1. Scroll the application list on the left of the screen and click the application name.

    2. The application panel page on the right automatically shows the application that you clicked.
      You can also scroll the panel page manually.
      Note If you are using a USB mouse, please drag to scroll the pages as the mouse wheel is not available.

    3. Press the "Start" button in the panel to run the application.

  3. On monitor, the application will automatically start.
    The application window is displayed on the screen and the termination button appears in the bottom right-hand corner.
    Note1 When an application window is displayed on the screen, the termination button may temporarily disappear. However, it will soon appear again, so please wait a few seconds until the screen display gets stable.
    Note2 If the running application encounters any errors (e.g. if the camera is not connected), the application will automatically exit and return to the home screen.

  4. To terminate the application, press the blue Termination Button in the bottom right-hand corner.


Step 3: Shutdown process

To power-off the RZ/V2H EVK, follow the procedures below.

  1. On the home screen, click the X button at the top right-hand corner.

    demo_gui_shutdown_btn_v2h

  2. On board console, check that shutdown procedure runs and ends with following log.

    [xxxxx.xxxxxx] reboot: Power down
  3. Turn SW2 to OFF.

  4. Turn SW3 to OFF.

    board