Renesas
RZ/V AI

5.00

The best solution for
starting your AI applications.

Provided by Renesas Electronics Corporation




To keep you updated,
Watch our GitHub repository
Watch



This project is maintained by renesas-rz

Hosted on GitHub Pages — Theme by orderedlist

RZ/V2L AI Applications Demo
How to Use Guide



This page explains how to use RZ/V2L AI Applications Demo on the RZ/V2L Evaluation Board Kit.
Supported version: RZ/V2L AI SDK v5.00


Overview

This page explains how to setup the RZ/V2L Evaluation Board Kit (EVK) using the demo binary file.
Unlike the procedure described in Getting Started, this page does not build the AI Software Development Kit (AI SDK) environment, so you can easily try running the AI Applications.

In this guide, you will be able to learn followings.

  • Prepare microSD card to set up operating environment
  • Run AI Applications on the board

The goal of this guide is to run the application and display the captured data with AI inference results on an HDMI monitor as shown below.

demo_example

To see a list of applications included in this demo, see List of RZ/V2L AI Applications Demo.

For more information about the RZ/V series, click here.


Preparation

This chapter describes the procedures up to the first startup of the RZ/V2L Evaluation Board Kit.

Step 1: Hardware Preparation

To start using RZ/V2L AI Applications Demo, we need to get the board.
Renesas provides ideal board kit for RZ/V evaluation.

Since MIPI camera module is included, you can start evaluating RZ/V2L immediately by building an environment.
Click the button below to get the RZ/V2L board.


Please prepare the following equipments for your EVK.
Equipment Details
RZ/V2L EVK Evaluation Board Kit for RZ/V2L.
Includes followings.
  • MIPI Camera Module(Google Coral Camera)
    Note that the CMOS sensor (OV5645) in the camera is no longer available, and should not be used for mass production.
    Any software support provided is for evaluation purposes only.
  • MicroUSB to Serial Cable for serial communication.
AC Adapter USB Power Delivery adapter for the board power supply.
MicroHDMI Cable Used to connect the HDMI Monitor and the board.
RZ/V2L EVK has microHDMI port.
USB Camera Optional. AI Applications support USB camera input.
Supported resolution: 640x480
Supported format: 'YUYV' (YUYV 4:2:2)
USB Cable Type-C Connect AC adapter and the board.
HDMI Monitor Used to display the graphics of the board.
Supported resolution: 1280x720
microSD card Must have over 8GB capacity of blank space.
Operating Environment: Transcend UHS-I microSD 300S 16GB
Linux PC Used for Setup microSD card.
Operating Environment: Ubuntu 20.04
SD card reader Used for setting up microSD card.
USB Hub Optional. For using USB Camera.
Used to connect USB Camera and USB Mouse to the board.
USB Mouse Used to operate the mouse on the screen of board.
Note 1 From v5.00, USB Keyboard is no longer required since GUI operation is supported.
Note 2 Some applications support audio output in addition to the visual presentation on HDMI monitor.
If you would like to have the audio output, please prepare the HDMI monitor with speaker.


Step 2: Demo file extraction to microSD card

  1. If you have not yet obtained the demo file, click on the link below to download it.

    Download Link

    Note In this section, we use a Linux PC to prepare the microSD card.
    If you want to use a Windows PC, we have experience in writing disk images by following steps.
    1. Extract the *.wic.gz compressed file using software such as 7-Zip.
    2. Write the extracted disk image file to the microSD card using the applications such as:

  2. Place the downloaded Zip file into a Linux PC and unzip it using the following command in a terminal.

    unzip RTK0EF0166F05000SJ.zip
    Make sure the following folders and files are generated after unzipping the file.
    Demo File Structure
    Folder Name Folder Content Description
    licenses/ linux_licenses.zip Linux license information.
    r11an0939ej0500-rzv2l-ai-apps-demo(Linux License List).pdf List of Linux license information included in Demo microSD card image. Copyright information is not included. Please refer to Open Source Software packages included in AI SDK v5.00 Source Code to see copyright information.
    sd_image/ rzv2l_ai_applications_demo_v5.00.wic.gz Gzip file containing the Demo microSD card image.
    rzv2l_ai_applications_demo_v5.00.wic.bmap Bmap file for copying the Demo microSD card image.
    r11an0762ej0500-rzv2l.pdf ReadMe document describing the contents of the Demo zip file.

  3. To write the microSD card image, install bmap-tools on the Linux PC with the following command.

    sudo apt install bmap-tools

  4. Run the following command to check the device connected to the Linux PC before inserting the microSD card.

    lsblk
    Then, insert the microSD card into the Linux PC and run the same command (lsblk) again.
    Confirm that the microSD device name (/dev/sdb) has been added to the terminal after inserting the card, as shown in the console window below.

    demo_lsblk_check
    Note The microSD card device name may vary depending on the PC environment.
    In this manual, we use /dev/sdb as the microSD card device name.

  5. To use bmap-tools, microSD card partitions must be unmounted. Follow the steps below to unmount.
    1. Run the following command to check the automatically mounted microSD card partitions.

      df -h

    2. Check the output and find the mount point from the device name found above (/dev/sdb).
      Here "/media/user/9016-4EF8" is the mount point.

      Filesystem      Size  Used Avail Use% Mounted on
      :
      snip
      :
      /dev/sdb1        15G   32K   15G   1% /media/user/9016-4EF8
      Warning Here, we use /dev/sdb as microSD card device name.
    3. Unmount the SD card partition if it is mounted.

      sudo umount /media/user/9016-4EF8
      Note If there are more than one partitions on microSD card, unmount all partitions.

  6. Using the device name (/dev/sdb), write the disk image file into the microSD card.

    cd sd_image
    sudo bmaptool copy --bmap rzv2l_ai_applications_demo_v5.00.wic.bmap rzv2l_ai_applications_demo_v5.00.wic.gz /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.
    Note Writing the microSD card image takes several minutes.

  7. Execute the following command to eject the microSD card.

    sudo eject /dev/sdb
    Warning Change /dev/sdb to your microSD card device name.


This completes the board setup. Let’s move on to the next chapter and run the applications.


Running Applications

This chapter describes how to run the AI Applications in the demo file.

Step 1: Boot process

Once the Preparation chapter is complete, you can boot the board in the following way.

  1. Insert the microSD card to the Board.
    Note Use the microSD card slot CN3 as shown in the figure.

  2. Change SW1 and SW11 setting as shown in the figure.

  3. Connect the USB mouse.
    Note If you would like to use USB camera, connect the USB mouse and USB camera via USB hub.

  4. Connect the Google Coral camera to the Board.

  5. Connect the HDMI monitor to the Board.

  6. Connect the power cable to the Board.

  7. Press power button for 1 second to turn on the board.

boot
  1. The GUI home screen appears on the HDMI monitor.
    See the figure below for window layout.

    GUI Home Screen
    demo_gui_home


Step 2: Demo execution

  1. The list of AI applications included in the Demo is shown below.
    Select the application you want to run from the list.
    List of RZ/V2L AI Applications Demo
    Category Application Name Details Supported
    Camera Devices
    User Interface
    Agriculture Defense wild animals for crop GitHub Link MIPI / USB CUI
    Fruit and Vegetable Plant Disease Check GitHub Link MIPI / USB GUI
    Ranch Livestock Management GitHub Link MIPI / USB CUI
    Smart Building Elevator passengers Counting GitHub Link MIPI / USB CUI
    Conference Room Usage Monitor GitHub Link MIPI / USB CUI
    Lighting Control GitHub Link MIPI / USB CUI
    Security Area Intrusion Detection GitHub Link MIPI / USB CUI
    Wear management at construction sites GitHub Link MIPI / USB CUI
    Touchless Controller for elevator GitHub Link MIPI / USB CUI
    Employee ID check for Restricted Area GitHub Link MIPI / USB GUI
    Smart City Congestion Detection in Railway Station GitHub Link MIPI / USB CUI
    Prohibited Area Management GitHub Link MIPI / USB CUI
    Distracted driving detection GitHub Link MIPI / USB CUI
    Duration monitoring for surveillance camera GitHub Link MIPI / USB CUI
    Parking Spot Reservation GitHub Link MIPI / USB GUI
    Illegal Parking Check GitHub Link MIPI / USB GUI
    Passport check support GitHub Link MIPI / USB GUI
    Bus passenger counting GitHub Link MIPI / USB CUI
    Backtravel Detection GitHub Link MIPI / USB CUI
    Violence Activity Check in Surveillance Camera GitHub Link MIPI / USB CUI
    Bird Damage Prevention GitHub Link MIPI / USB CUI
    Blind Spot Monitor GitHub Link MIPI / USB CUI
    Preceding Vehicle Movement Alert GitHub Link MIPI / USB CUI
    +Audio Output
    Emergency Vehicles Detector GitHub Link MIPI / USB CUI
    Illegal Bicycle Approach Detection GitHub Link MIPI / USB CUI
    Bicycle Rental Stock Management GitHub Link MIPI / USB CUI
    Illegal Bicycle Parking Monitor Support GitHub Link MIPI / USB CUI
    Infrastructure Defect Prevention GitHub Link MIPI / USB CUI
    Crime Prevention Support for School GitHub Link MIPI / USB CUI
    Healthcare Physical Condition Monitor GitHub Link MIPI / USB CUI
    Smart Home Air Conditioner Control GitHub Link MIPI / USB CUI
    Pet Detection in Kitchen and Child's Room GitHub Link MIPI / USB CUI
    Touchless Controller for Kitchen Appliance GitHub Link MIPI / USB CUI
    Smart TV Not included in
    Demo v5.00
    - -
    Food Package Expiry Date Check GitHub Link MIPI / USB CUI
    Industrial Work Area Personnel Management GitHub Link MIPI / USB CUI
    Access Control GitHub Link MIPI / USB CUI
    Helmet and safety vest wearing monitor GitHub Link MIPI / USB CUI
    Touchless Controller for Industrial machine GitHub Link MIPI / USB CUI
    Driver Monitoring System GitHub Link MIPI / USB CUI
    Species check support in Fish Factory GitHub Link MIPI / USB CUI
    Defect Inspection Support GitHub Link MIPI / USB CUI
    Aquaculture Industrial Support GitHub Link MIPI / USB CUI
    Retail Congestion Detection GitHub Link MIPI / USB CUI
    Smart POS GitHub Link MIPI / USB CUI
    Marketing Interest Analysis GitHub Link MIPI / USB CUI
    Staying and flow line monitoring GitHub Link MIPI / USB CUI
    Exhibition Participants Monitoring GitHub Link MIPI / USB CUI
    Store Crime Prevention GitHub Link MIPI / USB CUI

  2. After following the boot procedure in the previous section, you can start the application using the GUI.

    1. Scroll the application list on the left of the screen and click the application name.

    2. The application panel page on the right automatically shows the application that you clicked.
      You can also scroll the panel page manually.
      Note If you are using a USB mouse, please drag to scroll the pages as the mouse wheel is not available.

    3. Press the "Start" button in the panel to run the application.

  3. On monitor, the application will automatically start.
    Note 1 Some applications require GUI control.
    See the link in the User Interface column of List of RZ/V2L AI Applications Demo.
    Note 2 The termination button on application window may temporarily disappear.
    Please wait a few seconds until the screen display gets stable.
    Note 3 If the running application encounters any errors (e.g. the camera is not connected), the application will automatically exit and return to the home screen.
    Note 4 Applications with Audio Output provide the sound alert from HDMI monitor speaker in addition to the visual presentation.
    E.g. Preceding Vehicle Movement Alert.

  4. To terminate the application, follow the instruction below.
    • For CUI application, press the blue Termination Button in the bottom right-hand corner.
    • For GUI application, double click the application window.


Step 3: Shutdown process

To power-off the RZ/V2L EVK, follow the procedures below.
  1. On the home screen, click the X button at the top right-hand corner.

    demo_gui_shutdown_btn_v2l

  2. On the screen, check that shutdown procedure runs and ends with following log.

    [xxxxx.xxxxxx] reboot: Power down
  3. Press and hold the power button for 2 seconds.

    board