Appendix¶

GStreamer¶

In Ubuntu and Debian for Renesas RZ Family MPUs, we support GStreamer in the same way as in Renesas VLP and/or SDK.

Here, we also support Renesas' own elements, such as vspmfilter.

By default, the Renesas Elements vspmfilter and gst-omx are prepared and installed when the package is built.

However, to use GStreamer, users must install Weston and GStreamer using aptitude as follows:

sudo apt-get install weston libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev libgstreamer-plugins-bad1.0-dev gstreamer1.0-plugins-base gstreamer1.0-plugins-good gstreamer1.0-plugins-bad gstreamer1.0-plugins-ugly gstreamer1.0-libav gstreamer1.0-tools gstreamer1.0-x gstreamer1.0-alsa gstreamer1.0-gl gstreamer1.0-gtk3 gstreamer1.0-qt5 gstreamer1.0-pulseaudio

Ref.: Install GStreamer on Ubuntu or Debian.

Supported (Verified) OSS and Renesas Elements¶

Plugin Category	Element Name	Package	Description
Video Decode	`omxh264dec`	`gst-omx`	OpenMAX H.264 Video Decoder
Video Conversion	`vspmfilter`	`gst-plugin-vspmfilter`	This is a GStreamer plugin that can use the color conversion and scaling with the hardware acceleration on Renesas RZ Family MPU(s)
Video Sink	`waylandsink`	`gst-plugins-bad`	The waylandsink is creating its own window and renders the decoded video frames to that
Demux	`qtdemux`	`gst-plugins-good`	Demuxes a .mov/mp4 file into raw or compressed audio and/or video streams

Example Pipeline¶

Note

All videos used here are open and accessible from the Renesas media repository.

Pre-request steps¶

Prepare the Weston desktop for waylandsink

To use waylandsink, it's required to start the Weston desktop as below.

If the Weston desktop already started, skip these steps.
```
sudo -i
```
```
export XDG_RUNTIME_DIR=/run/user/1000/
weston -B drm --continue-without-input
```

Notice

Root access maybe required to execute GStreamer pipeline.

Video Playback¶

In this example, we play the sintel_trailer-720p.mp4 (H.264 MP4 video) and display (video portion only) using waylandsink.

To play H.264 MP4 files, it is necessary to demux the file with qtdemux and decode the decoded video stream with omxh264dec.

gst-launch-1.0 filesrc location=sintel_trailer-720p.mp4 ! qtdemux ! h264parse ! omxh264dec ! waylandsink

Video Playback with Color Conversion and Resizing¶

Using vspmfilter to perform color conversion and resizing with Video Signal Processor (VSP; Renesas HW accelerator).

Note

Due to HW specification, vspmfilter for RZ/G2L only support downscaling (decreasing).

gst-launch-1.0 filesrc location=sintel_trailer-720p.mp4 ! qtdemux ! h264parse ! omxh264dec ! vspmfilter dmabuf-use=true ! video/x-raw, format=BGRA, width=640, height=480 ! waylandsink

Ubuntu/Debian Version	GStreamer Version	User's Manual
		RZ/G2L Group and RZ/V2L Group Linux Interface Specification GStreamer User's Manual: Software
Ubuntu 24.04 Noble Numbat	v1.24.2
Debian 13 Trixie	v1.26.2