This code example is for outputting the display of a Camera image with graphics library package via MIPI-CSI2 of Graphic Subsystems.
The drivers used or available in this code example are listed below.
- Graphics Driver for TRAVEO™ T2G cluster series user guide
- Chapter 4: Modules
- Chapter 5: Classes
Note: The above document are available on the myInfineon Collaboration Platform (MyICP). If not already available, please create a myInfineon account on www.infineon.com. Then, contact traveo@infineon.com and request access to TRAVEO™ T2G myICP.
- JPEG decode driver user guide (TRAVEO™ T2G cluster series)
- Chapter 2: JPEG decode driver
- ModusToolbox™ v3.5.0 or later (tested with v3.5.0)
- GNU Arm® Embedded Compiler v11.3.1 (
GCC_ARM) – Default value ofTOOLCHAIN
Device used in this code example is:
Board used for testing is:
- TRAVEO™ T2G Cluster 6M Lite Kit (KIT_T2G_C-2D-6M_LITE)
This is a basic code example for outputting video via the MIPI-CSI2 camera on the TRAVEO™ T2G Cluster 6M Lite kit to an HDMI display. See the Hardware setup for a MIPI-CSI2 interface.
Graphic Subsystems
- Supports 2D and 2.5D (perspective warping, 3D effects) graphics rendering
- 40-bit for internal processing (RGBA 10-bit per color channel)
- 24-bit for interfaces (RGB 8-bit per color channel)
- 4096 KB of embedded video RAM memory (VRAM)
- Up to two video output interfaces supporting two displays from
- Parallel RGB (max display size: 1600 × 600 at 80 MHz)
- FPD-link single (max display size: 1920 × 720 at 110 MHz)
- FPD-link dual (max display size: 2880 × 1080 at 220 MHz)
- One Capture engine for video input processing for ITU 656 or parallel RGB/YUV or MIPI CSI-2 input
- ITU656 (standard camera capture: up to 800 × 480)
- RGB (max capture size 1600 × 600 at 80 MHz) or
- Two-/four-lane MIPI CSI-2 interface (max capture size: 1920 × 720 for two lanes at 110 MHz, 2880 × 1080 for four lanes at 220 MHz)
- Display warping on-the-fly for HUD applications
- Direct video feed through from capture to display interface with graphics overlay
- Composition engine for scene composition from display layers
- Display engine for video timing generation and display functions
- Drawing engine for acceleration of vector graphics rendering
- Command sequencer for setup and control of the rendering process
- Supports graphics rendering without frame buffers (on-the-fly to both displays)
- Dual-channel FPD-Link interface for up to Wide-HD resolution video output
- JPEG Decoder
- Decodes JPEG images of various formats into pixel data with conformance to a subset of standard ISO/IEC10918-1
- Color spaces supporting RGB/YUV/Grayscale
- Supports YUV sub-sampling 4:4:4/4:2:2/4:1:1/4:2:0
- Image size between 1×1 to 16384×16384 pixels
More details can be found in:
- TRAVEO™ T2G CYT4DN
This code example has been developed for:
- TRAVEO™ T2G Cluster 6M Lite Kit (KIT_T2G_C-2D-6M_LITE)
Figure 1. KIT_T2G_C-2D-6M_LITE (Top View)
No changes are required from the board's default settings.
Resolution (hardware prerequisite)
-
This code example displays the camera image of 1280 x 720 resolution. Supported camera module is following.
- Arducam 5MP OV5640 Camera Module for Renesas RZ/V2L Evaluation Kit 5MP OV5640 Camera Module
Install a terminal emulator if you don't have one. Instructions in this document use Tera Term.
In this code example uses a capture engine to process video input via MIPI-CSI2, and outputs the captured video to a display via HDMI.
- First, enable graphics subsystem's power on.
- Next, initialize the graphics environment.
- Configure graphics-related VideoSubSystem interrupts. At this point, set up the interrupt settings for Graphix/MIPI and VideoIO.
- Initializes VIDEOSS and MIPI for buffered capture(Enable PLL/ Clock Divider/ Allocate video memory/ MIPI-CSI and sensor etc configuration).
- Initialize the HDMI transceiver
- Note: Hot plug detection is also performed during the main loop.
- If an HDMI or MIPI error occurs, an error message is printed.
After compiling the code, perform the following steps to flash the device:
- Connect the board to your laptop using the provided USB cable through the KitProg3 USB connector.
- Open a terminal program and select the KitProg3 COM port. Set the serial port parameters to '8N1' and '115200 baud.
- Connect the board to an HDMI Display using the HDMI cable through the HDMI connector.
- Connect the board to OV5640 Camera Module through the MIPI-CSI2.
- Program the board using one of the following:
- Select the code example project in the Project Explorer.
- In the Quick Panel, scroll down, and click [Project Name] Program (KitProg3_MiniProg4).
- After programming, the application starts automatically.
-
Note: It takes some time to display the camera image, After video output begins, blink the LED1(D900) approximately every 250 microseconds.
-
Check the following display from UART.
Figure 2. Terminal output on program startup
-
- Below is an image showing the camera output displayed on the screen.
Figure 3. Sample image showing video captured from the camera being output to the monitor
Relevant Application notes are:
- AN235305 - Getting started with TRAVEO™ T2G family MCUs in ModusToolbox™
ModusToolbox™ is available online:
- https://www.infineon.com/modustoolbox
- Graphics Driver for TRAVEO™ T2G cluster series user guide
- JPEG decode driver user guide (TRAVEO™ T2G cluster series)
ModusToolbox™ Graphics middleware is available online:
Associated TRAVEO™ T2G MCUs can be found on:
More code examples can be found on the GIT repository:
For additional trainings, visit our webpage:
For questions and support, use the TRAVEO™ T2G Forum: