[MA35D1] Real-Time Video Streaming

Application	Implementing video streaming on the MA35D1 FreeRTOS platform using the Real-time Transport Protocol (RTP) for transmission, and leveraging the MA35D1's built-in H.264 decoder for decoding and playback.
BSP Version	MA35D1_NonOS_BSP V1.4
Hardware	NuMaker-HMI-MA35D1-S1 V1.0

This sample program demonstrates how to implement a high-performance, real-time video streaming decoding and display system on the Nuvoton MA35D1 FreeRTOS platform by integrating the lwIP network stack with RTP (Real-time Transport Protocol) technology. Unlike traditional approaches that rely on the RTSP protocol, this solution adopts a more lightweight and direct UDP Server reception method. By bypassing the signaling negotiation process and directly processing RTP packets from IP cameras, this architecture is crucial for embedded video surveillance applications that demand ultra-low latency.

In terms of implementation, the system immediately initializes the MA35D1's built-in H.264 hardware decoder upon starting FreeRTOS. To ensure the stability of network packets during high-bitrate transmissions, this example specifically introduces a Ring Buffer mechanism. RTP data received from the network layer is temporarily stored in the buffer, unpacked, and reconstructed by the software before being sent directly to the hardware decoding engine for processing and outputting to the display interface. This design fully leverages the hardware acceleration capabilities of the MA35D1, delivering a smooth and stable video playback experience even within an RTOS environment.

This sample program is developed based on the MA35D1_NonOS_BSP V1.4 development environment (https://github.com/OpenNuvoton/MA35D1_NonOS_BSP). Before execution, please ensure that you have correctly set up the corresponding development environment and acquired the necessary driver libraries.

Although this document uses the NuMaker-HMI-MA35D1-S1 V1.0 development board for the implementation demonstration, its concepts and core code are applicable to all MA35D1 series MPUs equipped with H.264 hardware decoding capabilities. It serves as an ideal reference for developing industrial monitoring terminals, smart security displays, or any embedded products requiring highly efficient video stream processing.

You can download the sample code at EC_MA35D1_IPCam_RTP_V1.00.