LVC21-313: Bringing Stateless Video Decoder Support To Linux

Session Abstract

Under development for many years, support for video CODEC accelerators in Linux gained significant traction in 2020. A formal specification was merged into the Linux Media subsystem in v5.5, allowing for blob free hardware accelerated decoding on popular platforms such as Allwinner, NXP i.MX8, Microchip SAMA5, and Rockchip. In addition, H.264 V4L2 controls were destaged in v5.11, and the remaining CODEC controls will be coming soon to mainline. In this talk, we will take a deep dive into stateless video decoder support for Linux, including an overview of the decoding process using hardware accelerators, a look at the user space API and how it's used within multimedia frameworks, and how this all works with modern GPU accelerators. Lastly, this presentation would not be complete without discussing the effort to bring native support in FFMPEG and GStreamer, and its major role in the development of the new Open Source drivers.

Session Speakers

Nicolas Dufresne

Collabora (Principal Multimedia Engineer @ Collabora)

Nicolas Dufresne is a Principal Multimedia Engineer at Collabora. Based in Montréal, he was initially a generalist developer with a background in STB development. Nicolas began contributing to the GStreamer Multimedia Framework in 2011, adding infrastructure and primitives to support accelerated upload of buffers to GL textures. Today, Nicolas is actively involved in both the GStreamer and Linux Media communities to help create a solid support for CODECs on Linux.

Under development for many years, support for video CODEC accelerators in Linux gained significant traction in 2020. A formal specification was merged into the Linux Media subsystem in v5.5, allowing for blob free hardware accelerated decoding on popular platforms such as Allwinner, NXP i.MX8, Microchip SAMA5, and Rockchip. In addition, H.264 V4L2 controls were destaged in v5.11, and the remaining CODEC controls will be coming soon to mainline.

In this talk, we will take a deep dive into stateless video decoder support for Linux, including an overview of the decoding process using hardware accelerators, a look at the user space API and how it’s used within multimedia frameworks, and how this all works with modern GPU accelerators. Lastly, this presentation would not be complete without discussing the effort to bring native support in FFMPEG and GStreamer, and its major role in the development of the new Open Source drivers.

comments powered by Disqus

Other Posts

Sign up. Receive Updates. Stay informed.

Sign up to our mailing list to receive updates on the latest Linaro Connect news!