August 21, 2018
As we all know, OpenGL is an aging API which originated in the 1990s. Despite that, it uses modular structure, allowing new features to be added via extensions. An extremely useful approach, proven to be robust and used by many other APIs - OpenCL and Vulkan are the more well known.
Although, OpenGL in itself is the rendering API, the windowing system binding APIs such as GLX, WGL and EGL, are showing their age as well. An era where multi GPU systems were extremely uncommon and even harder to find.
Fast-forward to present days: dual GPU systems are becoming the norm, with platforms using 16 or even 32 not being unheard of.
So how did the API evolve, how do we handle multi GPUs installed on the same system? Solutions vary across vendors, but in Mesa we have
DRI_PRIME is an environment variable, initially introduced to work with two GPUs. By setting it to 1 prior to calling their application, the GL stack will query the X server and use the "other" GPU present on the system.
That was a good initial solution, although it brought a number of questions:
With the first question being more urgent, the community came with a solution: Allow the user to select the device by listing the device
ID_PATH_TAG, as provided by udev, in
With that ticked off, how do we handle the other two? Thanks to the extendable structure of EGL, we can accomplish that with the EGLDevice family of extensions.
They define the concept of EGLDevice, the means of enumerating and querying device specific attributes. Another two extensions
EGL_MESA_device_software define respectively hardware devices, backed with a DRM device node and software devices - as available in Mesa, but not many other GL implementations.
EGL_EXT_platform_device, defines a way of using an EGLDevice, yet without an explicit awareness of the underlying windowing system.
Which means that we can create a context, although we cannot test and analyse the interactions with the Android, Wayland compositor or X11 that's underneath. To address that,
EGL_EXT_explicit_device was proposed - allowing us to select, simultaneously, the device and the platform to be used.
As pointed earlier, the set of extensions allows us to explicitly select which device we want to use.
Hence, the use-cases are only limited to one's imagination. Here are a few that come to mind:
My personal interest is testing and development. We could easily have a single system with multiple GPUs instead of one system per GPU. That will make it easier for driver developers to test across different devices, improving the process and robustness of the drivers.
As part of the process, I have provided patches for Mesa and the Piglit testing suite. They cover the following extensions:
At the time of writing, the Piglit patches have been merged, while the Mesa ones are on the mailing list awaiting review.
EGL_EXT_device_base- implementing both
In my testing, they have proved to be in fairly good shape, although further testing and review is needed.
While the extension EGL_MESA_device_software is in good shape, we are planning to follow the official Khronos process and ratify it. Additionally, a few questions were raised in the
EGL_EXT_explicit_device spec, which will need to be resolved and Mesa implementation will be required.
While that covers most issues, one corner-case remains - how can one do the same with X? GLX does not have such a set of extensions. Our goals is to draft and bring them forward to Khronos. Thus projects which aim to simplify all the platform specifics for you, such as Waffle and SDL, they will have a consistent way of handling device selection.
Which brings us to the final piece. We are planning to design and implement a user-friendly API for Waffle, that makes use of the extensions.
I'll be giving a talk about this and the Mesa releasing this September at XDC 2018 in A Coruña, Spain. A dozen Collaborans will be in attendance as well, so please come say hello!
In the embedded world, many modern SoCs such as the ST Microelectronics STM32MP1 now include coprocessor cores which can be used for a wide…
Our recent efforts on the Hantro kernel driver have resulted in the addition of H.264 decoding support and multiple performance improvements.…
Hwangsaeul, or H8L, a remote surveillance streaming solution, utilizes the capability of libsrt to collect statistics from open SRT sockets…
Complex, real-world correctness tests and performance analysis are now possible thanks to gltrim, a new tool recently added to apitrace,…
Earlier this week, WebRTC became an official W3C and IETF standard. GStreamer has a powerful and rapidly maturing WebRTC implementation.…
Last year, from June to September, I worked on the kernel development tool Coccinelle under Collabora. I implemented a performance boosting…