Moshi Turner
February 24, 2023
Share this post:
Reading time:
In our previous blog post, I teased our new optical hand tracking pipeline, codenamed Mercury. Work on this tracking method began around January 2022.
Now, after a little over a year of development, it's finally ready for the public to use!
Mercury currently works on Valve Index, Windows Mixed Reality headsets (Reverb G2 v2 shown below), Oculus Rift S (early support), and Luxonis cameras (video shows a OAK-D Pro W Dev mounted on a North Star). It estimates hand pose accurately, supports limited hand-over-hand interactions, tracks fast hand movements, and is useable for drawing, typing and UI interaction.
Usage documentation is here if you want to run it in Monado. Expect in the coming few weeks some improvements to hand tracked-state stability, reductions to background jitter, a SteamVR driver so you can use it on Windows, and a much more detailed blog post showcasing the work we did to get here!
18/08/2026
Linux kernel 7.2 adds broad core, Rust, and hardware-support updates, with Collabora contributing 102 patches across graphics, media, virtualization,…
12/08/2026
Collabora and MediaTek continue expanding upstream support across the Genio IoT family, with HDMI 2.0 now enabled for existing boards, Genio…
30/07/2026
Kraid, the new compiler for the Panfrost driver stack, now passes all Vulkan CTS compute shader tests. This marks a major milestone, with…
Whether writing a line of code or shaping a longer-term strategic software development plan, we'll help you navigate the ever-evolving world of Open Source.
한국어 버전의 Collabora.com 보기
Acesse Collabora.com em Português