Moshi Turner
February 24, 2023
Share this post:
Reading time:
In our previous blog post, I teased our new optical hand tracking pipeline, codenamed Mercury. Work on this tracking method began around January 2022.
Now, after a little over a year of development, it's finally ready for the public to use!
Mercury currently works on Valve Index, Windows Mixed Reality headsets (Reverb G2 v2 shown below), Oculus Rift S (early support), and Luxonis cameras (video shows a OAK-D Pro W Dev mounted on a North Star). It estimates hand pose accurately, supports limited hand-over-hand interactions, tracks fast hand movements, and is useable for drawing, typing and UI interaction.
Usage documentation is here if you want to run it in Monado. Expect in the coming few weeks some improvements to hand tracked-state stability, reductions to background jitter, a SteamVR driver so you can use it on Windows, and a much more detailed blog post showcasing the work we did to get here!
06/10/2026
A look at the USB-PD, PHY, hotplug, and DRM changes involved in making USB-C DisplayPort Alternate Mode work on RK3588/RK3576, and where…
02/10/2026
Next week we'll be in Prague for a packed Open Source week! We’ll speak at the Linux Plumbers Conference and GStreamer Conference, and present…
29/09/2026
We’ll be in Frankfurt this Thursday for the AMD Embedded Computing Summit! See a live demo of our AI Magic Mirror for a touchless, real-time…
Whether writing a line of code or shaping a longer-term strategic software development plan, we'll help you navigate the ever-evolving world of Open Source.
한국어 버전의 Collabora.com 보기
Acesse Collabora.com em Português