We're hiring!
*

Open source machine learning at IBC 2022

Kara Bembridge avatar

Kara Bembridge
September 06, 2022

Share this post:

Back in Amsterdam!

Returning for a long awaited reunion, IBC is back at the RAI in Amsterdam! The content and technology community will connect at this 4 day event, starting September 9, to gain the latest insights on empowering content. Collabora will be present to take part and share in this exciting edition for 2022. If you are planning on attending, please make sure to add booth F57 in Hall 5 to your itinerary & come say hello!

This year, we are showcasing two new Open Source software demonstrations featuring machine learning. The first features a backend video compression that runs on a complete open source stack, and the second is a data quality assurance tool that's designed to integrate into the annotation pipeline.

  • Panfrost ML-based video compression

    Traditional video codec techniques are hitting their limit, newer codecs require a 10x increase in computational power for a 2x gain in coding efficiency. It has become clear that radically new approaches are needed. Many have suggested that Deep Learning techniques can yield better results within acceptable computational deadlines. This demo proposes such a technique specifically targeted at videoconferencing.

    Using open source software, Collabora has developed an efficient compression pipeline that enables a face video broadcasting system that achieves the same visual quality as the H.264 standard while only using one-tenth of the bandwidth.

    In a nutshell, the face video compression algorithms rely on a source frame of the face, a pipeline to extract the important features from a face image, and a generator to reconstruct the face using the extracted and compressed features on the receiving side. We will be demonstrating the entire process, including both encoding and decoding, on a small Rockchip RK3399 board.

  • Analyzing and improving datasets with MLfix

    Training neural networks requires well labelled datasets. Sadly, labelling datasets by humans or by machines is an error-prone process. A leading AI expert Andrew Ng discovered that "In many industries where giant data sets simply don’t exist, I think the focus has to shift from big data to good data." and yet there is a serious lack of tools for working with and understanding datasets. That's why Collabora wrote an Open Source tool called MLfix to analyze and improve the quality of datasets.

    The tool works by sorting the images through visual similarity and then showing them in a streamlined user interface. The interface allows images to be marked so that the QA process can be performed. The visual similarity sorting is based on a model trained in an unsupervised manner, so it's not limited to ImageNet-like data.

As a leading contributor to the GStreamer, PipeWire and Wayland projects, Collabora is uniquely positioned to provide the expertise your require to integrate the latest Open Source technologies with the newest multimedia standards. Be it for low latency streaming, cloud transcoding, embedded capture and playback or AR/VR, Collabora can help you with customization, optimization, hardware acceleration and complex multimedia integration so you can build innovative solutions across the digital media space.

Please contact us to set up a meeting with us at IBC.

We look forward to seeing you at the RAI!

 

Comments (0)


Add a Comment






Allowed tags: <b><i><br>Add a new comment:


 

Search the newsroom

Latest News & Events

A busy, open source week in Dublin!

12/09/2022

Mere weeks after the debut of Open Source Summit Latin America, Dublin continues the collaborative momentum with the 2022 hybrid editions…

Open source machine learning at IBC 2022

06/09/2022

Showcasing two new software demonstrations featuring machine learning, including backend video compression that runs on Panfrost, and a…

Last chance to submit to FOSS XR!

30/08/2022

Be part of the FOSSXR lineup by submitting your talk by September 5th, 2022. That means there's one week left for all you AR and VR enthusiasts…

Open Since 2005 logo

We use cookies on this website to ensure that you get the best experience. By continuing to use this website you are consenting to the use of these cookies. To find out more please follow this link.

Collabora Ltd © 2005-2022. All rights reserved. Privacy Notice. Sitemap.