TPAC breakout session on efficient audio/video processing.

Efficient audio/video processing

François Daoust – @tidoust
Dominique Hazaël-Massieux – @dontcallmedom

Context

Use cases

Media stream analysis
  • Barcode reading
  • Face recognition
  • Gesture/Presence tracking
  • Emotion analysis
  • Speech recognition
  • Depth data streams processing
Media stream manipulation
  • Funny hats
  • Voice effects
  • Background removal or blurring
  • In-browser composition
  • Augmented reality
  • Non-linear video edition
Media stream production/consumption
  • Custom codecs

Generic need

Some way to hook into the media pipeline and be able to process frames efficiently:

Efficiently?

Some of the use cases can already be implemented, but typically restricted to processing on the CPU through a Canvas. Goal is to:

Some questions

Goals

Let's look at...

References

Thank you!

Questions?