Media content
- ① Progressive media playback
- Media container file (e.g. MP4, OGG, WebM)
- Multiplex of encoded audio/video tracks (e.g. H.264, AV1, AAC)
- ② Adaptive media playback
- Media stream (e.g. ISOBMFF, MPEG2-TS, WebM)
- Data segments assembled on the fly
- ③ Real-time conversations
- Individual encoded/decoded Media stream tracks
- Coupling between encoding/decoding and transport
- ④ Synthesized audio playback
- Short encoded/decoded audio samples
This talk provides an overview of existing, planned or possible hooks for processing muxed and demuxed media in real time or faster than real time in Web applications, and rendering the results. It also presents high-level requirements for efficient media processing.