XML3D

A flexible, declarative approach
to Interactive 3D and VR on the Web

Philipp Slusallek
Kristian Sons, Christian Schlinkmann, Stefan Lemme


## Real-Time Ray Tracing for VR * Foveated rendering with eye tracking * Reprojection of previous frame w/ selected resampling * Works at **full frame rate** * Presented last week at Pacific Graphics 2016
## Overview: XML3D * Declarative 3D framework extending HTML5 * __Minimal__: Minimizes number new HTML elements * __Integrated__: Reuses Web tech where possible (CSS, onclick, ...) * __Generic__: Generic data types & data flow programming (Xflow) * __Programmable__: Supports full shaders & compute (also GPU) * __Renderer-Independent__: WebGL, plus ray tracing (shade.js) * __Open__: Format handler, compressed structured format (Blast) * All publisched over the last few years [Web3D, PG, ...], part of FIWARE Open Source ecosystem (WebUI) plus other tools
## New implementation (XML3D-NG) * Leverages new technologies: **WebComponents** and **WebVR** * Much smaller core library -- plus domain-specific components * XML3D, X3D, A-Frame, ... * Much improved flexibility * Shareable web components from remote library (eg. `<vr-camera>`) * Published at Web3D 2016, still prototype
## Core data-model * All components based on a core data model: * Data Tables and Entries: List of named & typed arrays * Easy reuse and compositing of data by reference * Programmable operators can modify the data (JS/glsl/shade.js)

Core elements

  • All components build upon a minimal set of core elements

Example: A-frame's <a-sphere>

  • Replicate <a-sphere> using attribute binding and core elements


  #ShadowRoot
    
      
         
           {{radius}}
         
         
           {{color}}

WebVR Plugin: Kings-Cross Station

  • 3.2 Mpoly, 350 Objects, 75 fps

WebVR Plugin: Frettage

  • 350 Kpoly, 15 Objects, 90 fps
## Publication Venues * Between three communities: * VR community (IEEE VR, etc) * Web community (WWW, etc.) * High-Performance Graphics (HPG) * Fokus on *Performance* and *Systems* aspects * Special Track on *Compiler Technologies for Graphics* * Deadline likely in early April 2017
## Thanks to our supporters * Intel Visual Computing Institute * European Union’s Seventh Framework Programme * FI-Core * Dreamspace * European Union’s H2020 Framework Programme * CIMPLEX

Thanks!

Questions?