From Flat Screens to Fully Walk-Around Mixed Reality Content
Volumetric video streaming marks a major shift in how mixed reality content is delivered and experienced. Instead of watching performers on a flat screen or in a fixed 3D viewpoint, users can now walk around a fully captured scene, viewing it from any angle as if it were physically present. This is powered by advanced 3D capture technology that reconstructs real people and environments as dense clouds of points or “splats” in space. Unlike traditional stereoscopic or limited-perspective immersive video, volumetric content supports true six degrees of freedom, letting you move closer, step behind, or circle around a subject naturally. Because the content is streamed rather than downloaded as massive files, it feels much closer to how we already consume online video, but with presence and depth that bridge the gap between video, games, and real life.
How Gracia Streams Volumetric Video Directly to Quest 3
Gracia’s platform shows how volumetric video streaming can reach everyday devices, including Quest 3 streaming through a simple web browser. Instead of installing a dedicated app or waiting for multi‑gigabyte downloads, users open a WebXR site and see moving volumetric scenes appear within seconds. Under the hood, Gracia represents scenes as dynamic Gaussian splats, each a semi‑transparent, colored blob in 3D space. To make this streamable, the system sends keyframes plus motion deltas, encoding only what changes over time—similar in spirit to how traditional video codecs work. Combined with WebGPU for high‑performance rendering in the browser, this architecture removes one of mixed reality’s biggest friction points: waiting. With no hard file-size cap, streams can span from short sequences to full performances, transforming a headset into an instant portal for rich, immersive video without storage anxiety.
Breaking Free of File Size, Storage, and Bandwidth Constraints
Immersive 3D capture technology has historically been limited by huge file sizes and storage bottlenecks, making longer volumetric experiences impractical for consumers. Gracia’s compression pipeline addresses this by minimizing the data that needs to be transmitted while preserving enough detail to feel lifelike. At higher quality settings, streaming volumetric scenes requires a steady but increasingly common broadband connection, and there are lower‑bandwidth modes that trade detail for accessibility. Crucially, because the content is streamed rather than fully stored on the headset, creators are no longer forced to trim experiences to fit device storage or ask users to endure lengthy downloads. This opens the door to volumetric concerts, theatrical pieces, or training sessions that can match or exceed traditional video in duration. The result is a viewing model closer to mainstream streaming platforms, but with volumetric depth and interactivity layered on top.
Mixed Reality on Quest 3 Today, Apple Vision Pro Next
Volumetric video streaming is already live on standalone headsets such as Quest 3, where captures can be anchored into your physical room via passthrough mixed reality. You can, for example, place a musician or a documentary subject in your living space and move around them as if they were there. On some premium headsets, browser limitations currently restrict passthrough usage, so these experiences appear in virtual environments instead of blending with the real world. To overcome this, dedicated apps are being developed to bring full mixed reality support, including an upcoming Apple Vision Pro app that will allow volumetric captures to appear naturally in the user’s environment. As browser APIs and platform policies evolve, the same web-first pipeline should reach an even broader range of devices, turning volumetric video streaming into a cross‑platform layer for immersive content.
New Possibilities for Entertainment, Events, and Interactive Experiences
The ability to stream volumetric video directly to consumer hardware transforms what mixed reality content can be. In entertainment, artists can perform as volumetric avatars in fans’ living rooms, with spatial audio enriching the sense of presence. Virtual events can feel more like attending in person, as viewers walk around speakers or performers instead of passively watching a 2D feed. For interactive experiences, volumetric captures can be embedded into game engines like Unity or Unreal, combining realistic human performances with responsive virtual worlds. This fusion enables training scenarios with lifelike instructors, narrative experiences with truly present characters, and social platforms where user‑generated volumetric clips become a new media format. As capture and processing become more accessible, volumetric video streaming is poised to move from niche demo to everyday immersive video, reshaping how stories, performances, and information are shared.