Gracia's groundbreaking volumetric capture technology has taken a significant leap forward, enabling seamless streaming of moving volumetric scenes. This development marks a pivotal moment in the evolution of immersive experiences, particularly in the realm of virtual reality (VR) and mixed reality (MR). The ability to stream these captures without the need for app installation or full scene downloads is a game-changer, opening up a world of possibilities for content creators and consumers alike.
The technology behind Gracia's streaming capability is a sophisticated application of Gaussian splatting, a technique that fits millions of semitransparent colored blobs (Gaussians) in 3D space. This allows for realistic rendering of arbitrary viewpoints in real-time, a significant advancement in 3D reconstruction. By encoding keyframes and motion change deltas, Gracia's system sends only the necessary data, reducing the strain on internet connections and enabling near-instant streaming.
This breakthrough is particularly notable when compared to China's 4DV AI, which demonstrated WebXR demo of volumetric 6DoF videos last year but with limitations. Gracia's streaming solution, on the other hand, offers a more comprehensive and user-friendly experience, eliminating the need for pre-downloading and providing a seamless viewing experience.
The implications of this technology are far-reaching. It paves the way for the creation of a 'YouTube of truly volumetric content,' a platform where users can access and interact with dynamic, moving volumetric scenes without the hassle of downloads. This could revolutionize the way we consume and engage with VR and MR content, making it more accessible and interactive.
However, the capture and processing requirements for creating these volumetric scenes are substantial. Around 60 shutter-synced and genlocked cameras are needed, and the processing costs are significant. Despite these challenges, the potential for this technology to transform the entertainment industry is immense. Imagine watching a musician perform as a 6DoF volumetric figure in your living room, or attending a comedy show in a virtual space.
The next step in this journey is to make volumetric scene capture more accessible. Reducing the processing time and enabling capture with a couple of iPhones could democratize the creation of such content. While it may seem impossible today, the rapid advancements in AI and the pace of progress in the 3D reconstruction scene suggest that this could become a reality within the decade.
Gracia's streaming capability is a testament to the power of innovation in the tech industry. It not only enhances the user experience but also opens up new avenues for content creation and consumption. As the technology continues to evolve, we can anticipate even more immersive and interactive experiences, further solidifying the role of VR and MR in our digital lives.
