Visit this page on Quest or Vision Pro to view the scene in VR! These are neural radiance field (NeRF) videos and photos compressed and rendered in Lifecast's ldi3 format. [video source]

NeRF volumetric VR video for Quest and Vision Pro has arrived, and it's open source

Open source immersive volumetric video for developers and VR filmmakers

[pdf] Baking Neural Radiance Field Video to Immersive Layered Depth Images
This technical report explains 'ldi3', our web-streamable realtime volumetric media format, and how to compress NeRFs in it.
Neural radiance field (NeRF) video engine
An efficient C++ implementation of state of the art neural radiance field video and ldi3 compression.
Volumetric video player for JavaScript, WebXR, THREE.js
Example code for implementing the ldi3 player in any web page using JavaScript and THREE.js.
Volumetric video player for Unreal Engine 5
An example project for Unreal Engine illustrating playback of the ldi3 format.
Volumetric video player for Unity
The Unity flavor of Lifecast's volumetric video player.

Minimal example: embed volumetric video in a web page with WebXR and THREE.js


<html>
  <head>
  <script src="https://cdn.jsdelivr.net/gh/fbriggs/lifecast_public/lifecast.min.js"></script>
  </head>
  <body>
  <div id="player_div" style="width: 600px; height: 500px;"></div>
  <script>
  LifecastVideoPlayer.init({
    _media_urls: ["https://lifecast.ai/media/orrery_transp_ldi3.jpg"],
    _embed_in_div: "player_div",
  });
  </script>
  </body>
</html>

Professional tools by Lifecast

Tools for creating and enhancing 2D and 3D video

UpscaleVideo.ai
Increase video resolution using AI on Windows and Mac (works with any 2D video).
Volumetric Video Editor
A tool for Windows and Mac that transforms VR180 video (stereoscopic) to ldi3 (volumetric). Uses machine learning based fisheye stereo depth estimation (not NeRF).
Volurama
Volurama is an easy-to-use GUI for Windows and Mac that runs the same powerful NeRF and computer vision algorithms described here.

About Lifecast

Lifecast is dedicated to pushing the limits of immersive media, while making tools that are practical for creators to unleash their creativity. Lifecast is venture funded by Y Combinator, and was founded in 2021 by Forrest Briggs, Ph.d. (40+ patents, JPL, Facebook, Lyft, Google X).

Contact Lifecast

info@lifecastvr.com
Email us about creating volumetric media, and deploying it in unique applications.
Lifecast Facebook Group
The best place to ask questions and get the latest news.

Services

Volumetric and holographic video production and application development
Virtual production and special effects
Computer vision and robotics