3D Scene Reconstruction from OpenAI Sora Videos (Live Demo)

We run videos generated by sora through our 3DGS reconstruction pipeline. Here are the generated 3D Gaussian Splatting models. This page includes four scenes:

1. Big Sur

2. Construction Site

3. Art Gallery

4. Minecraft

Big Sur

Here is a live demo:

can visit: link

To run this python code locally, you need to install the vuer package

pip install 'vuer[all]==0.0.31rc7'

Download the asset file at _static/assets/big_sur.splat

and run the following code:

from asyncio import sleep
from vuer import Vuer
from vuer.schemas import Splat

pi = 3.141592653
app = Vuer()

@app.spawn(start=True)
async def main(proxy):
    proxy.upsert @ Splat(
        src="https://docs.vuer.ai/en/0.0.31rc7/_static/gaussian_splatting/big_sur.splat",
        scale=0.5,
        position=[-0.7, 0.75, 1.58],
        rotation=[75 / 180 * pi, -3.92 / 180 * pi, 25 / 180 * pi],
        key="big_sur"
    )

    while True:
        await sleep(10.0)

Construction Site

You can rotate, pan and dolly the camera to view the construction scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the construction scene.

@app.spawn(start=True)
async def main(proxy):
    proxy.upsert @ Splat(
        src="https://docs.vuer.ai/en/0.0.31rc7/_static/gaussian_platting/construction.splat",
        scale=0.5,
        position=[-0.33, 0.39, -0.07],
        rotation=[94 / 180 * pi, -28 / 180 * pi, 134 / 180 * pi],
        key="big_sur",
    )

    while True:
        await sleep(10.0)

Art Gallery

You can rotate, pan and dolly the camera to view this art gallery scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the construction scene.

@app.spawn(start=True)
async def main(proxy):
    proxy.upsert @ Splat(
        src="https://docs.vuer.ai/en/0.0.31rc7/_static/gaussian_splatting/art.splat",
        scale=5,
        position=[0., 0.6, 0.],
        rotation=[90 * 0.01744, -3 * 0.01744, 0 * 0.01744],
        key="big_sur",
    )

    while True:
        await sleep(10.0)

Minecraft

You can rotate, pan and dolly the camera to view the minecraft scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the construction scene.

@app.spawn(start=True)
async def main(proxy):
    proxy.upsert @ Splat(
        src="https://docs.vuer.ai/en/0.0.31rc7/_static/gaussian_splatting/minecraft.splat",
        scale=0.5,
        position=[-0.08, 0.31, -0.07],
        rotation=[74 * 0.01744, -11 * 0.01744, 77 * 0.01744],
        key="minecraft",
    )

    while True:
        await sleep(10.0)