3DGS from OpenAI Sora Videos

We run videos generated by sora through our 3DGS reconstruction pipeline. Here are the generated 3D Gaussian Splatting models. This page includes four scenes:

Big Sur
Construction Site
Art Gallery
Minecraft

Big Sur

Here is a live demo:

can visit: link

You can also run the following code to load the big sur scene.

python

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

pi = 3.141592653
app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/big_sur.splat"
@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/workspace/"  + splat_file,
        scale=0.5,
        position=[-0.7, 0.75, 1.58],
        rotation=[75 / 180 * pi, -3.92 / 180 * pi, 25 / 180 * pi],
        up=[0, 1, 0],
        key="big_sur",
    )

    await sess.forever()

Construction Site

You can rotate, pan and dolly the camera to view the construction scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the construction scene.

python

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

pi = 3.141592653
app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/construction.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/workspace/"  + splat_file,
        scale=0.5,
        position=[-0.33, 0.39, -0.07],
        rotation=[94 / 180 * pi, -28 / 180 * pi, 134 / 180 * pi],
        key="big_sur",
    )

    await sess.forever()

Art Gallery

You can rotate, pan and dolly the camera to view this art gallery scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the arg gallery scene.

python

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/art.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/workspace/"  + splat_file,
        scale=5,
        position=[0.0, 0.6, 0.0],
        rotation=[90 * 0.01744, -3 * 0.01744, 0 * 0.01744],
        key="big_sur",
    )

    await sess.forever()

Minecraft

You can rotate, pan and dolly the camera to view the minecraft scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the minecraft scene.

python

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/minecraft.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/workspace/"  + splat_file,
        scale=0.5,
        position=[-0.08, 0.31, -0.07],
        rotation=[74 * 0.01744, -11 * 0.01744, 77 * 0.01744],
        key="minecraft",
    )

    await sess.forever()