3DGS from OpenAI Sora Videos¶

We run videos generated by sora through our 3DGS reconstruction pipeline. Here are the generated 3D Gaussian Splatting models. This page includes four scenes:

Big Sur
Construction Site
Art Gallery
Minecraft

Big Sur¶

Here is a live demo:

can visit: link

You can also run the following code to load the big sur scene.

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

pi = 3.141592653
app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/big_sur.splat"
@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/static/"  + splat_file,
        scale=0.5,
        position=[-0.7, 0.75, 1.58],
        rotation=[75 / 180 * pi, -3.92 / 180 * pi, 25 / 180 * pi],
        up=[0, 1, 0],
        key="big_sur",
    )

    await sess.forever()

Construction Site¶

You can rotate, pan and dolly the camera to view the construction scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the construction scene.

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

pi = 3.141592653
app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/construction.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/static/"  + splat_file,
        scale=0.5,
        position=[-0.33, 0.39, -0.07],
        rotation=[94 / 180 * pi, -28 / 180 * pi, 134 / 180 * pi],
        key="big_sur",
    )

    await sess.forever()

Art Gallery¶

You can rotate, pan and dolly the camera to view this art gallery scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the arg gallery scene.

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/art.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/static/"  + splat_file,
        scale=5,
        position=[0.0, 0.6, 0.0],
        rotation=[90 * 0.01744, -3 * 0.01744, 0 * 0.01744],
        key="big_sur",
    )

    await sess.forever()

Minecraft¶

You can rotate, pan and dolly the camera to view the minecraft scene from different angles.

Or click on this link to visit the scene in full screen.

You can also run the following code to load the minecraft scene.

import os
from vuer import Vuer, VuerSession
from vuer.schemas import Splat

app = Vuer(static_root=os.getcwd() + "/../../../../assets")
splat_file = "splats/minecraft.splat"

@app.spawn(start=True)
async def main(sess: VuerSession):
    sess.upsert @ Splat(
        src="http://localhost:8012/static/"  + splat_file,
        scale=0.5,
        position=[-0.08, 0.31, -0.07],
        rotation=[74 * 0.01744, -11 * 0.01744, 77 * 0.01744],
        key="minecraft",
    )

    await sess.forever()