3D Scene Reconstruction from OpenAI Sora Videos (Live Demo)¶
We run videos generated by sora through our 3DGS reconstruction pipeline. Here are the generated 3D Gaussian Splatting models. This page includes four scenes:
Big Sur¶
Here is a live demo:
can visit: link
To run this python code locally, you need to install the vuer
package
pip install 'vuer[all]==0.0.34-rc4'
Download the asset file at _static/assets/big_sur.splat
and run the following code:
from asyncio import sleep
from vuer import Vuer
from vuer.schemas import Splat
pi = 3.141592653
app = Vuer()
@app.spawn(start=True)
async def main(proxy):
proxy.upsert @ Splat(
src="https://docs.vuer.ai/en/0.0.34-rc4/_static/gaussian_splatting/big_sur.splat",
scale=0.5,
position=[-0.7, 0.75, 1.58],
rotation=[75 / 180 * pi, -3.92 / 180 * pi, 25 / 180 * pi],
key="big_sur"
)
while True:
await sleep(10.0)
Construction Site¶
You can rotate, pan and dolly the camera to view the construction scene from different angles.
Or click on this link to visit the scene in full screen.
You can also run the following code to load the construction scene.
@app.spawn(start=True)
async def main(proxy):
proxy.upsert @ Splat(
src="https://docs.vuer.ai/en/0.0.34-rc4/_static/gaussian_platting/construction.splat",
scale=0.5,
position=[-0.33, 0.39, -0.07],
rotation=[94 / 180 * pi, -28 / 180 * pi, 134 / 180 * pi],
key="big_sur",
)
while True:
await sleep(10.0)
Art Gallery¶
You can rotate, pan and dolly the camera to view this art gallery scene from different angles.
Or click on this link to visit the scene in full screen.
You can also run the following code to load the construction scene.
@app.spawn(start=True)
async def main(proxy):
proxy.upsert @ Splat(
src="https://docs.vuer.ai/en/0.0.34-rc4/_static/gaussian_splatting/art.splat",
scale=5,
position=[0., 0.6, 0.],
rotation=[90 * 0.01744, -3 * 0.01744, 0 * 0.01744],
key="big_sur",
)
while True:
await sleep(10.0)
Minecraft¶
You can rotate, pan and dolly the camera to view the minecraft scene from different angles.
Or click on this link to visit the scene in full screen.
You can also run the following code to load the construction scene.
@app.spawn(start=True)
async def main(proxy):
proxy.upsert @ Splat(
src="https://docs.vuer.ai/en/0.0.34-rc4/_static/gaussian_splatting/minecraft.splat",
scale=0.5,
position=[-0.08, 0.31, -0.07],
rotation=[74 * 0.01744, -11 * 0.01744, 77 * 0.01744],
key="minecraft",
)
while True:
await sleep(10.0)