Live3D
Live 3D reconstruction from any camera
A server that takes video from a phone, a drone or a CCTV stream and builds a 3D model of the space live in the browser, then a refined model in real meters that can be measured, walked through and exported. It runs on one Apple Silicon workstation, with no cloud GPU.
- When
- Sep – Nov 2026 · Built
Progress70%
Capture and 3D reconstruction work end to end and are benchmarked. Scene understanding and asset export are partial; AI completion, correction and multi-session scale are planned.
34 of 36
benchmark datasets with a live delay under one second
95th-percentile delay, median of three runs per dataset. The full range is 0.18 to 1.69 seconds, with a median of 0.47.
Verified · Benchmark result files (bench/NEW_r2a, NEW_r2b and NEW_r2c.json)
108
benchmark runs: 36 datasets, three runs each
Public datasets (TUM, EuRoC, KITTI, Newer College, ETH3D, TUM-VI), synthetic houses and stock clips.
Verified · Benchmark result files (bench/NEW_r2a, NEW_r2b and NEW_r2c.json)
0.08–1.05%
camera-path error on five public sequences
0.08% and 0.21% on two TUM sequences, 0.13% on Newer College, 0.52% on EuRoC V1_01 and 1.05% on KITTI 07.
Verified · Benchmark result files (bench/NEW_r2a, NEW_r2b and NEW_r2c.json)
Every measured result the audit could trace to a run output, including the weak ones. Pretrained models are used as released; these numbers describe the system built around them.
| Measure | Result | Note | Source |
|---|---|---|---|
| Benchmark scale | 108 runs | 36 datasets, three runs each. | bench/NEW_r2a, NEW_r2b, NEW_r2c.json |
| Live delay under one second | 34 of 36 datasets | 95th percentile, median of three runs. Two datasets are over one second. | bench/NEW_r2*.json |
| Live delay, full range | 0.18–1.69 s | Median 0.47 s. | bench/NEW_r2*.json |
| Camera-path error, TUM long_office | 0.08% | bench/NEW_r2*.json |
2 more exhibits on the project page
What comes next
- Record a model growing live in the viewer; no such recording exists yet.
- Finish the draft paper and submit it to a 3D-vision or robotics workshop.
Challenge· stamped
Live3D was benchmarked on 36 datasets. On how many does the live model stay less than one second behind the camera?
34 of 36. The 95th-percentile live delay runs from 0.18 to 1.69 seconds with a median of 0.47, according to the benchmark result files (108 runs).
Show the answer
34. 34 of 36. The 95th-percentile live delay runs from 0.18 to 1.69 seconds with a median of 0.47, according to the benchmark result files (108 runs).
