bolt Short
visibility 48.9K views schedule 0:14
CULCHR.TV
Vintage

LongSplat turns shaky video into clean 3d gaussian splats

0:00
thumb_up 1.2K comment 38 2025 11 months ago
Using 3d gaussian splats to stabilize shaky handheld footage -- giving you the ultimate hyper lapse. New ICCV 2025 ai research paper by NVIDIA and: LongSplat https://github.com/NVlabs/LongSplat Abstract: LongSplat addresses critical challenges in novel view synthesis (NVS) from casually captured long videos characterized by irregular camera motion, unknown camera poses, and expansive scenes. Current methods often suffer from pose drift, inaccurate geometry initialization, and severe memory limitations. To address these issues, we introduce LongSplat, a robust unposed 3D Gaussian Splatting framework featuring: (1) Incremental Joint Optimization that concurrently optimizes camera poses and 3D Gaussians to avoid local minima and ensure global consistency; (2) a Pose Estimation Module leveraging learned 3D priors; and (3) an adaptive Octree Anchor Formation mechanism that dynamically adjusts anchor densities, significantly reducing memory usage. Extensive experiments on challenging benchmarks demonstrate that LongSplat achieves state-of-the-art results, substantially improving rendering quality, pose accuracy, and computational efficiency compared to prior approaches