taichi_3d_gaussian_splatting
taichi_3d_gaussian_splatting copied to clipboard
wanmeihuali
support bg color
Running experiment on sagemaker with git sha cd7417be07ed5c497accff69a1f24453f8184a3b
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Running experiment on sagemaker with git sha cd7417be07ed5c497accff69a1f24453f8184a3b
Training job support-bg-color-cd7417b-230713-054228-tat-truck-baseline completed.
Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/support-bg-color-cd7417b-230713-054228-tat-truck-baseline/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/support-bg-color-cd7417b-230713-054228-tat-truck-baseline/output/output.tar.gz
Training job support-bg-color-cd7417b-230713-054228-tat-truck-baseline final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:num_valid_points | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.028060728684067726 | 0.04665923863649368 | 463203.0 | 26.227439880371094 | 0.8789467215538025 | 0.12105327844619751 | 0.05423763766884804 | 24.982290267944336 | 0.864874541759491 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 22.77389907836914 | 0.811922550201416 | 25.415742874145508 | 0.8546379804611206 | 26.227439880371094 | 0.8789467215538025 | 22.970996856689453 | 0.8145796656608582 | 23.850791931152344 | 0.8371531963348389 | 24.982290267944336 | 0.864874541759491 |
Training job support-bg-color-cd7417b-230713-054144-tat-train-baseline completed.
Model url: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/support-bg-color-cd7417b-230713-054144-tat-train-baseline/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/support-bg-color-cd7417b-230713-054144-tat-train-baseline/output/output.tar.gz
Training job support-bg-color-cd7417b-230713-054144-tat-train-baseline final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:num_valid_points | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.060022469609975815 | 0.08679809421300888 | 693872.0 | 21.207773208618164 | 0.8060994148254395 | 0.19390058517456055 | 0.10382827371358871 | 20.614830017089844 | 0.7850539088249207 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 22.61538314819336 | 0.7635285258293152 | 22.542423248291016 | 0.8190064430236816 | 21.207773208618164 | 0.8060994148254395 | 19.258577346801758 | 0.7346248030662537 | 19.708393096923828 | 0.7557579278945923 | 20.614830017089844 | 0.7850539088249207 |
Does this PR ready for merging (after rebasing)? Anything you plan to work on? @wanmeihuali
Does this PR ready for merging (after rebasing)? Anything you plan to work on? @wanmeihuali
The previous experiment does not show any significant improvement with background color...Actually, the PSNR even dropped a bit... I'm not sure if it will get better after rebasing. Anyway, we will only merge it if it does not hurt the metrics.
I prefer to use "black" background (0, 0, 0) as the default value for training. But at the render time, one can choose to switch between black or white or other custom colors.
Running experiment on sagemaker with git sha 3ddc7472d0a86479639d1ec7650c4a0d11470ff1
Running experiment on sagemaker with git sha 3ddc7472d0a86479639d1ec7650c4a0d11470ff1
Running experiment on sagemaker with git sha 3ddc7472d0a86479639d1ec7650c4a0d11470ff1
Running experiment on sagemaker with git sha 3ddc7472d0a86479639d1ec7650c4a0d11470ff1
Running experiment on sagemaker with git sha 3ddc7472d0a86479639d1ec7650c4a0d11470ff1
Training job support-bg-color-3ddc747-231025-184731-stump completed.
Model url: s3://taichi-3d-gaussian-splatting-log/stump/support-bg-color-3ddc747-231025-184731-stump/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/stump/support-bg-color-3ddc747-231025-184731-stump/output/output.tar.gz
Training job support-bg-color-3ddc747-231025-184731-stump final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.02718164585530758 | 0.06568731367588043 | 27.399700164794922 | 0.7802900075912476 | 0.21970999240875244 | 0.08477786183357239 | 25.340702056884766 | 0.7252534031867981 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 22.840965270996094 | 0.542497992515564 | 22.793359756469727 | 0.604921281337738 | 27.399700164794922 | 0.7802900075912476 | 23.599395751953125 | 0.6121237277984619 | 24.146839141845703 | 0.6494683027267456 | 25.340702056884766 | 0.7252534031867981 |
Training job support-bg-color-3ddc747-231025-184819-tat-truck-baseline completed.
Model url: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/support-bg-color-3ddc747-231025-184819-tat-truck-baseline/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-truck-baseline/support-bg-color-3ddc747-231025-184819-tat-truck-baseline/output/output.tar.gz
Training job support-bg-color-3ddc747-231025-184819-tat-truck-baseline final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.02906094305217266 | 0.048246562480926514 | 26.5162296295166 | 0.8750109672546387 | 0.12498903274536133 | 0.05499852076172829 | 25.008712768554688 | 0.8628195524215698 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 23.006772994995117 | 0.8178406953811646 | 24.454757690429688 | 0.8571473360061646 | 26.5162296295166 | 0.8750109672546387 | 23.024946212768555 | 0.8145551681518555 | 23.754863739013672 | 0.8370049595832825 | 25.008712768554688 | 0.8628195524215698 |
Training job support-bg-color-3ddc747-231025-184805-bicycle completed.
Model url: s3://taichi-3d-gaussian-splatting-log/bicycle/support-bg-color-3ddc747-231025-184805-bicycle/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/bicycle/support-bg-color-3ddc747-231025-184805-bicycle/output/output.tar.gz
Training job support-bg-color-3ddc747-231025-184805-bicycle final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.043804850429296494 | 0.09135077893733978 | 21.698631286621094 | 0.7184655070304871 | 0.28153449296951294 | 0.09074745327234268 | 24.536022186279297 | 0.7150701880455017 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 24.073598861694336 | 0.6494255065917969 | 23.9046688079834 | 0.6313458681106567 | 21.698631286621094 | 0.7184655070304871 | 22.656890869140625 | 0.5860998630523682 | 23.194732666015625 | 0.6250209212303162 | 24.536022186279297 | 0.7150701880455017 |
Training job support-bg-color-3ddc747-231025-184754-tat-train-baseline completed.
Model url: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/support-bg-color-3ddc747-231025-184754-tat-train-baseline/output/model.tar.gz,
tensorboard output path: s3://taichi-3d-gaussian-splatting-log/tat-train-baseline/support-bg-color-3ddc747-231025-184754-tat-train-baseline/output/output.tar.gz
Training job support-bg-color-3ddc747-231025-184754-tat-train-baseline final metrics:
Latest Metrics
| train:iteration | train:l1loss | train:loss | train:psnr | train:ssim | train:ssimloss | val:loss | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|
| 30000.0 | 0.057057030498981476 | 0.07781828194856644 | 21.757766723632812 | 0.8391367197036743 | 0.16086328029632568 | 0.10022936016321182 | 20.933279037475586 | 0.8011162877082825 |
Max Metrics
| train:5kpsnr | train:5kssim | train:7kpsnr | train:7kssim | train:psnr | train:ssim | val:5kpsnr | val:5kssim | val:7kpsnr | val:7kssim | val:psnr | val:ssim |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 22.54574203491211 | 0.8242156505584717 | 24.459022521972656 | 0.8401768207550049 | 21.757766723632812 | 0.8391367197036743 | 19.247770309448242 | 0.7367949485778809 | 19.85987091064453 | 0.7608734965324402 | 20.933279037475586 | 0.8011162877082825 |