nerfstudio
nerfstudio copied to clipboard
nerfstudio-project
Scene is not rendering
Hi this is a really cool work.
I was testing this repo and was using the default scene in the quickstart page. Everything loaded correctly and I can see it training, however, when i open the viewer, I can only see the camera poses with the images. I am running this code on a AWS instance (ubuntu 20.04) terminal, with port 7007 opened. I can see all the stats updating, but the scene is not rendering. Thanks!
@eldercrow can you describe your machine setup as well? It’s something with webrtc not connecting.
Does refreshing after the images first show up, then waiting ~10 seconds, work for any of you? Curious if it’s due to the initialization sequence or because webrtc is failing with your machine setup.
Everyone who is running into this issue, can you report the following details (we are having trouble replicating this bug on the dev machines).
- OS version
- nerfstudio version
- Browser type
- Local or remote compute
- What is your internet setup, (ie are you on a corp network, or personal plan)
Other tips:
- Make sure to open link reported in browser, don't use an old one
- Only have one viewer window open
- Try refreshing
- Ubuntu 20.04.4 LTS (GNU/Linux 5.15.0-46-generic x86_64)
- 0.1.5
- Chrome
- Remote
- Remote on corporate site
Tried tips withouth success
@Blueslikehail Can you try the latest version of the code to see if that fixes the issue. If it doesn't a few followup questions,
- Are you are able to see the dataset images, but not the NeRF rendering?
- Is this a new issue, or have previous versions of nerfstudio also not work?
I'm concerned that it may be caused by webrtc being blocked by some corporate network restrictions.
Hi Matthew,Just tried the last version and I have the same problem. Tomorrow I’ll try from within the corporate network to see if it works. Which previous version do you suggest trying should the problem persist?Thanks,WalterOn Oct 17, 2022, at 19:05, Matthew Tancik @.***> wrote: @Blueslikehail Can you try the latest version of the code to see if that fixes the issue. If it doesn't a few followup questions,
Are you are able to see the dataset images, but not the NeRF rendering? Is this a new issue, or have previous versions of nerfstudio also not work?
I'm concerned that it may be caused by webrtc being blocked by some corporate network restrictions.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>
Ubuntu 20.04 (x86_64) 0.1.5.1 Edge Remote Remote on corporate site
I've tried the localhost too. It gave me this address: (https://viewer.nerf.studio/versions/22-10-13-0/?websocket_url=ws://localhost:7007) which did not work too.
Just checking, everyone in this thread is able to see the dataset images, just not the render (same as in the image in the original post)?
Ubuntu 18.04.4 LTS (GNU/Linux 5.4.0-126-generic) 0.1.5 Chrome Remote Remote on corporate site
Yes, I can see the the dataset images, but no render scene.
Ubuntu 18.04.4 LTS Latest version (as of today) NVIDIA V100 Edge Remote Remote on corporate site
Yes, I can see the the dataset images, but no render scene.
Hi All,I am running the same setup on corporate site and I can see the render now.WalterOn Oct 18, 2022, at 08:15, Hyunjoon Lee @.***> wrote: Ubuntu 18.04.4 LTS Latest version (as of today) NVIDIA V100 Edge Remote Remote on corporate site Yes, I can see the the dataset images, but no render scene.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>
@Blueslikehail Could you please let me know your setting? Has anything changed?
Hi,No changes, it seems I just have to be within the corporate network. WalterOn Oct 18, 2022, at 09:41, Hyunjoon Lee @.***> wrote: @Blueslikehail Could you please let me know your setting? Has anything changed?
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: @.***>
Same problem. Sometimes it works sometimes it doesn't.
- OS version: Windows 11 22H1
- nerfstudio version: 0.1.5.1
- Browser type: Firefox 105.0.3 (64-Bit)
- Local
- Internet: shouldn't matter, it's local
I noticed, though, that the change for the viewer to work is higher if I open the webpage before training starts.
same problem with my custom datasets especially:
- ubuntu 20.04
- nerfstudio version: 0.1.5.1
- browser: firefox 94.0
- local
Sorry this is proving to be such an issue. It seems that webrtc initial connection is sometimes flaky. We we continue to try to debug this, unfortunately it isn't something we are experiencing on our machines.
(side note, we have been using chrome, it might be worth seeing if it works better on chrome)
I like to offer help, yet I am not able to reproduce it when I want it.
Btw, I updated my Firefox and not experiencing the issue anymore. In case it helps anyone out there. Also haven't experienced this issue on Chrome(windows 10) as well.
Hi @tancik, Thanks for your work!
Have the same issue when running ns-train on the docker image nvidia/cuda:11.8.0-cudnn8-devel-ubuntu22.04 and ssh port forwarding. (In the container I've installed a conda environment according to the tutorial using torch with cuda 11.3 and nerfstudio 0.1.6)
Refreshing after a few training steps and then waiting or moving the camera does not help.
The RTC connection seems to be fine and Server + Render are shown as connected.
I've tested on Google Chrome and Firefox and in none of my tests the render is shown only the images appear.
In the terminal everything seems to be normal and the Vis Rays / Sec column (which I assume is responsible for the viewer) also shows entries.
Ubuntu 18.04.4 LTS (GNU/Linux 5.4.0-126-generic) 0.1.5 Chrome Remote Remote on corporate site
Yes, I can see the the dataset images, but no render scene.
Update: I move the camera and wait for a few seconds, the render scene appears.
I have the same issue when using port forwarding on the remote machine. When connecting locally, the scene is rendered correctly. Moving the camera and waiting do not helps.
I had to reboot the remote Ubuntu machine I was working on.
OS version: OSX 12.5.1 nerfstudio version: Browser type: Chrome Local or remote compute: remote Internet setup: Personal plan
Configurations that don't work for me:
OS version: OSX 12.6 (local OS, remote Ubuntu 20.04) nerfstudio version: latest (as of today, also didn't work with 0.1.5) Browser type: Chrome (and Firefox) Local or remote compute: remote Internet setup: Corporate internet
OS version: Ubuntu 20.04 (local OS, remote Ubuntu 20.04) nerfstudio version: latest (as of today, also didn't work with 0.1.5) Browser type: Firefox Local or remote compute: remote Internet setup: Corporate internet
Does work: Remotely connected to the same machine with NoMachine using Firefox
Same issue here, but, weirdly, another dataset I trained loaded the view correcly.
Win 10 nerfstudio v0.1.8 Chrome 107.0.5304.88 (64 bits) Run Local, Viewing from localhost, so, no ISP issue.
Same issue I was working on Windows locally and it was fine.
But on the remote server and forward to windows, there is no render.
I just got this issue again as well.
Is it a cooncidence we have it at the same time? 👀
Same issue 😭 It used to work (few weeks? ago), but now it doesn't.
Win 11 + WSL (Ubuntu 20.04.5) nerfstudio v0.1.8 Chrome, Firefox, Edge Run Local, Viewing from localhost
I just got this issue again as well.
Is it a cooncidence we have it at the same time? 👀
Now it makes sense. I checked locally still no render. I guess its something wrong with the render itself. Not our browser or setting issue. It used to be render connected, but now the render is disconnected all the time.