Predictions

[Nuri-benbarka]

Are there any plans to display predictions along with ground truths?

[erksch]

Actually I have a secret version on my computer that supports 3D object detection and semantic segmentation predictions but I haven't found the time to polish everything. I can make a branch so you can try it out.

[Nuri-benbarka]

That will be great if you can share it and if I found anything that needs polishing I will definitely help.

[jiangzhengkai]

@erksch Would you like to share your prediction visualization tools?

[erksch]

Yes I'll do it asap

[erksch]

@Nuri-benbarka @jiangzhengkai

I pushed my code to the branch react and opened this pull request. I basically recoded everything with React because it is much nicer than painful DOM manipulation. With the react rebuild also comes support for 3D object detection and semantic segmentation.

There is no updated README yet, but to start the server you just run yarn start. Don't forget to run yarn install after checking out the branch.

Regarding the prediction feature: As you will see, you can specify a server where the current segment and frame is sent to where you can perform predictions. The server should have a POST /predict route that handles that. The server should then return bounding boxes and the viewer automatically displays them. I'll make a template ready for a server that does this.

[erksch]

Here is a template for a server that would perform 3D Object Detection: https://gist.github.com/erksch/a21a1197dfe7d9ee74c8e530e48f2b95

[erksch]

I really hope that works for you and is not too complicated to get into. As I said this branch is not finished yet and I am very happy about any feedback.

[jiangzhengkai]

@erksch Thanks

[Nuri-benbarka]

Thanks for sharing your code, @erksch, I was trying to run the new branch; I ran yarn install successfully, then I ran yarn build and got the following warnings:

and then I got the following error in the browser:

Are you familiar with this error?

[Nuri-benbarka]

Thanks for sharing your code, @erksch, I was trying to run the new branch; I ran yarn install successfully, then I ran yarn build and got the following warnings:

and then I got the following error in the browser:

Are you familiar with this error?

I got this error because of the command yarn upgrade which you get as a suggestion when you run yarn start. If you don't make the update, it works fine.

[erksch]

@Nuri-benbarka The warnings are just linting, nothing important. Glad you resolved your error. Although you build the app you can also just use yarn start to get a working version. But maybe the build is more stable for the rendering.

You mentioned that only one frame or segment is loaded, I'll look into this.