photonvision icon indicating copy to clipboard operation
photonvision copied to clipboard

Add object detection training docs

Open Alex-idk opened this issue 1 year ago • 7 comments

Adds documentation for training a custom model.

Alex-idk avatar Sep 27 '24 11:09 Alex-idk

I'm going to try following these instructions and see if I can get it to work :+1:

Alextopher avatar Sep 27 '24 12:09 Alextopher

I will boot up a vm later and try this process from scratch and look for anything I missed.

Alex-idk avatar Sep 27 '24 13:09 Alex-idk

I was able to follow the instructions and got the model running on an Orange PI. I'll verify tonight if the model is working.

As for the state of this PR - I think this is a huge help for the PV developers. I'm no longer concerned about the bus factor regarding training object detection models. However, I don't think these instructions would be enough for the average team.

I wonder if we can just change the name of this content from "training a custom model" to "converting trained model to RKNN" for now. I think a proper "training custom model" section would require teaching how to set up an environment, installing all of the dependencies, how to label data, export to YOLO formats, training parameters, and only then conversion and uploading.

Alextopher avatar Sep 27 '24 16:09 Alextopher

Yeah broadly agree with @Alextopher -- it's a great set of docs for developers, and as long as we call that out i'd like to get this shipped before it bitrots :)

mcm001 avatar Oct 13 '24 14:10 mcm001

Sorry for the late response, I've been busy with school and theater. Here is a revised version of the docs that removes the model training part, I will work on a update for the conversion script to just take in a directory instead of a file with paths and clean it up a bit.

Is the scripts folder a good place for the conversion script to go in the PV repo?

Alex-idk avatar Oct 18 '24 15:10 Alex-idk

Sounds legit

mcm001 avatar Oct 18 '24 15:10 mcm001

Any chance we can get this shoved in for beta (maybe tentatively this weekend?)

mcm001 avatar Oct 25 '24 17:10 mcm001

Is this ready?

mcm001 avatar Nov 01 '24 05:11 mcm001

immediately starts pushing new stuff lol

mcm001 avatar Nov 02 '24 03:11 mcm001

Covered by #1723 and #1715. We can still leave it open to document this alternative process, but maybe make it a draft?

samfreund avatar Jan 13 '25 17:01 samfreund

Superceded by #2024

samfreund avatar Aug 05 '25 02:08 samfreund