igvc-software icon indicating copy to clipboard operation
igvc-software copied to clipboard

Multiclass Segmentation Performance Metrics

Open VAM7686 opened this issue 4 years ago • 0 comments
trafficstars

This is what the multiclass segmentation output currently looks like:

The output looks a bit choppy and I'm not sure if this is due to the GPU the model ran on, the node that runs model, or even the frame rate of the ros bag file that was used.

It would be nice to collect metrics on the new multiclass segmentation model and how it compares to our old binary segmentation model.

Thoughts:

  • Check frame rate of the segmentation topic
  • Check model inference rate.
  • If the model inference rate of binary and multiclass are not similar, perhaps check the image frame rate or other part of code that slows the code

AC: Performance metrics of multiclass segmentation versus binary segmentation which can be included in the documentation. Possible improvements to inference rate of multiclass segmentation.

VAM7686 avatar Nov 21 '21 19:11 VAM7686