EdgeNeXt icon indicating copy to clipboard operation
EdgeNeXt copied to clipboard

other task---edgenext

Open SDarknessZX opened this issue 3 years ago • 2 comments

I used Edgenext for crowd counting, but the effect was not as good as VGG. I tried to change the different learning rate, but it still didn't help. Do you have any suggestions?

SDarknessZX avatar Jul 26 '22 11:07 SDarknessZX

Hi @SDarknessZX,

Thank you for using EdgeNeXt. We empirically found that EdgeNeXt is sensitive to hyperparameter choice for downstream vision tasks (Object detection and segmentation). We were, however, able to get good results when trained using a slightly less learning rate than usual.

Further, would you please tell me if crowd counting task is sensitive to location information? If that so, one thing to try could be to use learnable positional encodings in all SDTA blocks. Note that currently it is only enabled in the first SDTA block in the network. We observed that it was helpful but also increased the inference time a little. Please do share if you will have any questions or get any improvements in the crowd counting task.

Good Luck!

mmaaz60 avatar Jul 27 '22 01:07 mmaaz60

Hi @SDarknessZX,

Thank you for using EdgeNeXt. We empirically found that EdgeNeXt is sensitive to hyperparameter choice for downstream vision tasks (Object detection and segmentation). We were, however, able to get good results when trained using a slightly less learning rate than usual.

Further, would you please tell me if crowd counting task is sensitive to location information? If that so, one thing to try could be to use learnable positional encodings in all SDTA blocks. Note that currently it is only enabled in the first SDTA block in the network. We observed that it was helpful but also increased the inference time a little. Please do share if you will have any questions or get any improvements in the crowd counting task.

Good Luck!

The crowd count is sensitive to the scale change, and the location also has a certain impact. I will try it according to your suggestion. Thank you!

SDarknessZX avatar Jul 27 '22 03:07 SDarknessZX