efficientnet icon indicating copy to clipboard operation
efficientnet copied to clipboard

how is the training speed?

Open MichaelHL-ai opened this issue 6 years ago • 7 comments

recently, I have written efficientnet using tensorpack framework, and I have found this net training speed is very slow (efficientnet-b0 is slower than resnet50). Do you have the same situations?

MichaelHL-ai avatar Dec 11 '19 02:12 MichaelHL-ai

same thing is happening to me. Which version of tensorflow and efficientnet are you using?

I'm using tensorflow 1.15.0 and efficientnet 1.0.0

mrkaworu avatar Dec 16 '19 05:12 mrkaworu

same thing is happening to me. Which version of tensorflow and efficientnet are you using?

I'm using tensorflow 1.15.0 and efficientnet 1.0.0

I am using tensorflow 1.13, and efficientnet-b0 written by myself. see https://github.com/tensorflow/tensorflow/issues/12132 https://github.com/tensorflow/tensorflow/issues/12940

MichaelHL-ai avatar Dec 16 '19 06:12 MichaelHL-ai

I see. I'll follow the links you provided too. Thank you!

mrkaworu avatar Dec 16 '19 06:12 mrkaworu

Same issues here.

kevinwu23 avatar Jan 03 '20 17:01 kevinwu23

When you say slow training speed do you mean examples per second or epochs to convergence?

I'm seeing slightly more examples per second than resnet50, but many more epochs to converge.

LucasSloan avatar Feb 20 '20 17:02 LucasSloan

Which dataset are you training on? I'm getting OOM errors when training on ImageNet with all trainable params.

AshishSardana avatar Apr 14 '20 17:04 AshishSardana

When you say slow training speed do you mean examples per second or epochs to convergence?

I'm seeing slightly more examples per second than resnet50, but many more epochs to converge.

examples per second, I mean

MichaelHL-ai avatar Apr 15 '20 02:04 MichaelHL-ai