EfficientNet-PyTorch icon indicating copy to clipboard operation
EfficientNet-PyTorch copied to clipboard

half / mixed precision?

Open jacekpoplawski opened this issue 4 years ago • 1 comments

Is it possible to use EfficientNet-PyTorch with half / mixed precision somehow? I know the mixed precision is supported by PyTorch for about a year, but what about pretrained weights?

jacekpoplawski avatar May 30 '21 12:05 jacekpoplawski

In Pytorch, you can convert the pretrained weights into torch.half16 with the following way: model.half()

but this is not the recommended way. Instead you have to use torch.cuda.amp.autocast while training.

For more details

ekurtulus avatar Jun 21 '21 12:06 ekurtulus