Use pytorch's automatic mixed precision

[remtav]

https://pytorch.org/docs/stable/amp.html

Tests with current inference script show that by simply wrapping the outputs = model(inputs) call in a context manager with autocast(device_type=device.type) speeds up inference by about 15% (tested on small image only). See pytorch's autocast.