Half-Precision Training

Open jlevy44 opened this issue 5 years ago • 2 comments

Can we use float16 using this framework? Has there been consideration for allowing integration with nvidia apex: https://github.com/NVIDIA/apex

Thanks!

May 11 '20 17:05 jlevy44

Hi, since the type of each image could be defined in the beginning. It should be possible. The integration of apex is definitely a very interesting idea which we will consider in the future.

Jun 10 '20 19:06 RobinSandkuehler

https://pytorch.org/docs/stable/amp.html

Sep 23 '20 19:09 jlevy44