AndyD

Results 1 comments of AndyD

Hey, maybe this will help. With fp16 support I survived the OOM message, even with batch_size=32 (GTX1080 8GB). https://github.com/thorjohnsen/bert/tree/gpu_optimizations