transfer-learning-conv-ai icon indicating copy to clipboard operation
transfer-learning-conv-ai copied to clipboard

6 GB VRAM?

Open Dampfinchen opened this issue 5 years ago • 1 comments

Hello,

is it possible to run the 117M GPT-2 model with 6 GB VRAM using FP16?

Dampfinchen avatar Jan 11 '20 00:01 Dampfinchen

If you mean "train it" then nope.

ioannist avatar Oct 22 '20 20:10 ioannist