ctrl icon indicating copy to clipboard operation
ctrl copied to clipboard

Published 20 hours ago • verified publisher icon salesforce

Running the model on TPUs?

Open vessenes opened this issue 4 years ago • 2 comments

Hi,

I have the 256 and 512 models working on GCP with a Tesla V100. Text generates, but slowly, and I'm wanting to get faster generation out of the system. I thought running CTRL on TPUs could get me faster text, but I have no idea how to do that.

Do you have an incantation or pointer that would let me point CTRL at a TPU?

vessenes avatar Oct 25 '19 23:10 vessenes