lingvo icon indicating copy to clipboard operation
lingvo copied to clipboard
verified publisher icon tensorflow

Does GShard support GPUs？

Open aoyulong opened this issue 5 years ago • 1 comments

Hi, I can see that GShard can run large models on TPUs, does it also support GPUs now ?

aoyulong avatar Jan 13 '21 02:01 aoyulong

We haven't tested it on GPUs yet. It depends on the XLA support for GPUs.

bignamehyp avatar Jan 29 '21 20:01 bignamehyp