true_poetry icon indicating copy to clipboard operation
true_poetry copied to clipboard

Published 20 hours ago • verified publisher icon summerstay

using gpu device

Open Hagasus opened this issue 2 years ago • 0 comments

is it possible to use a gpu device for next token prediction. should be far faster. tried to implement it myself, but got stuck.

Hagasus avatar Apr 06 '22 18:04 Hagasus