ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Run T5 ggml

Open phanxuanphucnd opened this issue 1 year ago • 2 comments

Dear author,

How can i run t5 like gpt-2 or gpt-j?

Thank

phanxuanphucnd avatar Apr 13 '23 09:04 phanxuanphucnd

walking-octopus avatar Apr 27 '23 22:04 walking-octopus

Since ggerganov said this is no longer a priority, I recommend CTranslate2 to do fast Python-free CPU inference of T5 family models.

redthing1 avatar May 21 '23 23:05 redthing1