ggml
ggml copied to clipboard
Run T5 ggml
Dear author,
How can i run t5 like gpt-2 or gpt-j?
Thank
- GPT-2 and GPT-J usage is outlined in the README.
- T5 inference is being worked on in PR #12.
Since ggerganov said this is no longer a priority, I recommend CTranslate2 to do fast Python-free CPU inference of T5 family models.