replit-3B-inference icon indicating copy to clipboard operation
replit-3B-inference copied to clipboard
verified publisher icon abacaj

Runtime error in inference

Open nandanpr opened this issue 2 years ago • 1 comments

on windows 10 (AMD Ryzen 5 5600) , gets the Runtime error :Failed to create LLM 'replit' from ......\models\replit-v2-codeinstruct-3b.q4_1.bin during inference (python inference.py) . it says Model type 'replit' is not supported. any idea/pointers on fixing this

nandanpr avatar Jul 01 '23 23:07 nandanpr

Hi please see a similar issue, likely around ctransformers version

https://github.com/abacaj/replit-3B-inference/issues/5

abacaj avatar Jul 02 '23 01:07 abacaj