alpaca.cpp

alpaca.cpp copied to clipboard

Is it possible to convert this instruct-gpt-j model for use with Alpaca? https://huggingface.co/nlpcloud/instruct-gpt-j-fp16/tree/main

I tried using model as is on ./chat but I just get a 'bad magic' error

I also tried using the convert-pth-to-ggml.py script but I just get a bunch of No such file in directory errors.

<user>@VEDA:~/Desktop/Alpaca/alpaca.cpp-99f3908$ python3 convert-pth-to-ggml.py ../instruct-gpt-j-fp16 1
Traceback (most recent call last):
   File "/home/<user>/Desktop/Alpaca/alpaca.cpp-99f3908/convert-pth-to-ggml.py", line 67, in <module>
    with open(fname_hparams, "r") as f:
FileNotFoundError: [Errno 2] No such file or directory: '../instruct-gpt-j-fp16/params.json'