AutoGPT
AutoGPT copied to clipboard
Run llama mistral-7b-instruct-v0.2.Q5_K_M.llamafile with serve.py
I am on os debian 12. I run commad "/home/nick/AutoGPTDiet/autogpt/$ ./scripts/llamafile/serve.py and get error below
type(llamafile) = <class 'NoneType'>
Traceback (most recent call last):
File "/home/nick/AutoGPTDiet/autogpt/./scripts/llamafile/serve.py", line 165, in <module>
main()
File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/nick/AutoGPTDiet/autogpt/./scripts/llamafile/serve.py", line 126, in main
subprocess.run(
File "/usr/lib/python3.11/subprocess.py", line 548, in run
with Popen(*popenargs, **kwargs) as process:
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/subprocess.py", line 1024, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/usr/lib/python3.11/subprocess.py", line 1901, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
OSError: [Errno 8] Exec format error: './mistral-7b-instruct-v0.2.Q5_K_M.llamafile'
File itself runs with ./scripts/llamafile/mistral-7b-instruct-v0.2.Q5_K_M.llamafile