AutoGPT icon indicating copy to clipboard operation
AutoGPT copied to clipboard

Run llama mistral-7b-instruct-v0.2.Q5_K_M.llamafile with serve.py

Open nkv123 opened this issue 7 months ago • 2 comments

I am on os debian 12. I run commad "/home/nick/AutoGPTDiet/autogpt/$ ./scripts/llamafile/serve.py and get error below

type(llamafile) = <class 'NoneType'>
Traceback (most recent call last):
  File "/home/nick/AutoGPTDiet/autogpt/./scripts/llamafile/serve.py", line 165, in <module>
    main()
  File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nick/AutoGPTDiet/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/nick/AutoGPTDiet/autogpt/./scripts/llamafile/serve.py", line 126, in main
    subprocess.run(
  File "/usr/lib/python3.11/subprocess.py", line 548, in run
    with Popen(*popenargs, **kwargs) as process:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1024, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.11/subprocess.py", line 1901, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
OSError: [Errno 8] Exec format error: './mistral-7b-instruct-v0.2.Q5_K_M.llamafile'

File itself runs with ./scripts/llamafile/mistral-7b-instruct-v0.2.Q5_K_M.llamafile

nkv123 avatar Jul 29 '24 19:07 nkv123