jan icon indicating copy to clipboard operation
jan copied to clipboard

bug: Error occurred: Failed to fetch - Model: Wizard Coder Python 13B Q5

Open 0xHieu01 opened this issue 1 year ago • 1 comments

Describe the bug

Steps to reproduce Steps to reproduce the behavior:

  1. Download the model Wizard Coder Python 13B Q5 in the Model Hub
  2. Start the model and start the conversation

Expected behavior A clear and concise description of what you expected to happen. The thread should work normally with model Wizard Coder Python 13B Q5

Screenshots If applicable, add screenshots to help explain your issue.

image

image

Environment details

  • Operating System: Windows
  • Jan Version: 0.4.3
  • Processor: AMD Ryzen 5 4600H
  • RAM: 16GB
  • Any additional relevant hardware specifics: GTX 1650 4gb

Additional context

0xHieu01 avatar Jan 02 '24 09:01 0xHieu01

Phind 34B Q5 is working on a M1 Max with 64GB but not on a M1 Max 32GB (same error as above), so I guess you need more ram for larger model.

hmorneau avatar Jan 02 '24 13:01 hmorneau

User can run normally via using the nightly build.

0xHieu01 avatar Jan 03 '24 01:01 0xHieu01

Same issue with Wizard Coder Python 13B Q5.

Error occurred: Failed to fetch

16 GB on Mac Mini M1. MacOS Sonoma 14.2 (23C64).

Also tried nightly build jan-mac-arm64-0.4.3-126 with no luck.

pbeens avatar Jan 07 '24 02:01 pbeens