jan
jan copied to clipboard
bug: Error occurred: Failed to fetch - Model: Wizard Coder Python 13B Q5
Describe the bug
Steps to reproduce Steps to reproduce the behavior:
- Download the model Wizard Coder Python 13B Q5 in the Model Hub
- Start the model and start the conversation
Expected behavior A clear and concise description of what you expected to happen. The thread should work normally with model Wizard Coder Python 13B Q5
Screenshots If applicable, add screenshots to help explain your issue.
Environment details
- Operating System: Windows
- Jan Version: 0.4.3
- Processor: AMD Ryzen 5 4600H
- RAM: 16GB
- Any additional relevant hardware specifics: GTX 1650 4gb
Additional context
Phind 34B Q5 is working on a M1 Max with 64GB but not on a M1 Max 32GB (same error as above), so I guess you need more ram for larger model.
User can run normally via using the nightly build.
Same issue with Wizard Coder Python 13B Q5.
Error occurred: Failed to fetch
16 GB on Mac Mini M1. MacOS Sonoma 14.2 (23C64).
Also tried nightly build jan-mac-arm64-0.4.3-126 with no luck.