jan icon indicating copy to clipboard operation
jan copied to clipboard

Published 20 hours ago • verified publisher icon janhq

bug: Can't run on Apple M1 Pro

Open iwootten opened this issue 1 year ago • 0 comments

Describe the bug

Unable to run a model on my M1 Pro 16GB. Tried both Mistral and TinyLlama on both 0.4.3 and the nightly version.

Steps to reproduce Steps to reproduce the behavior:

  1. Download a model
  2. Create a thread using said model
  3. Enter a prompt
  4. See error

Expected behavior The model gives some sort of response.

Screenshots Screenshot 2024-01-10 at 16 42 08

Environment details

  • Operating System: Mac OS 13.4.1
  • Jan Version: 0.4.3/0.4.3-137
  • Processor: Apple M1 Pro
  • RAM: 16GB

iwootten avatar Jan 10 '24 16:01 iwootten