lollms-webui icon indicating copy to clipboard operation
lollms-webui copied to clipboard
verified publisher icon ParisNeo

ModuleNotFoundError: No module named 'exllamav2_ext'

Open nospam2k opened this issue 2 years ago • 2 comments

Expected Behavior

Cannot load any models I've tried.

Current Behavior

On the settings page, I cannot get any model to load using exlamav2

Steps to Reproduce

Please provide detailed steps to reproduce the issue. I also tried manually install exlamav2 again.

  1. Install using mac_install.sh
  2. load any model
  3. check console for error

Possible Solution

Context

MacOS (Intel) Sonoma

Screenshots

nospam2k avatar Nov 09 '23 19:11 nospam2k

Same issue here. Ubuntu Server 22.04 I can paste error if wanted, but its very long so I wont do it for now.

d13g4 avatar Nov 16 '23 02:11 d13g4

I have notified the creators of exllama and I'll fix that

ParisNeo avatar Nov 16 '23 10:11 ParisNeo