Forkoz

I have PCIE2.0 Phenom II system and rocm will not work with RX580. Same issue, my board doesn't support atomics. Rocm never detects the GPU, only the CPU. also.. for...

Chrome versions 89 worked. Now on newer versions it does not. Some flags probably changed.

Will see what the 7b does today. https://t.co/QwqDmpdftO

I am SOL because of bitsandbytes not so great pascal support. So flexgen is my only hope for 30b and 13b so far. IME, trying to chat with these models...

Convert to HF format.

I think if it was that easy we would have support for a lot of models right now.

Same here on 3090 on linux. Loads like 300mb to GPU, occasional blip of 5%, multi core CPU usage. VR models use GPU memory and time. Demucs I have to...

>11.6. Oh dear.. that's not a fix. Maybe if this is the only software you run. Whatever it uses needs to be recompiled.

How about 8-bit support. To run a 30b at higher perplexity in multi-gpu, except fast.

When i did perplexity tests for 8bit vs 4bit on 13b models, the perplexity difference was somewhat sizable. Granted I used bnb instead of GPTQ at the time. Almost a...