Ycros
Ycros
I might have fixed this in #47
This breaks for me in exactly the same way on a fresh Ubuntu 20.04 instance, no Docker involved.
Hi, apologies, I was an idiot and was missing xorg dependencies - I installed xorg and it seems to be working now. It doesn't help that pyppeteer currently swallows chrome...
So how do you support more models? I tried a simple test where I took the experiments notebook and I replaced `mistralai/Mistral-7B-Instruct-v0.1` with `mistralai/Mistral-7B-Instruct-v0.2` - and running with 0.2 gives...
gpu0 doesn't work for me, where gpu1 to gpu3 work fine - it'll show all 4 gpus just fine in the gpu-totals graphs too edit: this might actually be a...
I spent a while staring at the code, and I've figured it out - I think it's allocating too small a vram scratch buffer for 65B, increasing the vram_scratch size...
I have proof-of-concept working currently on Windows at https://github.com/ycros/vparty using a fork of glutin https://github.com/ycros/glutin/commit/dd0de4444dbcc6c4be86ebf6d3d61a9ffc804ddb - eventually I'd like to get conrod up and running, but this requires either implementing...
No idea, but it still seemed somewhat functional. I sort of just killed the entire runpod after that.
I dunno, I tried again - this time instead of an fp16 with an AWQ 32g quant of mixtral (like 26gb on disk) on 2 A6000s (48GB vram each). I...
Ah, crypto.randomUUID only exists in a HTTPS (secure) context.