TitleOS
Results
1
issues of
TitleOS
RuntimeError: shape '[1, 5, 8, 128]' is invalid for input of size 10240 LLama 405B 4-bit on Layer 1
3
System Specs: Ryzen 5600G Nvidia Tesla M40 24GB 128GB DDR4 RAM Error: ``` running layers(cuda:0): 1%|▍ | 1/129 [00:06pip list Package Version ------------------ ------------ accelerate 0.33.0 aiohappyeyeballs 2.4.0 aiohttp 3.10.5...