FFAMax

ptxas/nvdisasm: Unsupported .version 8.5; current version is '7.5'

1

Hello, Team! I have RTX 4090 and GTX 1080 Ti, run on both ``` CUDA_VISIBLE_DEVICES=0,1 python3 examples/llama3.py --download_model --shard 2 --size 8B # data loaded on both GPU Hit Ctrl-C...

AMD gfx1010: "Unsupported arch: {self.arch}

3

``` (.venv) user@b250:~/tinygrad$ AMD=1 VISIBLE_DEVICES=0 python3 examples/llama3.py --download_model seed = 1730624168 0%| | 0/292 [00:00

CUDA_VISIBLE_DEVICES: should it me added to env_vars doc?

1

Should we add it to https://github.com/tinygrad/tinygrad/blob/master/docs/env_vars.md ?

Hello, Team. Tried with CLANG - it worked, but with GPU just no progress: ``` python3 examples/llama3.py --host 0.0.0.0 --port 8080 --model /home/user/.cache/tinygrad/downloads/llama3-1b-instruct/Llama-3.2-1B-Instruct-Q6_K.gguf seed = 1730621540 ``` I see on...

For now CPU, AMD, Nvidia can be used as OpenCL, but limited due no option to pick the right ones. For example combination of AMD+Nvidia can work via OpenCL Example...