exo icon indicating copy to clipboard operation
exo copied to clipboard

Exo not detecting my GPU

Open DKilkenny opened this issue 1 year ago • 4 comments

Hello,

I recently installed Exo from the source on my Ubuntu 20.04.6 LTS box with a GeForce RTX 3070. I installed it the same way I did with my MacBook M1 Pro but this time it showed my TFLOPS equal to 0.0 and it also wasn't detecting my Mac on the same local network. Screenshot from 2024-10-19 16-12-57 Screenshot from 2024-10-19 16-15-37

The above is from the Linux box with the other showing my GPU and below is the Mac.

Screenshot 2024-10-19 at 4 18 44 PM

Let me know if I can provide any other details. As far as the two computers not detecting each other, the only thing I did notice was the different URLs to access the Tinychat web UI.

DKilkenny avatar Oct 19 '24 20:10 DKilkenny

The FLOPS is currently implemented by the lookup table. You can add more as per your needs. https://github.com/exo-explore/exo/blob/1e4524b5c0fc1bf74aab20b9ef2ae1e1b1b7de1a/exo/topology/device_capabilities.py#L82-L84

Sean-fn avatar Oct 20 '24 04:10 Sean-fn

Hmm I thought my card was the NVIDIA GEFORCE RTX 3080 (10 GB) but I'll double check. Any ideas why it's not finding my MacBook on the same local network?

DKilkenny avatar Oct 20 '24 20:10 DKilkenny

FLOPS showing

Dose it shows NVIDIA GEFORCE RTX 3080 (10 GB) on your linux machine? It has to be exactly the same so the lookup table can work. If not, you might have to add this line with out (10GB) in device_capabilities.py : "NVIDIA GEFORCE RTX 3080": DeviceFlops(fp32=29.8*TFLOPS, fp16=59.6*TFLOPS, int8=119.2*TFLOPS), CleanShot 2024-10-21 at 16 04 22@2x

Device discovery

You can scroll up a bit to see all the IP, and make sure your devices are in the same subnet. Also, you can see detail logs by running DEBUG=9 exo

CleanShot 2024-10-21 at 16 09 07@2x

Sean-fn avatar Oct 21 '24 08:10 Sean-fn

I have the same problem, it shows "device: CLANG" for me.

rabejens avatar Nov 21 '24 17:11 rabejens