Dimitar Dimitrov

Here is a fix, tested on Jetson Orin AGX: https://github.com/D-G-Dimitrov/exo/commit/edf3bd54e7988ada0148ca429812c7f8ff76fe1f ```python ... gpu_name = gpu_raw_name.rsplit(" ", 1)[0] if gpu_raw_name.endswith("GB") else gpu_raw_name if gpu_raw_name == 'ORIN (NVGPU)': # In case of...

> > > I am not seeing TFLOPS rating for the NVIDIA ORIN box. Is this an indication that some component is missing? I have Ollama with GPU support installed...

https://github.com/dusty-nv/jetson-containers/blob/284a49618987ae7505fb1a8e2df3683216be6e78/packages/llm/transformers/Dockerfile#L2-L8 Each package have such "meta" config in their Dockerfile. So, `transofrmers` depends on `pytorch`, that's why `PyTorch` gets build twice (different versions) If you want to use `transofrmers` with...