Alex Cheema
Alex Cheema
I don't think this works. Please re-open if that's not that case.
I see the issue - we're polling every second so if `fetchDownloadProgress` takes >1s we'll overwhelm the server. Can we just change `startDownloadProgressPolling` to be the same as `startModelPolling`, using...
Looks good. Just 2 things: 1. why are there changes to llama in this PR? 2. add pixtral to tinychat UI. I haven't tested this myself yet, will do when...
> @AlexCheema please close this, ill build #247 on top of this Will do. And of course you will receive payment for both bounties.
Hey, thanks for the detailed issue. can you run with DEBUG=2 and send the logs here?
Can you make sure you have the latest NVIDIA drivers / CUDA toolkit installed too?
Good to know it at least works in WSL. OPENCL is always going to be quite slow. You’ll want to configure your NVIDIA drivers so that your GPU is detected...
I just bumped up the tinygrad version https://github.com/exo-explore/exo/commit/142682645f2c8b480e1105c1d8c2dc0a9b767815, since it was quite old. Can you try with the latest version?
Bump.
> Hi @AlexCheema, > > I’d like to help with this issue. I have a solution to enable dynamic configuration updates while the application (exo) is running, using a hot-reload...