Alex Cheema
Alex Cheema
> > You can also add the info about running the nix package in the README! > > I will wait for it to be successfully packaged before advertising it...
Thanks for the detailed bug report! We should definitely fix this for the tinygrad inference engine, and it might require some changes upstream to the tinygrad lib. For now, I...
Thanks for the issue. The fact that only one GPU shows on the linux box is expected. We need to do some work to make this seamless. I've made an...
BOOM! You read my mind. This is certainly worthy of a $200 bounty. Please email [email protected] with your ethereum address.
Thanks for being patient with us. exo is still highly experimental and there are indeed a lot of bugs that need to be fixed. I think the general point here...
> +1 > > I really appreciate what you folks are doing, but it's been almost impossible to run Exo on a Cluster of 3 Linux systems (NVIDIA/CUDA) + a...
Please resolve merge conflicts. `index.html` no longer needs to hardcode the model choices.
Please fix conflicts. Also the convention right now is that if it doesn't have a suffix it's 4bit so please stick to that.
> Hi, > > It seems that if I send multiple requests at the same time, the service starts to slow down or occasionally fails to process them correctly or...
Definitely check the changes in the PR that was just merged https://github.com/exo-explore/exo/pull/124 Will make this much easier hopefully!