Alex Cheema
Alex Cheema
> I'd like to look into this. Adjacently, [llamafiles](https://github.com/Mozilla-Ocho/llamafile) might be worth looking into as they are binaries able to run on multiple desktop OSes without any configuration. Though I'm...
@bayedieng I'd recommend looking at https://github.com/abetlen/llama-cpp-python -- it should hopefully be low level enough to do what we need to do. Also, I'd recommend looking at https://github.com/exo-explore/exo/pull/139 for a minimal...
What device are you running on? I see you're using conda, which might be causing issues since I believe tinygrad doesn't support conda
> Hi @AlexCheema , Can I take this up? Yes please! Added you to the sheet @pranav4501
Btw you mentioned you only have one device to test. You can still run multiple nodes on a single device. The easiest way is to do something like `python3 main.py...
> Hi @AlexCheema, > > * [ ] Stable diffusion (text to image) => [Stable Diffusion v2-1](https://huggingface.co/stabilityai/stable-diffusion-2-1-base) > * [ ] MLX distributed inference > * [ ] Tinygrad distributed...
Bumping. Any progress @pranav4501
What do you mean? An API for text embedding?
Should be fixed with https://github.com/exo-explore/exo/pull/640 Let me know if it's still an issue.