exo

exo copied to clipboard

we need the support for llama 3.2

1

Kbassem10

we need option to use intel graphics like (intel iris xe)

11

we need option to use intel graphics like (intel iris xe) on wsl

Kbassem10

[BOUNTY - $1000] Compile tinygrad to swift

26

- I want to keep exo 100% python if possible - Would like to compile swift or objc inference code in tinygrad - The deliverable here is a merged PR...

AlexCheema

Exo not detecting Nvidia GPUs

16

This is a follow up from https://github.com/exo-explore/exo/issues/46 which wasn't resolved. My linux machine has: - 1x RTX 3090 (24GB) - 2x RTX A4000 (2x16GB) - Ryzen 7600 w/ 192GB But...

sammcj

running from terminal doesn't show TFLOPS ?

3

 Can it not run from an ssh session ?

aviadoffer

Error: Failed to fetch completions: Error processing prompt (see logs with DEBUG>=2): No module named '_posixshmem'

2

### Issue Description I am currently running the **Exo** framework on my Windows device. Initially, I encountered compatibility errors because the `main.py` file was only supported on macOS. However, after...

Shivp1413

[BOUNTY - $200] Windows native support

16

- Windows is largely untested. Don't know of anyone who has it working natively, only in WSL - Known issues on windows: https://github.com/exo-explore/exo/issues/184 , tinygrad not officially supported - Perhaps...

AlexCheema

Error on Windows 11: "NotImplementedError" in asyncio

7

I'm trying to run the project on Windows 11, but I encounter the following error: ``` Cancelling 0 outstanding tasks Traceback (most recent call last): File "C:\Users\Filip\exo\main.py", line 192, in...

TheFilipcom4607

Showing 0 TFLOPS for Linux (Ubuntu 22.04, Quadro RTX 4000) + CUDA out of memory error on Llama 3.1 8B

4

Hi! I managed to make Llama 3.1 8B to work across the two nodes (Linux Box 64GB of RAM + Quadro RTX 4000 (8GB) + 64GB of RAM and a...

fullofcaffeine

[Bounty] PyTorch & HuggingFace Interface

123

Hello all, I’ve made some updates to the exo library based on the bounty mentioned in this [tweet/X post](https://x.com/ac_crypto/status/1816721481671348685). These changes aim to integrate PyTorch and expand access to various...

risingsunomi