Alex Cheema
Alex Cheema
> I'll like to work on this That would be excellent! I can help here and on Discord with any questions / issues you have.
@the-alex-b Very interesting - you're totally right, we should fix session isolation first. This makes sense since both would share the same kv caches (it's stateful). What we really need...
> Hi @AlexCheema, Can I work on session isolation? Hey @pranav4501 I think @varshith15 is already working on that so best to check with him if you can contribute. Can...
> Hey! First off, I love this project, props for the great work! And I love your mission! > > I think I did implement this for my MS thesis...
Great. Can we do python 3.12.8? https://docs.python.org/release/3.12.8/
I've never tried this but I don't see why it wouldn't work. Can you send the logs with `DEBUG=6`? What do you mean by "device_capabilities can't be discovered"?
1. Not showing FLOPs is a visual bug. I made an issue to fix this here: https://github.com/exo-explore/exo/issues/149 2. Try running with `SUPPORT_BF16=0` e.g. `SUPPORT_BF16=0 python3 main.py` 3. Possible same as...
1. Yep we should do this dynamically. Made an issue: #177 2. This `SUPPORT_BF16` shenanigans needs to be fixed properly. It should be as simple as running one command to...
Did you test this on Apple Silicon?
Awesome work! Thanks so much for the PR. Could you also update the tests in `exo/topology/test_device_capabilities.py` @stephanj