grok-1
grok-1 copied to clipboard
Are there plans to develop on the pytorch framework?
Are there plans to develop on the pytorch framework? Many LLM develop based on torch, like LLama, Qwen, etc. Some developers may not be familiar with JAX.
is there any problem to move weights to torch?
I created a demo pytorch implementation https://github.com/DominiqueGarmier/grok-pytorch you can't really run it at the moment. Maybe it's a good starting point if someone wants to create a full pytorch version.