grok-1 icon indicating copy to clipboard operation
grok-1 copied to clipboard

Are there plans to develop on the pytorch framework?

Open JasonCZH4 opened this issue 1 year ago • 2 comments

Are there plans to develop on the pytorch framework? Many LLM develop based on torch, like LLama, Qwen, etc. Some developers may not be familiar with JAX.

JasonCZH4 avatar Mar 18 '24 06:03 JasonCZH4

is there any problem to move weights to torch?

AsureDay avatar Mar 18 '24 06:03 AsureDay

I created a demo pytorch implementation https://github.com/DominiqueGarmier/grok-pytorch you can't really run it at the moment. Maybe it's a good starting point if someone wants to create a full pytorch version.

dominiquegarmier avatar Mar 20 '24 12:03 dominiquegarmier