benchmarks icon indicating copy to clipboard operation
benchmarks copied to clipboard

Published 20 hours ago • verified publisher icon premAI-io

JAX

Open Anindyadeep opened this issue 1 year ago • 2 comments

Since, JAX is getting very much popular. So, it would be awesome, if we can also benchmark the performance of LLama 2 written in JAX.

Here is the implementation

Anindyadeep avatar Dec 04 '23 05:12 Anindyadeep

@Anindyadeep can you check if they support llama2/mistral? Otherwise let's close the issue

nsosio avatar Apr 05 '24 08:04 nsosio

Seems like HuggingFace does have an implementation for both

Llama implementation: https://github.com/huggingface/transformers/pull/24587 Mistral implementation: https://github.com/huggingface/transformers/pull/26943

we can come back to this, once done with the initial ones

Anindyadeep avatar Apr 05 '24 09:04 Anindyadeep