Ird

body.json() will get you the joints in json format

Just use the tokenizer below and add case for llama3tokenizer in arguments.py file and in the build_tokenizer function in the tmegatron/training/tokenizer/tokenizer.py. It seems to work this way ```python def create_llama3_tokenizer(*args,...

Its the official llama3 tokenizer from this repo https://github.com/meta-llama/llama3/blob/main/llama/tokenizer.py. You can clone the repo and install with pip install -e .

That was a patchy fix. I think it is better to specify tokenizer as hugging face tokenizer. ```bash --tokenizer-type HuggingFaceTokenizer --tokenizer-model path to downloaded llama3 folder. that contains original/tokenizer.model file....

OOM has nothing to do with tokenizer. If the model is not fitting in your GPU either use the SGD optimizer using `--optimzer sgd` . Decrease batch size of the...

Thank you for the prompt reply. I would like to further confirm a couple of things with you, 1 - deployed model on the hugging face just uses the first...

Thank you for the clarification. Best