Paras Chopra

icon indicating a website link https://invertedpassion.com/

icon company Wingify icon location Founder and Chairman of @wingify. I write essays on invertedpassion.com and tweet at twitter.com/paraschopra

Results 2 issues of Paras Chopra

Is there any pre-trained RETRO model released yet?

4 comment

I don't have resources to train a large model myself, but I'm wondering if anyone has used this repo to release a model that I can play with. Thanks!

Finetuning on Llama 3.1 instruct version throws Untrained tokens found error

1 comment

Replicating my issue from Discord here. I'm following the provided notebook on my dataset, but it keeps throwing the following error: Unsloth: Untrained tokens of [[128042, 128036]] found, but embed_tokens...