stable-diffusion-webui-tokenizer icon indicating copy to clipboard operation
stable-diffusion-webui-tokenizer copied to clipboard
verified publisher icon AUTOMATIC1111

Thanks!

Open 0xdevalias opened this issue 3 years ago • 1 comments

Haha, thanks for this!

I was literally doing some initial exploration work last night with the idea of making exactly this sort of thing!

  • https://github.com/0xdevalias/poc-clip-tokeniser

Even better that I don't have to do it myself now! 🖤

0xdevalias avatar Nov 06 '22 01:11 0xdevalias

I know this is a noob question but could you please explain in short why looking at the tokens can be so helpful?

illtellyoulater avatar Nov 24 '22 14:11 illtellyoulater