stable-diffusion-webui-tokenizer

stable-diffusion-webui-tokenizer copied to clipboard

is this still maintained?

3

getting an error saying "unknown clip : module".....

alenknight

What do the colors on each token mean?

1

I wish you'd be clear on that because I am interested. Is there a legend of sorts?

danielos123ssa

Error loading script: tokenizer.py Traceback (most recent call last): File "C:\Users\coron\OneDrive\デスクトップ\stable-diffusion-webui-master\stable-diffusion-webui-master\modules\scripts.py", line 170, in load_scripts exec(compiled, module.__dict__) File "C:\Users\coron\OneDrive\デスクトップ\stable-diffusion-webui-master\stable-diffusion-webui-master\extensions\stable-diffusion-webui-tokenizer\scripts\tokenizer.py", line 5, in import open_clip.tokenizer ModuleNotFoundError: No module named 'open_clip'

coronet1127

AttributeError: 'FrozenOpenCLIPEmbedder' object has no attribute 'tokenizer'

4

Can't run it at all, unfortunately. :( Traceback (most recent call last): File "/scratch/StableDiffusion/AUTOMATIC1111/stable-diffusion-webui/venv/lib64/python3.10/site-packages/gradio/routes.py", line 284, in run_predict output = await app.blocks.process_api( File "/scratch/StableDiffusion/AUTOMATIC1111/stable-diffusion-webui/venv/lib64/python3.10/site-packages/gradio/blocks.py", line 982, in process_api result =...

enn-nafnlaus

This PR solve the highlights in dark mode (issue #2) and also provide parsing prompts by webui before tokenize. Some examples are as follow: Simple tokenizer:  **Parse prompts by...

zzhongzz

Thanks!

1

Haha, thanks for this! I was literally doing some initial exploration work last night with the idea of making exactly this sort of thing! - https://github.com/0xdevalias/poc-clip-tokeniser Even better that I...

0xdevalias

I am using zh_CN in stable-diffusion-webui But the output words of this extension will also be translated :( This should not be a fatal problem, just some impact on the...

Widecss

As the title Experience bad in dark mode 

HaroidBlue

This extension works with the SD1.5 models but fails with SDXL. In this code update, I checked the source code and identified that SDXL at this line: https://github.com/AUTOMATIC1111/stable-diffusion-webui/blob/feee37d75f1b168768014e4634dcb156ee649c05/modules/sd_hijack_clip.py#L349. The current...

zero41120