stable-diffusion-webui-tokenizer is this still maintained?

getting an error saying "unknown clip : module".....

Sep 23 '23 01:09 alenknight

It seemed that it couldn't work on SDXL.

Sep 26 '23 13:09 aDropp

Using SDXL:

\webui\extensions\stable-diffusion-webui-tokenizer\scripts\tokenizer.py", line 54, in tokenize
    raise RuntimeError(f'Unknown CLIP model: {type(clip).__name__}')
RuntimeError: Unknown CLIP model: Module

@aDropp it seems that this repo was last updated on 2022-12-10 and ther is an open pull request from november... maybe this ping will get @AUTOMATIC1111 's attention.

Jan 07 '24 01:01 ice-fly

I make some change to support SDXL. However, SDXL and SD1.5 yields the same tokenization. So there should be no difference.

https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer/pull/9

Jun 14 '24 01:06 zero41120