fastsdcpu icon indicating copy to clipboard operation
fastsdcpu copied to clipboard

77 tokens limit ?

Open Cariboost opened this issue 1 year ago • 3 comments

Hello

[Edit] since posting this message I understood how to search correctly on GitHub. However I find the answer to be "token limit is on model side". However for the same model I use on A1111 with Google collab, I don't have this limit. And from what I read online this limit can be bypassed by the diffuser

I am using fastsdcpu on Android (btw I am using android 12 (on note 10+) even if compatibility says android 13 at least and it is working pretty well, even if quality is quite low but I didn't deep dive yet on why).

I am facing the limit of 77 tokens in the prompt : everything after 77 characters is ignored (terminal explicitly say that).

I checked on Google and it seem to be quite a common issue that most GUI like A1111 managed to solve. I tried to see if something was feasible on my side without coding but I couldn't find. So I was wondering if a way existed with fastsdcpu ? Or is it something wanted to avoid CPU overload

Cariboost avatar Sep 30 '24 15:09 Cariboost

yes current default token limitation is 77.

rupeshs avatar Oct 10 '24 03:10 rupeshs

Here are some solutions. I'm no programmer, but maybe someone will make a PR after this: https://github.com/huggingface/diffusers/issues/2136

mykeehu avatar Oct 13 '24 19:10 mykeehu

"compel" could be a good option, as introduced here:
https://huggingface.co/docs/diffusers/using-diffusers/weighted_prompts#stable-diffusion-xl

kotoji avatar Dec 31 '24 06:12 kotoji