compel icon indicating copy to clipboard operation
compel copied to clipboard

Incorrect pooled embeds

Open BitPhinix opened this issue 1 year ago • 2 comments

While benchmarking our internal prompt weighting, I noticed that compel's pooled embeddings change with different prompt weighting.

I.e. pooled embeds of test != pooled embeds of (test)0.9. Compel tokenizes and encodes the prompt string, including weighting syntax, for the pooled embeds. This doesn't seem intuitive or expected.

I don't have the bandwidth to create a PR for this, but it should be quite simple to fix.

BitPhinix avatar Jul 03 '24 23:07 BitPhinix

@BitPhinix why do you think we need to pool the original prompt string? let's say i have a prompt "a girl with (green)0.2 hair" where i want "green" to be very slow, in the pooled prompt I want it to be small as well

bonlime avatar Aug 12 '24 11:08 bonlime

I am reworking the way pooling works to properly apply the weighting or strip it out

damian0815 avatar Oct 01 '25 08:10 damian0815