Using negative prompts increases VRAM usage permanently

[ShnitzelKiller]

Describe the bug When using a negative prompt, the model size increases, as demonstrated by the sudden inability to increase the batch size beyond 1. Deleting the negative prompt does not change this, essentially forcing a restart of the entire application to be able to generate batches of 2 again on an 8 GB VRAM GPU.

To Reproduce Steps to reproduce the behavior:

1. Generate an image using both the regular prompt and the negative prompt
2. Remove the negative prompt
3. Future generations cannot be generated in batches of 2 anymore, or depending on the graphics card, whatever the maximum batch size was before will now be lower (probably).

Expected behavior Removing the negative prompt should cause the program state to be the way it was at the start, including VRAM usage.

Desktop (please complete the following information):

• OS: Windows
• Browser: Firefox
• Commit revision 8ff6f093206111940e2601187f3f208d761543d6

[tonyy01]

Your VRAM will always be the highest one you ever had. Fortunately, it will not affect your current use.

[catboxanon]

Closing as stale.