SwarmUI icon indicating copy to clipboard operation
SwarmUI copied to clipboard

Third Pass / Detailer Upscaling Workflow

Open Mooshieblob1 opened this issue 4 months ago • 0 comments

Feature Idea

The Problem

Currently, the image generation process in SwarmUI involves a generation pass (txt2img) followed by an upscaling pass (the second pass). While this is effective for increasing resolution, the upscaled images can sometimes lack the fine detail needed for a final-quality result.

To add these finer details, users must resort to cumbersome workarounds that break the streamlined workflow:

  1. Manual Re-processing in SwarmUI: Generate the image with its initial upscale, then manually send that output image back as a new init image. The user then has to re-run the generation with the same parameters, but with the upscaler's init creativity (denoising) set to a low value. This is a multi-step, unintuitive process.
  2. Using the ComfyUI Backend Directly: Users can bypass the SwarmUI interface to build a more complex, multi-pass workflow directly in ComfyUI. This defeats the purpose of using the simplified and powerful SwarmUI frontend.

Both of these methods are inefficient and disrupt the user experience. A native, automated third-pass/detailer feature is needed.

Proposed Solution

I propose adding an optional Third Pass (also known as a "Detail Pass") directly into the main workflow.

Functionally, this third pass should be an automated implementation of the existing manual workflow: it would take the 2nd pass upscaled image and feed it back into the upscaler as an init image. The parameters available for this third pass should be the same as those available for the second pass upscaler, with the most important being init creativity (denoising strength).

Proposed UI/UX:

  • In the upscaling parameters section, add a checkbox: [ ] Enable Detail Pass.
  • When checked, a new set of options would appear, allowing the user to control this third pass using the same parameters available for the second pass.

Key Options:

  • Init Creativity / Denoising Strength: A slider or input field (e.g., 0.1 to 0.4) to control how much the detail pass alters the upscaled image. This is the most essential setting.
  • Prompt Overrides: Text boxes for positive and negative prompts, which would default to the original prompts if left empty.
  • Model Override: A dropdown to select a different model specifically for the detail pass.
  • Other Upscaler Parameters: Access to the same set of samplers, steps, etc., that are available for the standard upscaling pass.

This feature would automate a powerful but tedious technique, allowing users to create highly detailed, high-resolution images in a single click.


Other

Alternatives Considered

The only alternative is the manual process described above. While functional, it is inefficient and discourages experimentation due to the time and effort involved.

Additional Context

This type of multi-pass workflow is a standard technique for achieving high-quality results in the AI image generation community. Other tools have implemented similar functionality, demonstrating its value:

  • ComfyUI: Allows users to build complex node graphs that achieve this exact workflow.

Integrating this feature natively into SwarmUI would be a major enhancement, aligning it with best practices for state-of-the-art image generation and greatly improving the user experience.

Mooshieblob1 avatar Aug 03 '25 19:08 Mooshieblob1