InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

Integrate Bria 3.1/3.2 Models and ControlNet Pipelines into InvokeAI

Open ilanbria opened this issue 4 months ago • 10 comments

Summary

This feature PR integrates Bria 3.1/3.2 text-to-image models and their ControlNet pipelines into InvokeAI.

image

How

Area Key Changes
Backend Added invokeai/backend/bria/** including:- pipeline_bria.py, pipeline_bria_controlnet.py (diffusers workflows)- transformer_bria.py, controlnet_bria.py, helper & utility scripts- controlnet_aux detectors (Canny/OpenPose)
Model Manager Added model_loaders/bria.py and updated probe/taxonomy for auto-discovery of Bria Main & ControlNet models.
Invocations / Nodes New nodes under invokeai/nodes/bria_nodes/* including model loader, encoder, decoder, denoiser, latent sampler, and ControlNet handlers.
UI / API - New field components (BriaMainModelFieldInputComponent.tsx, BriaControlNetModelFieldInputComponent.tsx)- Extended UIType enum for Node Editor integration- Updated Model Manager badges and schemas
Dependencies Added scikit-image (required for OpenPose detector), updated uv.lock.
Scope 46 files changed, ~5,500 new LOC, 3 LOC removed

Representative commits:

  • Add Bria text to image model and controlnet support

  • Setup Probe and UI to accept bria main/controlnet models

  • Added scikit-image required for Bria's OpenposeDetector model


Related Issues / Discussions

  • Follow-up to exploratory PR #7973 ("Setup Probe and UI to accept Bria main models").


QA Instructions

Requires Bria model weights and a CUDA-11+ GPU (CPU supported, slower).

Steps:

  1. Install Models

    • Set HF token with access to Bria's models.

    • Install briaai/BRIA-3.2.

    • Install briaai/BRIA-3.2-ControlNet-Union.

  2. Load Workflow

    • Load the workflow from the attached file:

      [Bria's ControlNet workflow.json](https://github.com/user-attachments/files/21248912/Bria.s.ControlNet.workflow.json) [Bria's text-to-image workflow.json](https://github.com/user-attachments/files/21248924/Bria.s.text-to-image.workflow.json)
  3. Run Workflow

    • Run workflow without controlnet.

    • Run workflow with controlnet.


Merge Plan

  • Rebase onto main after current release.


Checklist

  • [ ] The PR has a short but descriptive title, suitable for a changelog
  • [ ] Tests added / updated (if applicable)
  • [ ] Documentation added / updated (if applicable)
  • [ ] Updated What's New copy (if doing a release after this PR)

ilanbria avatar Jul 10 '25 08:07 ilanbria

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

google-cla[bot] avatar Jul 05 '25 07:07 google-cla[bot]