InvokeAI
InvokeAI copied to clipboard
Integrate Bria 3.1/3.2 Models and ControlNet Pipelines into InvokeAI
Summary
This feature PR integrates Bria 3.1/3.2 text-to-image models and their ControlNet pipelines into InvokeAI.
How
| Area | Key Changes |
|---|---|
| Backend | Added invokeai/backend/bria/** including:- pipeline_bria.py, pipeline_bria_controlnet.py (diffusers workflows)- transformer_bria.py, controlnet_bria.py, helper & utility scripts- controlnet_aux detectors (Canny/OpenPose) |
| Model Manager | Added model_loaders/bria.py and updated probe/taxonomy for auto-discovery of Bria Main & ControlNet models. |
| Invocations / Nodes | New nodes under invokeai/nodes/bria_nodes/* including model loader, encoder, decoder, denoiser, latent sampler, and ControlNet handlers. |
| UI / API | - New field components (BriaMainModelFieldInputComponent.tsx, BriaControlNetModelFieldInputComponent.tsx)- Extended UIType enum for Node Editor integration- Updated Model Manager badges and schemas |
| Dependencies | Added scikit-image (required for OpenPose detector), updated uv.lock. |
| Scope | 46 files changed, ~5,500 new LOC, 3 LOC removed |
Representative commits:
-
Add Bria text to image model and controlnet support -
Setup Probe and UI to accept bria main/controlnet models -
Added scikit-image required for Bria's OpenposeDetector model
Related Issues / Discussions
-
Follow-up to exploratory PR #7973 ("Setup Probe and UI to accept Bria main models").
QA Instructions
Requires Bria model weights and a CUDA-11+ GPU (CPU supported, slower).
Steps:
-
Install Models
-
Set HF token with access to Bria's models.
-
Install
briaai/BRIA-3.2. -
Install
briaai/BRIA-3.2-ControlNet-Union.
-
-
Load Workflow
-
Load the workflow from the attached file:
[Bria's ControlNet workflow.json](https://github.com/user-attachments/files/21248912/Bria.s.ControlNet.workflow.json) [Bria's text-to-image workflow.json](https://github.com/user-attachments/files/21248924/Bria.s.text-to-image.workflow.json)
-
-
Run Workflow
-
Run workflow without controlnet.
-
Run workflow with controlnet.
-
Merge Plan
-
Rebase onto
mainafter current release.
Checklist
- [ ] The PR has a short but descriptive title, suitable for a changelog
- [ ] Tests added / updated (if applicable)
- [ ] Documentation added / updated (if applicable)
- [ ] Updated
What's Newcopy (if doing a release after this PR)
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).
View this failed invocation of the CLA check for more information.
For the most up to date status, view the checks section at the bottom of the pull request.