InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

[enhancement]: Support Hypernetworks

Open n00mkrad opened this issue 3 years ago • 13 comments
trafficstars

Is there an existing issue for this?

  • [X] I have searched the existing issues

Contact Details

No response

What should this feature add?

Support hypernetworks (.pt), as there are now many community-trained hypernetwork models out there which cannot be used with this fork.

Alternatives

No response

Aditional Content

No response

n00mkrad avatar Nov 06 '22 19:11 n00mkrad

Can you provide pointers to some community-trained hypernetwork models that can be used to develop and test support?

lstein avatar Nov 10 '22 21:11 lstein

@damian0815 this enhancement might be something up your alley?

lstein avatar Nov 11 '22 02:11 lstein

Can you provide pointers to some community-trained hypernetwork models that can be used to develop and test support?

https://gitgud.io/necoma/sd-database/-/tree/main/hypernetworks/artists

I should mention that, as one might expect, these may be trained on NSFW content, but since they aren't full models I doubt that's a problem.

n00mkrad avatar Nov 11 '22 09:11 n00mkrad

Thank you. Can you confirm that these are not tainted by the NovelAI model leak?

On Fri, Nov 11, 2022 at 4:23 AM N00MKRAD @.***> wrote:

ICan you provide pointers to some community-trained hypernetwork models that can be used to develop and test support?

https://gitgud.io/necoma/sd-database/-/tree/main/hypernetworks/artists

I should mention that, as one might expect, these may be trained on NSFW content, but since they aren't full models I doubt that's a problem.

— Reply to this email directly, view it on GitHub https://github.com/invoke-ai/InvokeAI/issues/1396#issuecomment-1311442039, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA3EVMMJD52G6CSL6EXN7TWHYGBRANCNFSM6AAAAAARYR3ED4 . You are receiving this because you were assigned.Message ID: @.***>

lstein avatar Nov 11 '22 14:11 lstein

Thank you. Can you confirm that these are not tainted by the NovelAI model leak? On Fri, Nov 11, 2022 at 4:23 AM N00MKRAD @.> wrote: ICan you provide pointers to some community-trained hypernetwork models that can be used to develop and test support? https://gitgud.io/necoma/sd-database/-/tree/main/hypernetworks/artists I should mention that, as one might expect, these may be trained on NSFW content, but since they aren't full models I doubt that's a problem. — Reply to this email directly, view it on GitHub <#1396 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA3EVMMJD52G6CSL6EXN7TWHYGBRANCNFSM6AAAAAARYR3ED4 . You are receiving this because you were assigned.Message ID: @.>

Personally no because I have not trained them and don't know the technical details of NAI's networks.

Are there any "official" hypernetworks by Stability or RunwayML? Maybe that's better.

n00mkrad avatar Nov 11 '22 19:11 n00mkrad

@damian0815 this enhancement might be something up your alley?

yes, i could look into this

damian0815 avatar Nov 13 '22 11:11 damian0815

is there any estimate on when will this be released?

carct avatar Jan 16 '23 18:01 carct

as soon as somebody explains what it is without pointing us to the NAI stolen code or its derivatives

damian0815 avatar Jan 18 '23 08:01 damian0815

A quick browse of Civitai shows a large number of Hypernetworks available for download and use. I've no idea how one would prove that a Hypernetwork was absolutely not part of the NAI leak, but the A1111 web UI literally has an interface for training Hypernetworks, so there's no reason to assume guilt by default at this point. And with the increased proliferation of Hypernetworks, users will begin to expect any SD tool to support them.

ChrGriffin avatar Feb 23 '23 05:02 ChrGriffin

Isn't it supported yet?

iconnoci avatar Apr 17 '23 06:04 iconnoci

LoRA and ControlNet are coming Soon(™). those are "hypernetworks".

damian0815 avatar Apr 17 '23 14:04 damian0815

actually if you're on 2.3.4 LoRA is already in.

damian0815 avatar Apr 17 '23 14:04 damian0815

LoRA and ControlNet supersede the general hypernetworks.

jameswan avatar Jun 18 '23 03:06 jameswan