Inference speed

[rishabh063]

What is the fastest way to do inference with sdxl and sd1.5 these days without suffering on quality?

Seen a lot of 3rd party libs like openvivo , stable fast , stream diffusion , deepcache etc

But there is some quality loss or problems in inference.

Looking for inpainting specifically

[tolgacangoz]

Have you looked at this discussion too? Also, if you haven't encountered, there are fast sampling techniques to research about. There are trade-offs most of the time -no free lunch, no silver bullet etc.

[rishabh063]

bf 16 & sdpa seem to have no tradeoff IMO ,

Is there way to compile for multiple output dimensions ?

[DN6]

@rishabh063 The Discussions section would be a better place for this question.

[tolgacangoz]

bf 16 & sdpa seem to have no tradeoff IMO ,

Is there way to compile for multiple output dimensions ?

(A discussion was not opened, so I am posting here.)

One can determine a static maximum output shape and then mask out unused parts?

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.