x-stable-diffusion
x-stable-diffusion copied to clipboard
Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6
I would like to know which frameworks support mac, ideally using Metal Performance Shaders (MPS) or Apple Neural Engine (ANE). Seeing how these benchmark against windows and linux would be...
latents = self.scheduler.step(noise_pred.cuda(), t, latents)[ "prev_sample" ] i think there is a bug in this code, it should be: latents = self.scheduler.step(noise_pred.cuda(), i, latents)[ "prev_sample" ] because if i use...
does this have support for making batch inferences? does this have support for handling prompts that creates more than 75 tokens?
When I changed batchsize=4 while converting the model, it reported an error. The error message is that the broadcast sizes do not match
Bumps [transformers](https://github.com/huggingface/transformers) from 4.21.2 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...
Bumps [transformers](https://github.com/huggingface/transformers) from 4.21.2 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...
Bumps [transformers](https://github.com/huggingface/transformers) from 4.21.2 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...
Bumps [transformers](https://github.com/huggingface/transformers) from 4.21.2 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...
Bumps [transformers](https://github.com/huggingface/transformers) from 4.21.2 to 4.30.0. Release notes Sourced from transformers's releases. v4.30.0: 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone 100k Transformers has just reached 100k stars...