jetson-containers icon indicating copy to clipboard operation
jetson-containers copied to clipboard

Published 20 hours ago • verified publisher icon dusty-nv

Tensorrt SDXL support

Open Jcwscience opened this issue 1 year ago • 1 comments

Using the dev branch of stable-diffusion-webui along with Stable-Diffusion-WebUI-TensorRT now allows for converting SDXL models to tensorrt. On my pc I’ve been able to convert a model using around 12GB of vram, so it should be possible on the Orin nx 16GB and above (might be cutting it close). I’ve been trying to figure out what specific differences there are between the model conversion scripts but I haven’t been able to put much time into it. Is this something that could be implemented in the future?

Jcwscience avatar Feb 16 '24 21:02 Jcwscience

@Jcwscience I would accept PRs for this but SD/SDXL is not a priority for my development

dusty-nv avatar Feb 22 '24 19:02 dusty-nv