AITemplate
AITemplate copied to clipboard
Error when trying to compile Stable Diffusion demo on a RTX 2080
Hi! I'm trying to compile the Stable Diffusion demo on a RTX 2080, my specs:
Ubuntu 22.04 CUDA 11.7
2022-11-21 18:41:36,544 INFO <aitemplate.compiler.compiler> compiled the final .so file elapsed time: 0:02:44.633613 [18:41:36] model_interface.cu:91: Error: DeviceMalloc(&result, n_bytes) API call failed: out of memory at model_interface.cu, line49 [18:41:36] model_interface.cu:220: Variable handle can't be null
Full log https://pastebin.com/m3WkmYTA
Is it something to do with the VRAM?
2080 (8 GB) may not have enough memory to run Stable Diffusion. 3080 (10 GB) has enough.