Xiaoyu Xu

icon indicating a website link https://strint.github.io/ icon indicating an email [email protected]

icon location ShenZhen icon location a user of processor and matrix, strint.github.io

Results 214 comments of Xiaoyu Xu

Avoid CPU OOM by unloading to mmap when the CPU mem is low

> Would it not be better to just drop the memory and reload tensors from the model file on disk that you already have? ComfyUI’s unload and load operations work...

Avoid CPU OOM by unloading to mmap when the CPU mem is low

> Agree. This is the same behaviour as swap. I actually have some work-in-progress for what @asagi4 describes by just going back to the model file in this scenario. Going...

Avoid CPU OOM by loading diffusion model from state dict with assign

> How does this interact with pinned memory? My understanding is mmaped memory cannot be inplace pinned using the apporach currently taken in pin_memory (cuda_host_register). Does this just error and...

Avoid CPU OOM by loading diffusion model from state dict with assign

> This is a disruptive change and the community has actually gone to the effort of explictly offloading mmaps in the past due to poor OS support. > > https://github.com/city96/ComfyUI-GGUF/blob/main/nodes.py#L98...