webp: no embedded information found.
version: f2.0.1v1.10.1-previous-665-gae278f79 python: 3.10.6 torch: 2.3.1+cu121 gradio: 4.40.0
If the directory of embedded models contains their images in any format, then Forge rescans each image each time a checkpoint or VAE changes. Such delays are especially significant if there are many embedded files in the directories with their corresponding pics, and the checkpoint model or VAE change occurs during the workflow cycle itself—for example, a different checkpoint model in HiRes-Fix, Refiner, or ADetailer. Embedded models are used from a single location for different systems (Forge, Comfy, A1111); LoRA Manager is quite popular for Comfy, which automatically creates preview images for embedded models in .webp format. Is it possible to exclude the webp format from such frequent scanning, given that it does not contain scannable data? To eliminate such delays, we currently had to delete all previews in the embeddings directories and sub-directories.
for example:
Loading Model: {'checkpoint_info': {'filename': 'H:\SD\webui\models\Stable-diffusion\01iL\BSSEquinoxILSemi_v25.safetensors', 'hash': '16d44f2d'}, 'additional_modules': ['H:\SD\webui\models\VAE\illustriousXLV20_v10.safetensors'], 'unet_storage_dtype': None} [Unload] Trying to free all memory for cuda:0 with 0 models keep loaded ... Current free memory is 14096.53 MB ... Unload model JointTextEncoder Current free memory is 15855.76 MB ... Unload model KModel Current free memory is 20852.95 MB ... Unload model IntegratedAutoencoderKL Done. StateDict Keys: {'unet': 1680, 'vae': 248, 'text_encoder': 197, 'text_encoder_2': 518, 'ignore': 0} Working with z of shape (1, 4, 32, 32) = 4096 dimensions. K-Model Created: {'storage_dtype': torch.float16, 'computation_dtype': torch.float16} lazydn_pony.webp: no embedded information found. lazyhand.webp: no embedded information found. lazyhandV2.webp: no embedded information found. lazympos.webp: no embedded information found. lazynegV1.webp: no embedded information found. lazynegV2.webp: no embedded information found. lazynegV3.webp: no embedded information found. lazyposV1.webp: no embedded information found. lazyposV2.webp: no embedded information found. lazyreal.webp: no embedded information found. lazyup6.webp: no embedded information found. lazyup7.webp: no embedded information found. lazyup_pony.webp: no embedded information found. lazydn_pony.webp: no embedded information found. lazyhand.webp: no embedded information found. lazyhandV2.webp: no embedded information found. lazympos.webp: no embedded information found. lazynegV1.webp: no embedded information found. lazynegV2.webp: no embedded information found. lazynegV3.webp: no embedded information found. lazyposV1.webp: no embedded information found. lazyposV2.webp: no embedded information found. lazyreal.webp: no embedded information found. lazyup6.webp: no embedded information found. lazyup7.webp: no embedded information found. lazyup_pony.webp: no embedded information found. Model loaded in 6.2s (unload existing model: 3.0s, forge model load: 3.2s). [Unload] Trying to free 3051.58 MB for cuda:0 with 0 models keep loaded ... Done. | 0/34 [00:00<?, ?it/s] [Memory Management] Target: JointTextEncoder, Free GPU: 21174.96 MB, Model Require: 1559.68 MB, Previously Loaded: 0.00 MB, Inference Require: 1024.00 MB, Remaining: 18591.28 MB, All loaded to GPU. Moving model(s) has taken 1.04 seconds [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19414.51 MB ... Done. [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19413.89 MB ... Done. [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19413.89 MB ... Done. [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_g] [Unload] Trying to free 7411.92 MB for cuda:0 with 0 models keep loaded ... Current free memory is 19413.69 MB ... Done. [Memory Management] Target: KModel, Free GPU: 19413.69 MB, Model Require: 4897.05 MB, Previously Loaded: 0.00 MB, Inference Require: 1024.00 MB, Remaining: 13492.65 MB, All loaded to GPU. Moving model(s) has taken 2.77 seconds 82%|███████████████████████████████████████████████████████████████████▌ | 28/34 [00:07<00:01, 3.31it/s]Model selected: {'checkpoint_info': {'filename': 'H:\SD\webui\models\Stable-diffusion\01iL\alchemistMixUncanny_v20.safetensors', 'hash': '2ed62e7a'}, 'additional_modules': ['H:\SD\webui\models\VAE\illustriousXLV20_v10.safetensors'], 'unet_storage_dtype': None} Using online LoRAs in FP16: False Loading Model: {'checkpoint_info': {'filename': 'H:\SD\webui\models\Stable-diffusion\01iL\alchemistMixUncanny_v20.safetensors', 'hash': '2ed62e7a'}, 'additional_modules': ['H:\SD\webui\models\VAE\illustriousXLV20_v10.safetensors'], 'unet_storage_dtype': None} [Unload] Trying to free all memory for cuda:0 with 0 models keep loaded ... Current free memory is 14415.70 MB ... Unload model JointTextEncoder Current free memory is 16174.93 MB ... Unload model KModel Done. StateDict Keys: {'unet': 1680, 'vae': 248, 'text_encoder': 197, 'text_encoder_2': 518, 'ignore': 0} Working with z of shape (1, 4, 32, 32) = 4096 dimensions. K-Model Created: {'storage_dtype': torch.float16, 'computation_dtype': torch.float16} lazydn_pony.webp: no embedded information found. lazyhand.webp: no embedded information found. lazyhandV2.webp: no embedded information found. lazympos.webp: no embedded information found. lazynegV1.webp: no embedded information found. lazynegV2.webp: no embedded information found. lazynegV3.webp: no embedded information found. lazyposV1.webp: no embedded information found. lazyposV2.webp: no embedded information found. lazyreal.webp: no embedded information found. lazyup6.webp: no embedded information found. lazyup7.webp: no embedded information found. lazyup_pony.webp: no embedded information found. lazydn_pony.webp: no embedded information found. lazyhand.webp: no embedded information found. lazyhandV2.webp: no embedded information found. lazympos.webp: no embedded information found. lazynegV1.webp: no embedded information found. lazynegV2.webp: no embedded information found. lazynegV3.webp: no embedded information found. lazyposV1.webp: no embedded information found. lazyposV2.webp: no embedded information found. lazyreal.webp: no embedded information found. lazyup6.webp: no embedded information found. lazyup7.webp: no embedded information found. lazyup_pony.webp: no embedded information found. Model loaded in 6.9s (unload existing model: 2.7s, forge model load: 4.1s). Model selected: {'checkpoint_info': {'filename': 'H:\SD\webui\models\Stable-diffusion\01iL\BSSEquinoxILSemi_v25.safetensors', 'hash': '16d44f2d'}, 'additional_modules': ['H:\SD\webui\models\VAE\illustriousXLV20_v10.safetensors'], 'unet_storage_dtype': None} Using online LoRAs in FP16: False [Unload] Trying to free 3051.58 MB for cuda:0 with 0 models keep loaded ... Done. [Memory Management] Target: JointTextEncoder, Free GPU: 21172.12 MB, Model Require: 1559.68 MB, Previously Loaded: 0.00 MB, Inference Require: 1024.00 MB, Remaining: 18588.44 MB, All loaded to GPU. Moving model(s) has taken 3.64 seconds [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19411.67 MB ... Done. [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19411.06 MB ... Done. [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazynegV3] in CLIP of [clip_g] [Unload] Trying to free 1024.00 MB for cuda:0 with 1 models keep loaded ... Current free memory is 19411.06 MB ... Done. [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_l] [Textual Inversion] Used Embedding [lazyposV2] in CLIP of [clip_g] [Unload] Trying to free 7411.92 MB for cuda:0 with 0 models keep loaded ... Current free memory is 19411.06 MB ... Done. [Memory Management] Target: KModel, Free GPU: 19411.06 MB, Model Require: 4897.05 MB, Previously Loaded: 0.00 MB, Inference Require: 1024.00 MB, Remaining: 13490.01 MB, All loaded to GPU. Moving model(s) has taken 10.33 seconds 100%|██████████████████████████████████████████████████████████████████████████████████| 34/34 [00:30<00:00, 1.11it/s] [Unload] Trying to free 2071.52 MB for cuda:0 with 1 models keep loaded ... Current free memory is 14413.68 MB ... Done. 100%|██████████████████████████████████████████████████████████████████████████████████| 34/34 [00:17<00:00, 1.93it/s] [Unload] Trying to free 14183.68 MB for cuda:0 with 0 models keep loaded ... Current free memory is 14412.49 MB ... Done. [Memory Management] Target: IntegratedAutoencoderKL, Free GPU: 14412.49 MB, Model Require: 319.11 MB, Previously Loaded: 0.00 MB, Inference Require: 1024.00 MB, Remaining: 13069.38 MB, All loaded to GPU. Moving model(s) has taken 0.11 seconds Total progress: 100%|██████████████████████████████████████████████████████████████████| 68/68 [00:54<00:00, 1.25it/s] Total progress: 100%|██████████████████████████████████████████████████████████████████| 68/68 [00:54<00:00, 1.70it/s]
Same issue here.. It adds like 30 seconds to each generation.