stable-diffusion-webui-forge
stable-diffusion-webui-forge copied to clipboard
lllyasviel
[Bug]: Unable to use specific controllNet preprocessor
Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [X] The issue has been reported before but has not been fixed yet
What happened?
Unable to use specific controllNet preprocessor,console will show some erro
Steps to reproduce the problem
Using controlnet with specific preprocessor
What should have happened?
preprocessor will all useable
What browsers do you use to access the UI ?
No response
Sysinfo
{ "Platform": "Windows-10-10.0.22635-SP0", "Python": "3.10.11", "Version": "f0.0.17v1.8.0rc-latest-276-g29be1da7", "Commit": "29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7", "Script path": "I:\stable-diffusion-webui-forge", "Data path": "I:\stable-diffusion-webui-forge", "Extensions dir": "I:\stable-diffusion-webui-forge\extensions", "Checksum": "5a4d66a0c2ab90cb2b4c43d12e577386737e37c41069ad7b3787d63dd85def1c", "Commandline": [ "launch.py", "--autolaunch", "--api", "--ad-no-huggingface", "--xformers", "--theme=dark", "--cuda-stream", "--no-gradio-queue" ], "Torch env info": { "torch_version": "2.1.2+cu121", "is_debug_build": "False", "cuda_compiled_version": "12.1", "gcc_version": null, "clang_version": null, "cmake_version": null, "os": "Microsoft Windows 11 Enterprise", "libc_version": "N/A", "python_version": "3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)] (64-bit runtime)", "python_platform": "Windows-10-10.0.22635-SP0", "is_cuda_available": "True", "cuda_runtime_version": "11.1.105\r", "cuda_module_loading": "LAZY", "nvidia_driver_version": "551.61", "nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 3070", "cudnn_version": null, "pip_version": "pip3", "pip_packages": [ "numpy==1.26.2", "open-clip-torch==2.20.0", "pytorch-lightning==1.9.4", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.1", "torchsde==0.2.6", "torchvision==0.16.2+cu121" ], "conda_packages": null, "hip_compiled_version": "N/A", "hip_runtime_version": "N/A", "miopen_runtime_version": "N/A", "caching_allocator_config": "", "is_xnnpack_available": "True", "cpu_info": [ "Architecture=9", "CurrentClockSpeed=3801", "DeviceID=CPU0", "Family=107", "L2CacheSize=4096", "L2CacheSpeed=", "Manufacturer=AuthenticAMD", "MaxClockSpeed=3801", "Name=AMD Ryzen 7 5800X 8-Core Processor ", "ProcessorType=3", "Revision=8448" ] }, "Exceptions": [], "CPU": { "model": "AMD64 Family 25 Model 33 Stepping 0, AuthenticAMD", "count logical": 16, "count physical": 8 }, "RAM": { "total": "32GB", "used": "17GB", "free": "15GB" }, "Extensions": [ { "name": "OneButtonPrompt", "path": "I:\stable-diffusion-webui-forge\extensions\OneButtonPrompt", "version": "4dc3ceba", "branch": "main", "remote": "https://github.com/AIrjen/OneButtonPrompt" }, { "name": "a1111-sd-webui-tagcomplete", "path": "I:\stable-diffusion-webui-forge\extensions\a1111-sd-webui-tagcomplete", "version": "bec567fe", "branch": "main", "remote": "https://github.com/DominikDoom/a1111-sd-webui-tagcomplete.git" }, { "name": "adetailer", "path": "I:\stable-diffusion-webui-forge\extensions\adetailer", "version": "3f1d1b97", "branch": "main", "remote": "https://github.com/Bing-su/adetailer.git" }, { "name": "multi-subject-render", "path": "I:\stable-diffusion-webui-forge\extensions\multi-subject-render", "version": "03427e26", "branch": "main", "remote": "https://github.com/Extraltodeus/multi-subject-render.git" }, { "name": "sd-civitai-browser-plus", "path": "I:\stable-diffusion-webui-forge\extensions\sd-civitai-browser-plus", "version": "297f71bd", "branch": "main", "remote": "https://github.com/BlafKing/sd-civitai-browser-plus.git" }, { "name": "sd-forge-layerdiffuse", "path": "I:\stable-diffusion-webui-forge\extensions\sd-forge-layerdiffuse", "version": "e4d5060e", "branch": "main", "remote": "https://github.com/layerdiffusion/sd-forge-layerdiffuse.git" }, { "name": "sd-webui-aspect-ratio-helper", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-aspect-ratio-helper", "version": "99fcf9b0", "branch": "main", "remote": "https://github.com/thomasasfk/sd-webui-aspect-ratio-helper.git" }, { "name": "sd-webui-e621-prompt", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-e621-prompt", "version": "74ce0a50", "branch": "main", "remote": "https://github.com/nochnoe/sd-webui-e621-prompt.git" }, { "name": "sd-webui-infinite-image-browsing", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-infinite-image-browsing", "version": "6efef975", "branch": "main", "remote": "https://github.com/zanllp/sd-webui-infinite-image-browsing.git" }, { "name": "sd-webui-prompt-all-in-one", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-prompt-all-in-one", "version": "62178a29", "branch": "main", "remote": "https://github.com/Physton/sd-webui-prompt-all-in-one.git" }, { "name": "sd-webui-segment-anything", "path": "I:\stable-diffusion-webui-forge\extensions\sd-webui-segment-anything", "version": "982138cf", "branch": "master", "remote": "https://github.com/continue-revolution/sd-webui-segment-anything.git" }, { "name": "sd_delete_button", "path": "I:\stable-diffusion-webui-forge\extensions\sd_delete_button", "version": "9df37671", "branch": "main", "remote": "https://github.com/AlUlkesh/sd_delete_button.git" }, { "name": "stable-diffusion-webui-localization-zh_Hans", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-localization-zh_Hans", "version": "ba402f61", "branch": "master", "remote": "https://github.com/hanamizuki-ai/stable-diffusion-webui-localization-zh_Hans.git" }, { "name": "stable-diffusion-webui-promptgen", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-promptgen", "version": "84e58b5d", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-promptgen.git" }, { "name": "stable-diffusion-webui-rembg", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-rembg", "version": "a4c07b85", "branch": "master", "remote": "https://github.com/AUTOMATIC1111/stable-diffusion-webui-rembg.git" }, { "name": "ultimate-upscale-for-automatic1111", "path": "I:\stable-diffusion-webui-forge\extensions\ultimate-upscale-for-automatic1111", "version": "2322caa4", "branch": "master", "remote": "https://github.com/Coyote-A/ultimate-upscale-for-automatic1111" } ], "Inactive extensions": [ { "name": "Stable-Diffusion-Webui-Civitai-Helper", "path": "I:\stable-diffusion-webui-forge\extensions\Stable-Diffusion-Webui-Civitai-Helper", "version": "c333a93c", "branch": "master", "remote": "https://github.com/zixaphir/Stable-Diffusion-Webui-Civitai-Helper.git" }, { "name": "multidiffusion-upscaler-for-automatic1111", "path": "I:\stable-diffusion-webui-forge\extensions\multidiffusion-upscaler-for-automatic1111", "version": "76cde3c2", "branch": "main", "remote": "https://github.com/pkuliyi2015/multidiffusion-upscaler-for-automatic1111.git" }, { "name": "stable-diffusion-webui-localization-zh_CN", "path": "I:\stable-diffusion-webui-forge\extensions\stable-diffusion-webui-localization-zh_CN", "version": "eb67f8dc", "branch": "main", "remote": "https://github.com/dtlnor/stable-diffusion-webui-localization-zh_CN" } ], "Environment": { "COMMANDLINE_ARGS": " --autolaunch --api --ad-no-huggingface --xformers --theme=dark --cuda-stream --no-gradio-queue", "GRADIO_ANALYTICS_ENABLED": "False" }, "Config": { "ldsr_steps": 100, "ldsr_cached": false, "SCUNET_tile": 256, "SCUNET_tile_overlap": 8, "SWIN_tile": 192, "SWIN_tile_overlap": 8, "SWIN_torch_compile": false, "control_net_detectedmap_dir": "detected_maps", "control_net_models_path": "", "control_net_modules_path": "", "control_net_unit_count": 3, "control_net_model_cache_size": 5, "control_net_no_detectmap": false, "control_net_detectmap_autosaving": false, "control_net_allow_script_control": false, "control_net_sync_field_args": true, "controlnet_show_batch_images_in_ui": false, "controlnet_increment_seed_during_batch": false, "controlnet_disable_openpose_edit": false, "controlnet_disable_photopea_edit": false, "controlnet_photopea_warning": true, "controlnet_input_thumbnail": true, "tac_tagFile": "danbooru.csv", "tac_active": true, "tac_activeIn.txt2img": true, "tac_activeIn.img2img": true, "tac_activeIn.negativePrompts": true, "tac_activeIn.thirdParty": true, "tac_activeIn.modelList": "", "tac_activeIn.modelListMode": "Blacklist", "tac_slidingPopup": true, "tac_maxResults": 5, "tac_showAllResults": false, "tac_resultStepLength": 100, "tac_delayTime": 100, "tac_useWildcards": true, "tac_sortWildcardResults": true, "tac_wildcardExclusionList": "", "tac_skipWildcardRefresh": false, "tac_useEmbeddings": true, "tac_includeEmbeddingsInNormalResults": false, "tac_useHypernetworks": true, "tac_useLoras": true, "tac_useLycos": true, "tac_useLoraPrefixForLycos": true, "tac_showWikiLinks": false, "tac_showExtraNetworkPreviews": true, "tac_modelSortOrder": "Name", "tac_useStyleVars": false, "tac_replaceUnderscores": true, "tac_escapeParentheses": true, "tac_appendComma": true, "tac_appendSpace": true, "tac_alwaysSpaceAtEnd": true, "tac_modelKeywordCompletion": "Never", "tac_modelKeywordLocation": "Start of prompt", "tac_wildcardCompletionMode": "To next folder level", "tac_alias.searchByAlias": true, "tac_alias.onlyShowAlias": false, "tac_translation.translationFile": "Tags-zh-full-pack.csv", "tac_translation.oldFormat": false, "tac_translation.searchByTranslation": true, "tac_translation.liveTranslation": false, "tac_extra.extraFile": "extra-quality-tags.csv", "tac_extra.addMode": "Insert before", "tac_chantFile": "demo-chants.json", "tac_keymap": "{\n "MoveUp": "ArrowUp",\n "MoveDown": "ArrowDown",\n "JumpUp": "PageUp",\n "JumpDown": "PageDown",\n "JumpToStart": "Home",\n "JumpToEnd": "End",\n "ChooseSelected": "Enter",\n "ChooseFirstOrSelected": "Tab",\n "Close": "Escape"\n}", "tac_colormap": "{\n "danbooru": {\n "-1": ["red", "maroon"],\n "0": ["lightblue", "dodgerblue"],\n "1": ["indianred", "firebrick"],\n "3": ["violet", "darkorchid"],\n "4": ["lightgreen", "darkgreen"],\n "5": ["orange", "darkorange"]\n },\n "e621": {\n "-1": ["red", "maroon"],\n "0": ["lightblue", "dodgerblue"],\n "1": ["gold", "goldenrod"],\n "3": ["violet", "darkorchid"],\n "4": ["lightgreen", "darkgreen"],\n "5": ["tomato", "darksalmon"],\n "6": ["red", "maroon"],\n "7": ["whitesmoke", "black"],\n "8": ["seagreen", "darkseagreen"]\n }\n}", "tac_refreshTempFiles": "Refresh TAC temp files", "ad_max_models": 2, "ad_extra_models_dir": "", "ad_save_previews": false, "ad_save_images_before": false, "ad_only_seleted_scripts": true, "ad_script_names": "dynamic_prompting,dynamic_thresholding,wildcard_recursive,wildcards,lora_block_weight,negpip", "ad_bbox_sortby": "None", "ad_same_seed_for_each_tap": false, "use_aria2": true, "disable_dns": false, "show_log": false, "split_aria2": 64, "aria2_flags": "", "unpack_zip": false, "save_api_info": false, "auto_save_all_img": false, "custom_api_key": "0c0a964852e4f950a8fb27747a51778f", "hide_early_access": true, "use_LORA": true, "dot_subfolders": true, "use_local_html": false, "page_header": false, "video_playback": true, "individual_meta_btn": true, "update_log": true, "image_location": "", "sub_image_location": true, "local_path_in_html": false, "save_to_custom": false, "insert_sub_1": false, "insert_sub_2": false, "insert_sub_3": false, "insert_sub_4": false, "insert_sub_5": false, "insert_sub_6": false, "insert_sub_7": false, "insert_sub_8": false, "insert_sub_9": false, "insert_sub_10": false, "insert_sub_11": false, "insert_sub_12": false, "insert_sub_13": false, "insert_sub_14": false, "Checkpoint_subfolder": "None", "LORA_LoCon_subfolder": "None", "TextualInversion_subfolder": "None", "Poses_subfolder": "None", "Controlnet_subfolder": "None", "Hypernetwork_subfolder": "None", "MotionModule_subfolder": "None", "SWINIR_upscale_subfolder": "None", "REALESRGAN_upscale_subfolder": "None", "GFPGAN_upscale_subfolder": "None", "BSRGAN_upscale_subfolder": "None", "ESRGAN_upscale_subfolder": "None", "VAE_subfolder": "None", "AestheticGradient_subfolder": "None", "Wildcards_subfolder": "None", "Workflows_subfolder": "None", "Other_subfolder": "None", "openpose3d_use_online_version": false, "arh_javascript_aspect_ratio_show": true, "arh_javascript_aspect_ratio": "1:1, 3:2, 4:3, 5:4, 16:9", "arh_ui_javascript_selection_method": "Aspect Ratios Dropdown", "arh_hide_accordion_by_default": true, "arh_expand_by_default": false, "arh_ui_component_order_key": "MaxDimensionScaler, MinDimensionScaler, PredefinedAspectRatioButtons, PredefinedPercentageButtons", "arh_show_max_width_or_height": false, "arh_max_width_or_height": 1024.0, "arh_show_min_width_or_height": false, "arh_min_width_or_height": 1024.0, "arh_show_predefined_aspect_ratios": false, "arh_predefined_aspect_ratio_use_max_dim": false, "arh_predefined_aspect_ratios": "1:1, 4:3, 16:9, 9:16, 21:9", "arh_show_predefined_percentages": false, "arh_predefined_percentages": "25, 50, 75, 125, 150, 175, 200", "arh_predefined_percentages_display_key": "Incremental/decremental percentage (-50%, +50%)", "e621_prompt_username": "", "e621_prompt_api_key": "", "e621_prompt_user_agent": "sd-webui-e621-prompt (nochnoe)", "e621_prompt_use_proxy": false, "e621_prompt_proxy_url": "", "e621_prompt_excluded_tags": "comic, watermark, text, sign, patreon_logo, internal, censored, censored_genitalia, censored_penis, censored_pussy, censored_text, censored_anus, multiple_poses, multiple_images, dialogue, speech_bubble, english_text, dialogue_box, subtitled, thought_bubble, cutaway, conditional_dnp", "e621_prompt_appended_tags": "", "e621_prompt_replace_underscores": true, "e621_prompt_replace_underscores_in_appended": true, "e621_prompt_artist_prefix": "", "e621_prompt_meta_prefix": "", "e621_prompt_species_prefix": "", "e621_prompt_character_prefix": "", "e621_prompt_lore_prefix": "", "e621_prompt_general_prefix": "", "e621_prompt_copyright_prefix": "", "e621_prompt_invalid_prefix": "", "e621_prompt_rating_prefix": "rating:", "e621_prompt_rating_format": "short", "sam_use_local_groundingdino": false, "promptgen_names": "AUTOMATIC/promptgen-lexart, AUTOMATIC/promptgen-majinai-safe, AUTOMATIC/promptgen-majinai-unsafe", "promptgen_device": "gpu", "sd_checkpoint_hash": "ef3285adea0b7f20b4202b566c968e71cc7d887ac4b990c031f0e98a5a8abf58", "outdir_samples": "", "outdir_txt2img_samples": "H:\SD-GUI-1.5.0\output\txt2img-images", "outdir_img2img_samples": "H:\SD-GUI-1.5.0\output\img2img-images", "outdir_extras_samples": "H:\SD-GUI-1.5.0\output\extras-images", "outdir_grids": "", "outdir_txt2img_grids": "H:\SD-GUI-1.5.0\output\txt2img-grids", "outdir_img2img_grids": "H:\SD-GUI-1.5.0\output\img2img-grids", "outdir_save": "H:\SD-GUI-1.5.0\log\images", "outdir_init_images": "H:\SD-GUI-1.5.0\output\init-images", "samples_save": true, "samples_format": "png", "samples_filename_pattern": "", "save_images_add_number": true, "save_images_replace_action": "Replace", "grid_save": true, "grid_format": "png", "grid_extended_filename": false, "grid_only_if_multiple": true, "grid_prevent_empty_spots": false, "grid_zip_filename_pattern": "", "n_rows": -1, "font": "", "grid_text_active_color": "#000000", "grid_text_inactive_color": "#999999", "grid_background_color": "#ffffff", "save_images_before_face_restoration": false, "save_images_before_highres_fix": false, "save_images_before_color_correction": false, "save_mask": false, "save_mask_composite": false, "jpeg_quality": 80, "webp_lossless": false, "export_for_4chan": true, "img_downscale_threshold": 4.0, "target_side_length": 4000.0, "img_max_size_mp": 200.0, "use_original_name_batch": true, "use_upscaler_name_as_suffix": false, "save_selected_only": true, "save_init_img": false, "temp_dir": "", "clean_temp_dir_at_start": false, "save_incomplete_images": false, "notification_audio": true, "notification_volume": 100, "save_to_dirs": true, "grid_save_to_dirs": true, "use_save_to_dirs_for_ui": false, "directories_filename_pattern": "[date]", "directories_max_prompt_words": 8, "auto_backcompat": true, "use_old_emphasis_implementation": false, "use_old_karras_scheduler_sigmas": false, "no_dpmpp_sde_batch_determinism": false, "use_old_hires_fix_width_height": false, "dont_fix_second_order_samplers_schedule": false, "hires_fix_use_firstpass_conds": false, "use_old_scheduling": false, "use_downcasted_alpha_bar": false, "lora_functional": false, "extra_networks_show_hidden_directories": true, "extra_networks_dir_button_function": false, "extra_networks_hidden_models": "When searched", "extra_networks_default_multiplier": 1, "extra_networks_card_width": 0.0, "extra_networks_card_height": 0.0, "extra_networks_card_text_scale": 1, "extra_networks_card_show_desc": true, "extra_networks_card_description_is_html": false, "extra_networks_card_order_field": "Path", "extra_networks_card_order": "Ascending", "extra_networks_tree_view_default_enabled": false, "extra_networks_add_text_separator": " ", "ui_extra_networks_tab_reorder": "", "textual_inversion_print_at_load": false, "textual_inversion_add_hashes_to_infotext": true, "sd_hypernetwork": "None", "sd_lora": "None", "lora_preferred_name": "Alias from file", "lora_add_hashes_to_infotext": true, "lora_show_all": false, "lora_hide_unknown_for_versions": [], "lora_in_memory_limit": 0, "lora_not_found_warning_console": false, "lora_not_found_gradio_warning": false, "cross_attention_optimization": "Automatic", "s_min_uncond": 0, "token_merging_ratio": 0, "token_merging_ratio_img2img": 0, "token_merging_ratio_hr": 0, "pad_cond_uncond": false, "pad_cond_uncond_v0": false, "persistent_cond_cache": true, "batch_cond_uncond": true, "fp8_storage": "Enable", "cache_fp16_weight": false, "hide_samplers": [ "Heun", "DPM2 a", "DPM++ 2S a", "DPM++ 2M", "DPM++ SDE", "DPM++ 2M Karras", "DPM++ 2M SDE", "LMS", "DPM++ SDE Karras", "DPM++ 2M SDE Heun", "DPM++ 2M SDE Heun Karras", "DPM++ 2M SDE Exponential", "DPM++ 2M SDE Heun Exponential", "DPM++ 2M SDE Karras", "DPM++ 3M SDE", "DPM++ 3M SDE Karras", "DPM++ 3M SDE Exponential", "DPM fast", "DPM adaptive", "LMS Karras", "DPM2 Karras", "DPM2 a Karras", "DPM++ 2S a Karras", "DDIM", "PLMS", "LCM", "DDPM", "DDPM Karras", "LCM Karras" ], "eta_ddim": 0, "eta_ancestral": 1, "ddim_discretize": "uniform", "s_churn": 0, "s_tmin": 0, "s_tmax": 0, "s_noise": 1, "k_sched_type": "Automatic", "sigma_min": 0.0, "sigma_max": 0.0, "rho": 0.0, "eta_noise_seed_delta": 0, "always_discard_next_to_last_sigma": false, "sgm_noise_multiplier": false, "uni_pc_variant": "bh1", "uni_pc_skip_type": "time_uniform", "uni_pc_order": 3, "uni_pc_lower_order_final": true, "sd_noise_schedule": "Default", "sd_checkpoints_limit": 1, "sd_checkpoints_keep_in_cpu": true, "sd_checkpoint_cache": 0, "sd_unet": "Automatic", "enable_quantization": false, "emphasis": "Original", "enable_batch_seeds": true, "comma_padding_backtrack": 20, "upcast_attn": false, "randn_source": "GPU", "tiling": false, "hires_fix_refiner_pass": "second pass", "enable_prompt_comments": true, "sdxl_crop_top": 0.0, "sdxl_crop_left": 0.0, "sdxl_refiner_low_aesthetic_score": 2.5, "sdxl_refiner_high_aesthetic_score": 6.0, "sd_vae_checkpoint_cache": 0, "sd_vae_overrides_per_model_preferences": true, "auto_vae_precision_bfloat16": false, "auto_vae_precision": true, "sd_vae_encode_method": "Full", "sd_vae_decode_method": "Full", "inpainting_mask_weight": 1, "initial_noise_multiplier": 1, "img2img_extra_noise": 0, "img2img_color_correction": false, "img2img_fix_steps": false, "img2img_background_color": "#ffffff", "img2img_editor_height": 720, "img2img_sketch_default_brush_color": "#ffffff", "img2img_inpaint_mask_brush_color": "#ffffff", "img2img_inpaint_sketch_default_brush_color": "#ffffff", "return_mask": false, "return_mask_composite": false, "img2img_batch_show_results_limit": 32, "overlay_inpaint": true, "return_grid": true, "do_not_show_images": false, "js_modal_lightbox": true, "js_modal_lightbox_initially_zoomed": true, "js_modal_lightbox_gamepad": false, "js_modal_lightbox_gamepad_repeat": 250.0, "sd_webui_modal_lightbox_icon_opacity": 1, "sd_webui_modal_lightbox_toolbar_opacity": 0.9, "gallery_height": "", "open_dir_button_choice": "Subdirectory", "enable_pnginfo": true, "save_txt": false, "add_model_name_to_info": true, "add_model_hash_to_info": true, "add_vae_name_to_info": true, "add_vae_hash_to_info": true, "add_user_name_to_info": false, "add_version_to_infotext": true, "disable_weights_auto_swap": true, "infotext_skip_pasting": [], "infotext_styles": "Apply if any", "show_progressbar": true, "live_previews_enable": true, "live_previews_image_format": "jpeg", "show_progress_grid": true, "show_progress_every_n_steps": 1, "show_progress_type": "Approx NN", "live_preview_allow_lowvram_full": false, "live_preview_content": "Combined", "live_preview_refresh_period": 150.0, "live_preview_fast_interrupt": true, "js_live_preview_in_modal_lightbox": false, "keyedit_precision_attention": 0.1, "keyedit_precision_extra": 0.05, "keyedit_delimiters": ".,\/!?%^*;:{}=`~() ", "keyedit_delimiters_whitespace": [ "Tab", "Carriage Return", "Line Feed" ], "keyedit_move": true, "disable_token_counters": false, "include_styles_into_token_counters": true, "extra_options_txt2img": [], "extra_options_img2img": [], "extra_options_cols": 1, "extra_options_accordion": false, "compact_prompt_box": false, "samplers_in_dropdown": true, "dimensions_and_batch_together": true, "sd_checkpoint_dropdown_use_short": false, "hires_fix_show_sampler": false, "hires_fix_show_prompts": false, "txt2img_settings_accordion": false, "img2img_settings_accordion": false, "interrupt_after_current": true, "localization": "zh-Hans (Stable)", "quicksettings_list": [ "sd_model_checkpoint", "sd_vae", "CLIP_stop_at_last_layers" ], "ui_tab_order": [], "hidden_tabs": [], "ui_reorder_list": [], "gradio_theme": "Default", "gradio_themes_cache": true, "show_progress_in_title": true, "send_seed": true, "send_size": true, "api_enable_requests": true, "api_forbid_local_requests": true, "api_useragent": "", "auto_launch_browser": "Local", "enable_console_prompts": false, "show_warnings": false, "show_gradio_deprecation_warnings": true, "memmon_poll_rate": 8, "samples_log_stdout": false, "multiple_tqdm": true, "enable_upscale_progressbar": true, "print_hypernet_extra": false, "list_hidden_files": true, "disable_mmap_load_safetensors": false, "hide_ldm_prints": true, "dump_stacks_on_signal": false, "face_restoration": false, "face_restoration_model": "CodeFormer", "code_former_weight": 0.5, "face_restoration_unload": false, "postprocessing_enable_in_main_ui": [], "postprocessing_operation_order": [], "upscaling_max_images_in_cache": 5, "postprocessing_existing_caption_action": "Ignore", "ESRGAN_tile": 192, "ESRGAN_tile_overlap": 8, "realesrgan_enabled_models": [ "R-ESRGAN 4x+", "R-ESRGAN 4x+ Anime6B" ], "dat_enabled_models": [ "DAT x2", "DAT x3", "DAT x4" ], "DAT_tile": 192, "DAT_tile_overlap": 8, "unload_models_when_training": false, "pin_memory": false, "save_optimizer_state": false, "save_training_settings_to_txt": true, "dataset_filename_word_regex": "", "dataset_filename_join_string": " ", "training_image_repeats_per_epoch": 1, "training_write_csv_every": 500.0, "training_xattention_optimizations": false, "training_enable_tensorboard": false, "training_tensorboard_save_images": false, "training_tensorboard_flush_every": 120.0, "canvas_hotkey_zoom": "Alt", "canvas_hotkey_adjust": "Ctrl", "canvas_hotkey_shrink_brush": "Q", "canvas_hotkey_grow_brush": "W", "canvas_hotkey_move": "F", "canvas_hotkey_fullscreen": "S", "canvas_hotkey_reset": "R", "canvas_hotkey_overlap": "O", "canvas_show_tooltip": true, "canvas_auto_expand": true, "canvas_blur_prompt": false, "canvas_disabled_functions": [ "Overlap" ], "interrogate_keep_models_in_memory": false, "interrogate_return_ranks": false, "interrogate_clip_num_beams": 1, "interrogate_clip_min_length": 24, "interrogate_clip_max_length": 48, "interrogate_clip_dict_limit": 1500.0, "interrogate_clip_skip_categories": [], "interrogate_deepbooru_score_threshold": 0.5, "deepbooru_sort_alpha": false, "deepbooru_use_spaces": true, "deepbooru_escape": true, "deepbooru_filter_tags": "", "sd_model_checkpoint": "Useful\fiamixRebootHNSFW_v80.safetensors [ef3285adea]", "sd_vae": "anything-v4.5.pt", "disabled_extensions": [ "Stable-Diffusion-Webui-Civitai-Helper", "multidiffusion-upscaler-for-automatic1111", "sd-webui-controlnet", "stable-diffusion-webui-localization-zh_CN" ], "disable_all_extensions": "none", "CLIP_stop_at_last_layers": 2, "ch_civiai_api_key": "", "ch_dl_lyco_to_lora": false, "ch_open_url_with_js": true, "ch_hide_buttons": [], "ch_always_display": false, "ch_show_btn_on_thumb": true, "ch_max_size_preview": true, "ch_nsfw_preview_threshold": "Allow All", "ch_dl_webui_metadata": true, "ch_proxy": "", "regprp_debug": false, "regprp_hidepmask": false, "model_desc_to_json": true, "custom_civitai_proxy": "", "cabundle_path_proxy": "", "disable_sll_proxy": false }, "Startup": { "total": 40.217641830444336, "records": { "initial startup": 0.04804253578186035, "prepare environment/checks": 0.016629934310913086, "prepare environment/git version info": 0.1355447769165039, "prepare environment/torch GPU test": 3.1285510063171387, "prepare environment/clone repositores": 0.3350515365600586, "prepare environment/run extensions installers/a1111-sd-webui-tagcomplete": 0.0009999275207519531, "prepare environment/run extensions installers/adetailer": 0.36881089210510254, "prepare environment/run extensions installers/multi-subject-render": 0.3438394069671631, "prepare environment/run extensions installers/OneButtonPrompt": 0.0004990100860595703, "prepare environment/run extensions installers/sd-civitai-browser-plus": 0.3720738887786865, "prepare environment/run extensions installers/sd-forge-layerdiffuse": 0.0, "prepare environment/run extensions installers/sd-webui-aspect-ratio-helper": 0.0005016326904296875, "prepare environment/run extensions installers/sd-webui-e621-prompt": 0.0, "prepare environment/run extensions installers/sd-webui-infinite-image-browsing": 0.9932210445404053, "prepare environment/run extensions installers/sd-webui-prompt-all-in-one": 0.32576918601989746, "prepare environment/run extensions installers/sd-webui-segment-anything": 0.37536096572875977, "prepare environment/run extensions installers/sd_delete_button": 0.34474635124206543, "prepare environment/run extensions installers/stable-diffusion-webui-localization-zh_Hans": 0.0004987716674804688, "prepare environment/run extensions installers/stable-diffusion-webui-promptgen": 0.0, "prepare environment/run extensions installers/stable-diffusion-webui-rembg": 0.323641300201416, "prepare environment/run extensions installers/ultimate-upscale-for-automatic1111": 0.0004999637603759766, "prepare environment/run extensions installers": 3.4504623413085938, "prepare environment/run extensions_builtin installers/canvas-zoom-and-pan": 0.0009999275207519531, "prepare environment/run extensions_builtin installers/extra-options-section": 0.0004999637603759766, "prepare environment/run extensions_builtin installers/forge_legacy_preprocessors": 0.9503567218780518, "prepare environment/run extensions_builtin installers/forge_preprocessor_inpaint": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_marigold": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_normalbae": 0.0010066032409667969, "prepare environment/run extensions_builtin installers/forge_preprocessor_recolor": 0.0005059242248535156, "prepare environment/run extensions_builtin installers/forge_preprocessor_reference": 0.0, "prepare environment/run extensions_builtin installers/forge_preprocessor_revision": 0.0005006790161132812, "prepare environment/run extensions_builtin installers/forge_preprocessor_tile": 0.0005064010620117188, "prepare environment/run extensions_builtin installers/LDSR": 0.0, "prepare environment/run extensions_builtin installers/Lora": 0.0005044937133789062, "prepare environment/run extensions_builtin installers/mobile": 0.0, "prepare environment/run extensions_builtin installers/prompt-bracket-checker": 0.000499725341796875, "prepare environment/run extensions_builtin installers/ScuNET": 0.0005009174346923828, "prepare environment/run extensions_builtin installers/sd_forge_controlllite": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_controlnet": 0.9364960193634033, "prepare environment/run extensions_builtin installers/sd_forge_controlnet_example": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_dynamic_thresholding": 0.0005016326904296875, "prepare environment/run extensions_builtin installers/sd_forge_fooocus_inpaint": 0.0004994869232177734, "prepare environment/run extensions_builtin installers/sd_forge_freeu": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_hypertile": 0.0005009174346923828, "prepare environment/run extensions_builtin installers/sd_forge_ipadapter": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_kohya_hrfix": 0.0005006790161132812, "prepare environment/run extensions_builtin installers/sd_forge_latent_modifier": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_multidiffusion": 0.0004992485046386719, "prepare environment/run extensions_builtin installers/sd_forge_neveroom": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_photomaker": 0.0004999637603759766, "prepare environment/run extensions_builtin installers/sd_forge_sag": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_stylealign": 0.0005002021789550781, "prepare environment/run extensions_builtin installers/sd_forge_svd": 0.0, "prepare environment/run extensions_builtin installers/sd_forge_z123": 0.0004994869232177734, "prepare environment/run extensions_builtin installers/soft-inpainting": 0.0, "prepare environment/run extensions_builtin installers/SwinIR": 0.0004987716674804688, "prepare environment/run extensions_builtin installers": 1.8968777656555176, "prepare environment": 9.027117729187012, "launcher": 0.004500865936279297, "import torch": 8.611764669418335, "import gradio": 1.9042775630950928, "setup paths": 1.4137825965881348, "import ldm": 0.013722658157348633, "import sgm": 0.0, "initialize shared": 0.24996733665466309, "other imports": 0.9595975875854492, "opts onchange": 0.0, "setup SD model": 0.000499725341796875, "setup codeformer": 0.0024995803833007812, "setup gfpgan": 0.17789459228515625, "set samplers": 0.0, "list extensions": 0.014509916305541992, "restore config state file": 0.0, "list SD models": 0.250363826751709, "list localizations": 0.008518457412719727, "load scripts/custom_code.py": 0.032536983489990234, "load scripts/img2imgalt.py": 0.0010004043579101562, "load scripts/loopback.py": 0.0, "load scripts/outpainting_mk_2.py": 0.0004987716674804688, "load scripts/poor_mans_outpainting.py": 0.0004999637603759766, "load scripts/postprocessing_caption.py": 0.0, "load scripts/postprocessing_codeformer.py": 0.0, "load scripts/postprocessing_create_flipped_copies.py": 0.0011374950408935547, "load scripts/postprocessing_focal_crop.py": 0.02891397476196289, "load scripts/postprocessing_gfpgan.py": 0.0, "load scripts/postprocessing_split_oversized.py": 0.0, "load scripts/postprocessing_upscale.py": 0.0010046958923339844, "load scripts/processing_autosized_crop.py": 0.0005066394805908203, "load scripts/prompt_matrix.py": 0.0, "load scripts/prompts_from_file.py": 0.0004990100860595703, "load scripts/sd_upscale.py": 0.0005002021789550781, "load scripts/xyz_grid.py": 0.001505136489868164, "load scripts/ldsr_model.py": 2.2333617210388184, "load scripts/lora_script.py": 0.4897310733795166, "load scripts/scunet_model.py": 0.056514739990234375, "load scripts/swinir_model.py": 0.043027639389038086, "load scripts/hotkey_config.py": 0.0004999637603759766, "load scripts/extra_options_section.py": 0.0005009174346923828, "load scripts/legacy_preprocessors.py": 0.03854990005493164, "load scripts/preprocessor_inpaint.py": 0.03499579429626465, "load scripts/preprocessor_marigold.py": 0.4463069438934326, "load scripts/preprocessor_normalbae.py": 0.02001786231994629, "load scripts/preprocessor_recolor.py": 0.0, "load scripts/forge_reference.py": 0.0004992485046386719, "load scripts/preprocessor_revision.py": 0.0005004405975341797, "load scripts/preprocessor_tile.py": 0.0004999637603759766, "load scripts/forge_controllllite.py": 0.04002094268798828, "load scripts/controlnet.py": 0.8486363887786865, "load scripts/xyz_grid_support.py": 0.0005016326904296875, "load scripts/sd_forge_controlnet_example.py": 0.0004990100860595703, "load scripts/forge_dynamic_thresholding.py": 0.012624740600585938, "load scripts/forge_fooocus_inpaint.py": 0.0005030632019042969, "load scripts/forge_freeu.py": 0.013515233993530273, "load scripts/forge_hypertile.py": 0.011499643325805664, "load scripts/forge_ipadapter.py": 0.01650857925415039, "load scripts/kohya_hrfix.py": 0.011000633239746094, "load scripts/forge_latent_modifier.py": 0.01250004768371582, "load scripts/forge_multidiffusion.py": 0.02551579475402832, "load scripts/forge_never_oom.py": 0.0, "load scripts/forge_photomaker.py": 0.011500120162963867, "load scripts/forge_sag.py": 0.011000633239746094, "load scripts/forge_stylealign.py": 0.0004992485046386719, "load scripts/forge_svd.py": 0.06819725036621094, "load scripts/forge_z123.py": 0.057098388671875, "load scripts/soft_inpainting.py": 0.0004999637603759766, "load scripts/api.py": 2.922767162322998, "load scripts/onebuttonprompt.py": 0.007009267807006836, "load scripts/model_keyword_support.py": 0.05104231834411621, "load scripts/shared_paths.py": 0.0030031204223632812, "load scripts/tag_autocomplete_helper.py": 0.3452763557434082, "load scripts/!adetailer.py": 0.23127245903015137, "load scripts/multirender.py": 0.0010004043579101562, "load scripts/simple_depthmap.py": 0.02803182601928711, "load scripts/civitai_api.py": 0.25066494941711426, "load scripts/civitai_download.py": 0.0025005340576171875, "load scripts/civitai_file_manage.py": 0.0009984970092773438, "load scripts/civitai_global.py": 0.0, "load scripts/civitai_gui.py": 0.12203669548034668, "load scripts/forge_layerdiffusion.py": 0.014508485794067383, "load scripts/sd_webui_aspect_ratio_helper.py": 0.09602785110473633, "load scripts/e621_prompt.py": 0.04650688171386719, "load scripts/iib_setup.py": 0.20460891723632812, "load scripts/on_app_started.py": 0.1627955436706543, "load scripts/auto.py": 0.000499725341796875, "load scripts/dino.py": 0.0005004405975341797, "load scripts/process_params.py": 0.0004994869232177734, "load scripts/sam.py": 0.09472894668579102, "load scripts/sd_delete_button.py": 0.090301513671875, "load scripts/promptgen.py": 0.13359737396240234, "load scripts/postprocessing_rembg.py": 0.0005004405975341797, "load scripts/ultimate-upscale.py": 0.000499725341796875, "load scripts/comments.py": 0.053521156311035156, "load scripts/refiner.py": 0.0004994869232177734, "load scripts/seed.py": 0.0004999637603759766, "load scripts": 9.44143033027649, "load upscalers": 0.002000093460083008, "refresh VAE": 0.0055119991302490234, "refresh textual inversion templates": 0.0005002021789550781, "scripts list_optimizers": 0.03202629089355469, "scripts list_unets": 0.0, "reload hypernetworks": 0.0005004405975341797, "initialize extra networks": 0.19240069389343262, "scripts before_ui_callback": 0.0025110244750976562, "create ui": 2.906383514404297, "gradio launch": 3.22060227394104, "add APIs": 0.6005697250366211, "app_started_callback/lora_script.py": 0.0, "app_started_callback/controlnet.py": 0.0015134811401367188, "app_started_callback/api.py": 0.008507251739501953, "app_started_callback/tag_autocomplete_helper.py": 0.001998424530029297, "app_started_callback/!adetailer.py": 0.0, "app_started_callback/iib_setup.py": 0.019042015075683594, "app_started_callback/on_app_started.py": 1.1590847969055176, "app_started_callback": 1.1901459693908691 } }, "Packages": [ "absl-py==2.1.0", "accelerate==0.21.0", "addict==2.4.0", "aenum==3.1.15", "aiofiles==23.2.1", "aiohttp==3.9.3", "aiosignal==1.3.1", "albumentations==1.4.1", "aliyun-python-sdk-alimt==3.2.0", "aliyun-python-sdk-core==2.13.10", "altair==5.2.0", "antlr4-python3-runtime==4.9.3", "anyio==3.7.1", "async-timeout==4.0.3", "attrs==23.2.0", "basicsr==1.4.2", "beautifulsoup4==4.12.3", "blendmodes==2022", "boto3==1.34.60", "botocore==1.34.60", "certifi==2024.2.2", "cffi==1.16.0", "chardet==5.2.0", "charset-normalizer==3.3.2", "clean-fid==0.1.35", "click==8.1.7", "clip==1.0", "colorama==0.4.6", "coloredlogs==15.0.1", "colorlog==6.8.2", "contourpy==1.2.0", "cryptography==42.0.5", "cssselect2==0.7.0", "cycler==0.12.1", "cython==3.0.9", "defusedxml==0.7.1", "deprecation==2.1.0", "depth-anything==2024.1.22.0", "diffusers==0.25.0", "dill==0.3.8", "distro==1.9.0", "easydict==1.13", "einops==0.4.1", "embreex==2.17.7.post4", "exceptiongroup==1.2.0", "facexlib==0.3.0", "fake-useragent==1.5.0", "fastapi==0.94.0", "ffmpy==0.3.2", "filelock==3.13.1", "filterpy==1.4.5", "flatbuffers==24.3.7", "fonttools==4.49.0", "frozenlist==1.4.1", "fsspec==2024.2.0", "ftfy==6.1.3", "future==1.0.0", "fvcore==0.1.5.post20221221", "gitdb==4.0.11", "gitpython==3.1.32", "gradio-client==0.5.0", "gradio==3.41.2", "grpcio==1.62.1", "h11==0.12.0", "handrefinerportable==2024.2.12.0", "httpcore==0.15.0", "httpx==0.24.1", "huggingface-hub==0.21.4", "humanfriendly==10.0", "idna==3.6", "imageio==2.34.0", "importlib-metadata==7.0.2", "importlib-resources==6.1.3", "inflection==0.5.1", "insightface==0.7.3", "iopath==0.1.9", "jax==0.4.25", "jinja2==3.1.3", "jmespath==0.10.0", "joblib==1.3.2", "jsonmerge==1.8.0", "jsonschema-specifications==2023.12.1", "jsonschema==4.21.1", "kiwisolver==1.4.5", "kornia==0.6.7", "lark==1.1.2", "lazy-loader==0.3", "lightning-utilities==0.10.1", "llvmlite==0.42.0", "lmdb==1.4.1", "lxml==5.1.0", "mapbox-earcut==1.0.1", "markdown-it-py==3.0.0", "markdown==3.5.2", "markupsafe==2.1.5", "matplotlib==3.8.3", "mdurl==0.1.2", "mediapipe==0.10.11", "ml-dtypes==0.3.2", "mpmath==1.3.0", "multidict==6.0.5", "multiprocess==0.70.16", "networkx==3.2.1", "numba==0.59.0", "numpy==1.26.2", "omegaconf==2.2.3", "onnx==1.15.0", "onnxruntime==1.17.1", "open-clip-torch==2.20.0", "openai==1.13.3", "opencv-contrib-python==4.9.0.80", "opencv-python-headless==4.9.0.80", "opencv-python==4.9.0.80", "opt-einsum==3.3.0", "orjson==3.9.15", "packaging==24.0", "pandas==2.2.1", "pathos==0.3.2", "piexif==1.1.3", "pillow==9.5.0", "pip==23.0.1", "platformdirs==4.2.0", "pooch==1.8.1", "portalocker==2.8.2", "pox==0.3.4", "ppft==1.7.6.8", "prettytable==3.10.0", "protobuf==3.20.3", "psutil==5.9.5", "py-cpuinfo==9.0.0", "pycocotools==2.0.7", "pycollada==0.8", "pycparser==2.21", "pydantic==1.10.14", "pydub==0.25.1", "pyexecjs==1.5.1", "pygments==2.17.2", "pymatting==1.1.12", "pyparsing==3.1.2", "pyreadline3==3.4.1", "pysocks==1.7.1", "python-dateutil==2.9.0.post0", "python-dotenv==1.0.1", "python-multipart==0.0.9", "pytorch-lightning==1.9.4", "pytz==2024.1", "pywavelets==1.5.0", "pywin32==306", "pyyaml==6.0.1", "referencing==0.33.0", "regex==2023.12.25", "rembg==2.0.50", "reportlab==4.1.0", "requests==2.31.0", "resize-right==0.0.2", "rich==13.7.1", "rpds-py==0.18.0", "rtree==1.2.0", "s3transfer==0.10.0", "safetensors==0.4.2", "scikit-image==0.21.0", "scikit-learn==1.4.1.post1", "scipy==1.12.0", "seaborn==0.13.2", "segment-anything==1.0", "semantic-version==2.10.0", "send2trash==1.8.2", "sentencepiece==0.2.0", "setuptools==65.5.0", "shapely==2.0.3", "six==1.16.0", "smmap==5.0.1", "sniffio==1.3.1", "sounddevice==0.4.6", "soupsieve==2.5", "spandrel==0.1.6", "starlette==0.26.1", "supervision==0.18.0", "svg.path==6.3", "svglib==1.5.1", "sympy==1.12", "tabulate==0.9.0", "tb-nightly==2.17.0a20240312", "tensorboard-data-server==0.7.2", "termcolor==2.4.0", "thop==0.1.1.post2209072238", "threadpoolctl==3.3.0", "tifffile==2024.2.12", "timm==0.9.16", "tinycss2==1.2.1", "tokenizers==0.13.3", "tomesd==0.1.3", "tomli==2.0.1", "toolz==0.12.1", "torch==2.1.2+cu121", "torchdiffeq==0.2.3", "torchmetrics==1.3.1", "torchsde==0.2.6", "torchvision==0.16.2+cu121", "tqdm==4.66.2", "trampoline==0.1.2", "transformers==4.30.2", "trimesh==4.2.0", "typing-extensions==4.10.0", "tzdata==2024.1", "ultralytics==8.1.27", "urllib3==2.0.7", "uvicorn==0.28.0", "vhacdx==0.0.5", "wcwidth==0.2.13", "webencodings==0.5.1", "websockets==11.0.3", "werkzeug==3.0.1", "xatlas==0.0.9", "xformers==0.0.23.post1", "xxhash==3.4.1", "yacs==0.1.8", "yapf==0.40.2", "yarl==1.9.4", "zipp==3.17.0", "zipunicode==1.1.1" ] } '+
Console logs
When I using softedge_pidinet:
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
result = preprocessor(
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
from annotator.pidinet import apply_pidinet
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'
-------------------
When I using softedge_teed:
2024-03-13 00:01:47,323 - ControlNet - INFO - Preview Resolution = 640
Downloading: "https://huggingface.co/bdsqlsz/qinglong_controlnet-lllite/resolve/main/Annotators/7_model.pth" to I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\downloads\TEED\7_model.pth
Traceback (most recent call last):
File "C:\Program Files\Python310\lib\urllib\request.py", line 1348, in do_open
h.request(req.get_method(), req.selector, req.data, headers,
File "C:\Program Files\Python310\lib\http\client.py", line 1283, in request
self._send_request(method, url, body, headers, encode_chunked)
File "C:\Program Files\Python310\lib\http\client.py", line 1329, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "C:\Program Files\Python310\lib\http\client.py", line 1278, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "C:\Program Files\Python310\lib\http\client.py", line 1038, in _send_output
self.send(msg)
File "C:\Program Files\Python310\lib\http\client.py", line 976, in send
self.connect()
File "C:\Program Files\Python310\lib\http\client.py", line 1455, in connect
self.sock = self._context.wrap_socket(self.sock,
File "C:\Program Files\Python310\lib\ssl.py", line 513, in wrap_socket
return self.sslsocket_class._create(
File "C:\Program Files\Python310\lib\ssl.py", line 1071, in _create
self.do_handshake()
File "C:\Program Files\Python310\lib\ssl.py", line 1342, in do_handshake
self._sslobj.do_handshake()
FileNotFoundError: [Errno 2] No such file or directory
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
result = preprocessor(
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 696, in te_hed
model_te_hed = TEEDDector()
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\teed\__init__.py", line 30, in __init__
model_path = load_model(
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\util.py", line 18, in load_model
load_file_from_url(remote_url, model_dir=model_dir)
File "I:\stable-diffusion-webui-forge\modules\modelloader.py", line 39, in load_file_from_url
download_url_to_file(url, cached_file, progress=progress)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\hub.py", line 620, in download_url_to_file
u = urlopen(req)
File "C:\Program Files\Python310\lib\urllib\request.py", line 216, in urlopen
return opener.open(url, data, timeout)
File "C:\Program Files\Python310\lib\urllib\request.py", line 519, in open
response = self._open(req, data)
File "C:\Program Files\Python310\lib\urllib\request.py", line 536, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "C:\Program Files\Python310\lib\urllib\request.py", line 496, in _call_chain
result = func(*args)
File "C:\Program Files\Python310\lib\urllib\request.py", line 1391, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "C:\Program Files\Python310\lib\urllib\request.py", line 1351, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 2] No such file or directory>
---------------------
When I using scribble_pidinet:
2024-03-13 00:02:11,665 - ControlNet - INFO - Preview Resolution = 640
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
result = preprocessor(
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 362, in scribble_pidinet
result, _ = pidinet(img, res)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
from annotator.pidinet import apply_pidinet
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'
2024-03-13 00:02:41,989 - ControlNet - INFO - Preview Resolution = 640
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
result = preprocessor(
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 362, in scribble_pidinet
result, _ = pidinet(img, res)
File "I:\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 335, in pidinet
from annotator.pidinet import apply_pidinet
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\annotator\pidinet\__init__.py", line 9, in <module>
from scripts.utils import load_state_dict
ModuleNotFoundError: No module named 'scripts.utils'
------------------------
When I using lineart_coarse:
*** Error running process: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 798, in process
script.process(p, *script_args)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 450, in process
self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 253, in process_unit_after_click_generate
input_list, resize_mode = self.get_input_data(p, unit, preprocessor)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 192, in get_input_data
mask = HWC3(np.asarray(a1111_i2i_mask))
File "I:\stable-diffusion-webui-forge\modules_forge\forge_util.py", line 13, in HWC3
assert x.dtype == np.uint8
AssertionError
---
To load target model AutoencoderKL
Begin to load 1 model
*** Error running process_before_every_sampling: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 830, in process_before_every_sampling
script.process_before_every_sampling(p, *script_args, **kwargs)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 457, in process_before_every_sampling
self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
KeyError: 0
---
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.34 seconds
100%|██████████████████████████████████████████████████████████████████████████████████| 16/16 [00:02<00:00, 7.30it/s]
*** Error running postprocess_batch_list: I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "I:\stable-diffusion-webui-forge\modules\scripts.py", line 854, in postprocess_batch_list
script.postprocess_batch_list(p, pp, *script_args, **kwargs)
File "I:\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "I:\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 463, in postprocess_batch_list
self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
KeyError: 0
---
------------------------------------
Additional information
The vast majority of preprocessors are usable for me, with only a few of them reporting errors. There were no related errors when using the regular Controlnet instead of the Forge version on a regular AAAA Webui
By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet
By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet
I had a similar error with the depth_midas preprocessor in SF:
venv "C:\Code\stable-diffusion-webui-forge\venv\Scripts\Python.exe"
Python 3.10.9 (tags/v3.10.9:1dd9be6, Dec 6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]
Version: f0.0.17v1.8.0rc-latest-276-g29be1da7
Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7
Launching Web UI with arguments: --always-gpu --pin-shared-memory --cuda-malloc --cuda-stream
Using cudaMallocAsync backend.
Total VRAM 10239 MB, total RAM 32448 MB
Set vram state to: HIGH_VRAM
Always pin shared GPU memory
Device: cuda:0 NVIDIA GeForce RTX 3080 : cudaMallocAsync
VAE dtype: torch.bfloat16
CUDA Stream Activated: True
Using pytorch cross attention
ControlNet preprocessor location: C:\Code\stable-diffusion-webui-forge\models\ControlNetPreprocessor
Loading weights [be9b9fccd2] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\lightningFusionXL_v12Experimental.safetensors
2024-05-05 07:57:57,937 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL: http://127.0.0.1:7860
To create a public link, set `share=True` in `launch()`.
model_type EPS
UNet ADM Dimension 2816
Startup time: 25.8s (prepare environment: 4.8s, import torch: 5.4s, import gradio: 1.6s, setup paths: 1.5s, initialize shared: 1.1s, other imports: 1.0s, list SD models: 0.1s, load scripts: 3.6s, create ui: 5.3s, gradio launch: 1.4s).
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale', 'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids'}
loaded straight to GPU
To load target model SDXL
Begin to load 1 model
Moving model(s) has taken 0.04 seconds
To load target model SDXLClipModel
Begin to load 1 model
Moving model(s) has taken 0.72 seconds
Model loaded in 65.5s (load weights from disk: 5.9s, forge load real models: 58.3s, calculate empty prompt: 1.1s).
Traceback (most recent call last):
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in <listcomp>
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in <dictcomp>
self.items = {x["name"]: x for x in items_list}
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
Traceback (most recent call last):
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in <listcomp>
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "C:\Code\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in <dictcomp>
self.items = {x["name"]: x for x in items_list}
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
Calculating sha256 for C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\RevRPG.safetensors: 0f584388d8681397851ae63d68afd692a49f381bca28fae9d6eb27b37e8ae37a
Loading weights [0f584388d8] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\RevRPG.safetensors
model_type EPS
UNet ADM Dimension 0
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['model_ema.decay', 'model_ema.num_updates'])
loaded straight to GPU
To load target model BaseModel
Begin to load 1 model
Moving model(s) has taken 0.03 seconds
To load target model SD1ClipModel
Begin to load 1 model
Moving model(s) has taken 0.25 seconds
Model loaded in 26.5s (unload existing model: 0.3s, calculate hash: 22.5s, load weights from disk: 0.2s, forge load real models: 2.9s, load VAE: 0.3s, calculate empty prompt: 0.3s).
2024-05-05 08:34:43,689 - ControlNet - INFO - Preview Resolution = 720
Downloading: "https://huggingface.co/lllyasviel/ControlNet/resolve/main/annotator/ckpts/dpt_hybrid-midas-501f0c75.pt" to C:\Code\stable-diffusion-webui-forge\models\ControlNetPreprocessor\midas\dpt_hybrid-midas-501f0c75.pt
100%|███████████████████████████████████████████████████████████████████████████████| 470M/470M [00:16<00:00, 29.9MB/s]
Traceback (most recent call last):
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\sd_forge_controlnet\lib_controlnet\controlnet_ui\controlnet_ui_group.py", line 847, in run_annotator
result = preprocessor(
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\scripts\legacy_preprocessors.py", line 103, in __call__
result, is_image = self.call_function(img=input_image, res=resolution, thr_a=slider_1, thr_b=slider_2, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\legacy_preprocessors\preprocessor.py", line 218, in midas
result, _ = model_midas(img, a)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\__init__.py", line 31, in apply_midas
depth = model(image_depth)[0]
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\api.py", line 179, in forward
prediction = self.model(x)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\dpt_depth.py", line 108, in forward
return super().forward(x).squeeze(dim=1)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\dpt_depth.py", line 71, in forward
layer_1, layer_2, layer_3, layer_4 = forward_vit(self.pretrained, x)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\vit.py", line 59, in forward_vit
glob = pretrained.model.forward_flex(x)
File "C:\Code\stable-diffusion-webui-forge\extensions-builtin\forge_legacy_preprocessors\annotator\midas\midas\vit.py", line 127, in forward_flex
x = self.patch_embed.backbone(x)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\models\resnetv2.py", line 475, in forward
x = self.forward_features(x)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\models\resnetv2.py", line 463, in forward_features
x = self.stem(x)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\container.py", line 215, in forward
input = module(input)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\layers\pool2d_same.py", line 52, in forward
x = pad_same(x, self.kernel_size, self.stride, value=-float('inf'))
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\timm\layers\padding.py", line 55, in pad_same
x = F.pad(x, (pad_w // 2, pad_w - pad_w // 2, pad_h // 2, pad_h - pad_h // 2), value=value)
torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated : 9.23 GiB
Requested : 36.19 MiB
Device limit : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
: 17179869184.00 GiB
Loading weights [fd9cdc26c3] from C:\Code\stable-diffusion-webui-forge\models\Stable-diffusion\dynavisionXLAllInOneStylized_release0557Bakedvae.safetensors
2024-05-05 08:35:37,969 - ControlNet - INFO - Preview Resolution = 720
Automatic Memory Management: 11 Modules in 1.32 seconds.
Traceback (most recent call last):
File "C:\Code\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 37, in loop
task.work()
File "C:\Code\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 26, in work
self.result = self.func(*self.args, **self.kwargs)
File "C:\Code\stable-diffusion-webui-forge\modules\sd_models.py", line 628, in reload_model_weights
return load_model(info)
File "C:\Code\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 154, in load_model_for_a1111
forge_objects = load_checkpoint_guess_config(
File "C:\Code\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 104, in load_checkpoint_guess_config
model = model_config.get_model(sd, "model.diffusion_model.", device=inital_load_device)
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\supported_models.py", line 176, in get_model
out = model_base.SDXL(self, model_type=self.model_type(state_dict, prefix), device=device)
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\model_base.py", line 299, in __init__
super().__init__(model_config, model_type, device=device)
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\model_base.py", line 56, in __init__
self.diffusion_model = UNetModel(**unet_config, device=device, operations=operations)
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 754, in __init__
get_resblock(
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 613, in get_resblock
return ResBlock(
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\ldm\modules\diffusionmodules\openaimodel.py", line 224, in __init__
operations.conv_nd(dims, self.out_channels, self.out_channels, kernel_size, padding=padding, dtype=dtype, device=device)
File "C:\Code\stable-diffusion-webui-forge\ldm_patched\modules\ops.py", line 168, in conv_nd
return s.Conv2d(*args, **kwargs)
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\conv.py", line 447, in __init__
super().__init__(
File "C:\Code\stable-diffusion-webui-forge\venv\lib\site-packages\torch\nn\modules\conv.py", line 134, in __init__
self.weight = Parameter(torch.empty(
torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated : 9.26 GiB
Requested : 28.12 MiB
Device limit : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
: 17179869184.00 GiB
Allocation on device 0 would exceed allowed memory. (out of memory)
Currently allocated : 9.26 GiB
Requested : 28.12 MiB
Device limit : 10.00 GiB
Free (according to CUDA): 0 bytes
PyTorch limit (set by user-supplied memory fraction)
: 17179869184.00 GiB
@lipeng1109
By the way,how do i use normal sd-webui-controlnet rather than sd_forge_controlnet? The webui always force uncheck sd-webui-controlnet
You don't. It's not built for SF, since SF has CN built into it and it also appears to be split up based on the CN function, such as Inpainting, regular ControlNet, etc.
If you want to use regular ControlNet, go to regular SD (Auto1111). You might as well try to run Photoshop in Linux or a PS4 game in your XBox.
I've seen extensions such as Deforum version for both SF and A1111 work in Forge, but that's not a built in repo from the same dev like this. If you weren't aware, ControlNet, for Stable Forge and FoOocus were all developed by the same devs.
