diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

create_dynamic_module infinite recursion when setting HF_HOME using relative path

Open luocfprime opened this issue 1 year ago • 5 comments

Describe the bug

create_dynamic_module infinite recursion when setting HF_HOME using relative path

Reproduction

import os
os.environ["HF_HOME"] = ".cache/huggingface"

from diffusers.utils.dynamic_modules_utils import DIFFUSERS_DYNAMIC_MODULE_NAME, create_dynamic_module
from diffusers.utils.constants import HF_HOME

if __name__ == "__main__":
    print(f"HF_HOME: {HF_HOME}")
    full_submodule = DIFFUSERS_DYNAMIC_MODULE_NAME + os.path.sep + "local"
    create_dynamic_module(full_submodule)

Logs

HF_HOME: .cache/huggingface
Traceback (most recent call last):
  File "/Users/luochaofan/projects/diffusers/_dynamic_modules.py", line 10, in <module>
    create_dynamic_module(full_submodule)
  File "/Users/luochaofan/projects/diffusers/src/diffusers/utils/dynamic_modules_utils.py", line 71, in create_dynamic_module
    create_dynamic_module(dynamic_module_path.parent)
  File "/Users/luochaofan/projects/diffusers/src/diffusers/utils/dynamic_modules_utils.py", line 71, in create_dynamic_module
    create_dynamic_module(dynamic_module_path.parent)
  File "/Users/luochaofan/projects/diffusers/src/diffusers/utils/dynamic_modules_utils.py", line 71, in create_dynamic_module
    create_dynamic_module(dynamic_module_path.parent)
  [Previous line repeated 52 more times]
  File "/Users/luochaofan/projects/diffusers/src/diffusers/utils/dynamic_modules_utils.py", line 70, in create_dynamic_module
    if not dynamic_module_path.parent.exists():
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/pathlib.py", line 1414, in exists
    self.stat()
  File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/pathlib.py", line 1222, in stat
    return self._accessor.stat(self)
OSError: [Errno 63] File name too long: '.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules/.cache/huggingface/modules'

System Info

diffusers 0.28.0

Who can help?

No response

luocfprime avatar Jun 09 '24 05:06 luocfprime

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Sep 14 '24 15:09 github-actions[bot]

having the same issue when trying to load a community pipeline with

DiffusionPipeline.from_pretrained(
                    'path_to_model',
                    custom_pipeline="pipeline_flux_differential_img2img"  # community pipeline: https://github.com/huggingface/diffusers/blob/main/examples/community/pipeline_flux_differential_img2img.py
                )

OSError: [Errno 36] File name too long: 'checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules/checkpoints/modules'

Infinite recursion doing create_dynamic_module(dynamic_module_path.parent)

Clement-Lelievre avatar Oct 15 '24 09:10 Clement-Lelievre

cc @sayakpaul

a-r-r-o-w avatar Oct 15 '24 20:10 a-r-r-o-w

Seems to be getting fixed in https://github.com/huggingface/diffusers/pull/8442/.

sayakpaul avatar Oct 16 '24 02:10 sayakpaul

Seems to be getting fixed in #8442.

You are right.

But I accidentally added an extra commit. Only the first commit in the PR is valid, and for some reasons it hasn't been merged yet.

luocfprime avatar Oct 16 '24 12:10 luocfprime

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Nov 09 '24 15:11 github-actions[bot]