TeaCache icon indicating copy to clipboard operation
TeaCache copied to clipboard

Floating point exception (core dumped)?

Open buptmengjj opened this issue 5 months ago • 0 comments

When I used TeaCache to accerate the model of FLUX1.dev,the error "Float point exception (core dumped)" occured. How to solve it? The Inference code are " FluxTransformer2DModel.forward = teacache_forward num_inference_steps = 4 seed = 1997 guidance_scale = 0.0 height = 720 width = 1280 prompt = "An image of a squirrel in Picasso style" pipeline = DiffusionPipeline.from_pretrained("/workspace/mengjj/models/AIGC/FLUX.1-schnell", torch_dtype=torch.float16)

pipeline = DiffusionPipeline.from_pretrained("/workspace/mengjj/models/FLUX.1-dev", torch_dtype=torch.float16)

pipeline.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power

TeaCache

pipeline.transformer.class.enable_teacache = True pipeline.transformer.class.cnt = 0 pipeline.transformer.class.num_steps = num_inference_steps pipeline.transformer.class.rel_l1_thresh = 0.25 # 0.25 for 1.5x speedup, 0.4 for 1.8x speedup, 0.6 for 2.0x speedup, 0.8 for 2.25x speedup pipeline.transformer.class.accumulated_rel_l1_distance = 0 pipeline.transformer.class.previous_modulated_input = None pipeline.transformer.class.previous_residual = None

pipeline.to("cuda") img = pipeline( prompt, num_inference_steps=num_inference_steps, guidance_scale=guidance_scale, height=height, width=width, generator=torch.Generator("cpu").manual_seed(seed) ).images[0] img.save("{}.png".format('TeaCache_' + prompt))" and my environment are "_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
accelerate 1.9.0 pypi_0 pypi annotated-types 0.7.0 pypi_0 pypi antlr4-python3-runtime 4.9.3 pypi_0 pypi anyio 4.9.0 pypi_0 pypi attrs 25.3.0 pypi_0 pypi bcrypt 4.3.0 pypi_0 pypi beautifulsoup4 4.13.4 pypi_0 pypi bitsandbytes 0.46.1 pypi_0 pypi bs4 0.0.2 pypi_0 pypi bzip2 1.0.8 h5eee18b_6
ca-certificates 2025.2.25 h06a4308_0
certifi 2025.7.14 pypi_0 pypi cffi 1.17.1 pypi_0 pypi cfgv 3.4.0 pypi_0 pypi charset-normalizer 3.4.2 pypi_0 pypi click 8.2.1 pypi_0 pypi colossalai 0.4.0 pypi_0 pypi contexttimer 0.3.3 pypi_0 pypi contourpy 1.3.2 pypi_0 pypi cryptography 45.0.5 pypi_0 pypi cycler 0.12.1 pypi_0 pypi decorator 5.2.1 pypi_0 pypi deprecated 1.2.18 pypi_0 pypi diffusers 0.34.0 pypi_0 pypi distlib 0.3.9 pypi_0 pypi einops 0.8.1 pypi_0 pypi exceptiongroup 1.3.0 pypi_0 pypi expat 2.7.1 h6a678d5_0
fabric 3.2.2 pypi_0 pypi fastapi 0.116.1 pypi_0 pypi filelock 3.18.0 pypi_0 pypi fonttools 4.59.0 pypi_0 pypi fsspec 2025.7.0 pypi_0 pypi ftfy 6.3.1 pypi_0 pypi galore-torch 1.0 pypi_0 pypi google 3.0.0 pypi_0 pypi h11 0.16.0 pypi_0 pypi hf-xet 1.1.5 pypi_0 pypi huggingface-hub 0.33.4 pypi_0 pypi identify 2.6.12 pypi_0 pypi idna 3.10 pypi_0 pypi imageio 2.37.0 pypi_0 pypi imageio-ffmpeg 0.6.0 pypi_0 pypi importlib-metadata 8.7.0 pypi_0 pypi invoke 2.2.0 pypi_0 pypi jinja2 3.1.6 pypi_0 pypi jsonschema 4.24.0 pypi_0 pypi jsonschema-specifications 2025.4.1 pypi_0 pypi kiwisolver 1.4.8 pypi_0 pypi ld_impl_linux-64 2.40 h12ee557_0
libffi 3.4.4 h6a678d5_1
libgcc-ng 11.2.0 h1234567_1
libgomp 11.2.0 h1234567_1
libstdcxx-ng 11.2.0 h1234567_1
libuuid 1.41.5 h5eee18b_0
libxcb 1.17.0 h9b100fa_0
markdown-it-py 3.0.0 pypi_0 pypi markupsafe 3.0.2 pypi_0 pypi matplotlib 3.10.3 pypi_0 pypi mdurl 0.1.2 pypi_0 pypi mpmath 1.3.0 pypi_0 pypi msgpack 1.1.1 pypi_0 pypi ncurses 6.4 h6a678d5_0
networkx 3.4.2 pypi_0 pypi ninja 1.11.1.4 pypi_0 pypi nodeenv 1.9.1 pypi_0 pypi numpy 1.26.4 pypi_0 pypi nvidia-cublas-cu12 12.1.3.1 pypi_0 pypi nvidia-cuda-cupti-cu12 12.1.105 pypi_0 pypi nvidia-cuda-nvrtc-cu12 12.1.105 pypi_0 pypi nvidia-cuda-runtime-cu12 12.1.105 pypi_0 pypi nvidia-cudnn-cu12 8.9.2.26 pypi_0 pypi nvidia-cufft-cu12 11.0.2.54 pypi_0 pypi nvidia-curand-cu12 10.3.2.106 pypi_0 pypi nvidia-cusolver-cu12 11.4.5.107 pypi_0 pypi nvidia-cusparse-cu12 12.1.0.106 pypi_0 pypi nvidia-nccl-cu12 2.19.3 pypi_0 pypi nvidia-nvjitlink-cu12 12.9.86 pypi_0 pypi nvidia-nvtx-cu12 12.1.105 pypi_0 pypi omegaconf 2.3.0 pypi_0 pypi openssl 3.0.16 h5eee18b_0
packaging 25.0 pypi_0 pypi paramiko 3.5.1 pypi_0 pypi peft 0.13.2 pypi_0 pypi pillow 11.3.0 pypi_0 pypi pip 25.1 pyhc872135_2
platformdirs 4.3.8 pypi_0 pypi plumbum 1.9.0 pypi_0 pypi pre-commit 4.2.0 pypi_0 pypi protobuf 6.31.1 pypi_0 pypi psutil 7.0.0 pypi_0 pypi pthread-stubs 0.3 h0ce48e5_1
pycparser 2.22 pypi_0 pypi pydantic 2.11.7 pypi_0 pypi pydantic-core 2.33.2 pypi_0 pypi pygments 2.19.2 pypi_0 pypi pynacl 1.5.0 pypi_0 pypi pyparsing 3.2.3 pypi_0 pypi python 3.10.18 h1a3bd86_0
python-dateutil 2.9.0.post0 pypi_0 pypi pyyaml 6.0.2 pypi_0 pypi ray 2.47.1 pypi_0 pypi readline 8.2 h5eee18b_0
referencing 0.36.2 pypi_0 pypi regex 2024.11.6 pypi_0 pypi requests 2.32.4 pypi_0 pypi rich 14.0.0 pypi_0 pypi rpds-py 0.26.0 pypi_0 pypi rpyc 6.0.0 pypi_0 pypi safetensors 0.5.3 pypi_0 pypi sentencepiece 0.2.0 pypi_0 pypi setuptools 78.1.1 py310h06a4308_0
six 1.17.0 pypi_0 pypi sniffio 1.3.1 pypi_0 pypi some-package 0.1 pypi_0 pypi soupsieve 2.7 pypi_0 pypi sqlite 3.50.2 hb25bd0a_0
starlette 0.47.1 pypi_0 pypi sympy 1.14.0 pypi_0 pypi timm 1.0.17 pypi_0 pypi tk 8.6.14 h993c535_1
tokenizers 0.21.2 pypi_0 pypi torch 2.2.2 pypi_0 pypi torchvision 0.17.2 pypi_0 pypi tqdm 4.67.1 pypi_0 pypi transformers 4.53.2 pypi_0 pypi triton 2.2.0 pypi_0 pypi typing-extensions 4.14.1 pypi_0 pypi typing-inspection 0.4.1 pypi_0 pypi tzdata 2025b h04d1e81_0
urllib3 2.5.0 pypi_0 pypi uvicorn 0.29.0 pypi_0 pypi virtualenv 20.31.2 pypi_0 pypi wcwidth 0.2.13 pypi_0 pypi wheel 0.45.1 py310h06a4308_0
wrapt 1.17.2 pypi_0 pypi xorg-libx11 1.8.12 h9b100fa_1
xorg-libxau 1.0.12 h9b100fa_0
xorg-libxdmcp 1.1.5 h9b100fa_0
xorg-xorgproto 2024.1 h5eee18b_1
xz 5.6.4 h5eee18b_1
zipp 3.23.0 pypi_0 pypi zlib 1.2.13 h5eee18b_1
"

buptmengjj avatar Jul 21 '25 01:07 buptmengjj