taggui
taggui copied to clipboard
Models needing flash_attn aren't working
Error message:
Loading microsoft/Florence-2-large-ft...
Traceback (most recent call last):
File "/home/abc/StableDiffusion/taggui/taggui/auto_captioning/captioning_thread.py", line 145, in run
raise exception
File "/home/abc/StableDiffusion/taggui/taggui/auto_captioning/captioning_thread.py", line 141, in run
self.run_captioning()
File "/home/abc/StableDiffusion/taggui/taggui/auto_captioning/captioning_thread.py", line 88, in run_captioning
model.load_processor_and_model()
File "/home/abc/StableDiffusion/taggui/taggui/auto_captioning/auto_captioning_model.py", line 143, in load_processor_and_model
self.model = self.get_model()
File "/home/abc/StableDiffusion/taggui/taggui/auto_captioning/auto_captioning_model.py", line 104, in get_model
model = self.transformers_model_class.from_pretrained(
File "/home/abc/StableDiffusion/taggui/venv/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 550, in from_pretrained
model_class = get_class_from_dynamic_module(
File "/home/abc/StableDiffusion/taggui/venv/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 501, in get_class_from_dynamic_module
final_module = get_cached_module_file(
File "/home/abc/StableDiffusion/taggui/venv/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 326, in get_cached_module_file
modules_needed = check_imports(resolved_module_file)
File "/home/abc/StableDiffusion/taggui/venv/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 181, in check_imports
raise ImportError(
ImportError
:
This modeling file requires the following packages that were not found in your environment: flash_attn. Run `pip install flash_attn`
but flash_attn
is already installed:
$ pip install flash-attn --no-build-isolation
Requirement already satisfied: flash-attn in ./venv/lib/python3.10/site-packages (2.6.3)
...
Same problem happens with other models that require flash_attn as well.