OneTrainer
OneTrainer copied to clipboard
[Bug]: Disabled concepts are still checked for validity (including path)
What happened?
Made a fake path and concept for the purposes of rewriting the Newcomer guide, I disabled the concept and went to train something today and got the an error about the non-existent path in the disabled concept not existing.
What did you expect would happen?
Disabled concepts should be completely skipped after a check is done on if their state is 0 or 1.
Relevant log output
Traceback (most recent call last):
File "C:\repos\OneTrainer\modules\ui\TrainUI.py", line 538, in __training_thread_function
trainer.train()
File "C:\repos\OneTrainer\modules\trainer\GenericTrainer.py", line 491, in train
self.data_loader.get_data_set().start_next_epoch()
File "c:\repos\onetrainer\venv\src\mgds\src\mgds\MGDS.py", line 49, in start_next_epoch
self.loading_pipeline.start_next_epoch()
File "c:\repos\onetrainer\venv\src\mgds\src\mgds\LoadingPipeline.py", line 93, in start_next_epoch
module.start(self.__current_epoch)
File "c:\repos\onetrainer\venv\src\mgds\src\mgds\pipelineModules\CollectPaths.py", line 62, in start
file_names = sorted(self.__list_files(path, include_subdirectories))
File "c:\repos\onetrainer\venv\src\mgds\src\mgds\pipelineModules\CollectPaths.py", line 45, in __list_files
dir_list = [os.path.join(path, filename) for filename in os.listdir(path)]
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'E:\\datasets\\Astronaut-riding-horse'
Output of pip freeze
absl-py==2.1.0
accelerate==0.30.1
aiohttp==3.9.5
aiosignal==1.3.1
antlr4-python3-runtime==4.9.3
async-timeout==4.0.3
attrs==23.2.0
bitsandbytes==0.43.1
cachetools==5.3.3
certifi==2024.7.4
charset-normalizer==3.3.2
cloudpickle==3.0.0
colorama==0.4.6
coloredlogs==15.0.1
customtkinter==5.2.2
dadaptation==3.2
darkdetect==0.8.0
-e git+https://github.com/huggingface/diffusers.git@dd4b731e68f88f58dfabfb68f28e00ede2bb90ae#egg=diffusers
filelock==3.15.4
flatbuffers==24.3.25
frozenlist==1.4.1
fsspec==2024.6.1
ftfy==6.2.0
google-auth==2.29.0
google-auth-oauthlib==1.2.0
grpcio==1.64.1
huggingface-hub==0.23.3
humanfriendly==10.0
idna==3.7
importlib_metadata==8.0.0
intel-openmp==2021.4.0
invisible-watermark==0.2.0
Jinja2==3.1.4
lightning-utilities==0.11.3.post0
lion-pytorch==0.1.4
Markdown==3.6
markdown-it-py==3.0.0
MarkupSafe==2.1.5
mdurl==0.1.2
-e git+https://github.com/Nerogar/mgds.git@ae9019f4b92474c247bd076d38c332f2516ea57e#egg=mgds
mkl==2021.4.0
mpmath==1.3.0
multidict==6.0.5
networkx==3.3
numpy==1.26.4
oauthlib==3.2.2
omegaconf==2.3.0
onnxruntime-gpu==1.18.0
open-clip-torch==2.24.0
opencv-python==4.9.0.80
packaging==24.1
pillow==10.3.0
platformdirs==4.2.2
pooch==1.8.1
prodigyopt==1.0
protobuf==5.27.2
psutil==6.0.0
pyasn1==0.6.0
pyasn1_modules==0.4.0
Pygments==2.18.0
pynvml==11.5.0
pyreadline3==3.4.1
pytorch-lightning==2.2.5
PyWavelets==1.6.0
PyYAML==6.0.1
regex==2024.5.15
requests==2.32.3
requests-oauthlib==2.0.0
rich==13.7.1
rsa==4.9
safetensors==0.4.3
scalene==1.5.41
schedulefree==1.2.5
sentencepiece==0.2.0
six==1.16.0
sympy==1.13.0
tbb==2021.13.0
tensorboard==2.16.2
tensorboard-data-server==0.7.2
timm==1.0.7
tokenizers==0.19.1
torch==2.3.0+cu118
torchmetrics==1.4.0.post0
torchvision==0.18.0+cu118
tqdm==4.66.4
transformers==4.42.3
typing_extensions==4.12.2
urllib3==2.2.2
wcwidth==0.2.13
Werkzeug==3.0.3
xformers==0.0.26.post1+cu118
yarl==1.9.4
zipp==3.19.2