instruct-finetune-mistral
instruct-finetune-mistral copied to clipboard
requirements.txt results in conflict
After following the instruction the installation: pip install -r requirements.txt
returns the following error:
ERROR: Cannot install -r requirements.txt (line 5), -r requirements.txt (line 6), huggingface-hub==0.19.4 and transformers because these package versions have conflicting dependencies.
EDIT: If I create a new "requirements2.txt" file as follows: torch==2.1.0 trl==0.4.7 peft==0.4.0 accelerate==0.21.0 datasets==2.13.0 transformers==4.35.0 huggingface-hub>=0.16.4,<0.18 sentencepiece==0.1.99 bitsandbytes==0.41.1 gradio
Installation does work.
However, scipy-1.12.0 still appears to be missing. After manual install I get the following warnings/errors: site-packages\bitsandbytes\cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " 'NoneType' object has no attribute 'cadam32bit_grad_fp32'
Configuration already exists at .../.cache\huggingface\accelerate\default_config.yaml, will not override. Run accelerate config
manually or pass a different save_location
.