instruct-finetune-mistral icon indicating copy to clipboard operation
instruct-finetune-mistral copied to clipboard

requirements.txt results in conflict

Open ewandel opened this issue 1 year ago • 0 comments

After following the instruction the installation: pip install -r requirements.txt

returns the following error:

  ERROR: Cannot install -r requirements.txt (line 5), -r requirements.txt (line 6), huggingface-hub==0.19.4 and transformers because these package versions have conflicting dependencies.

EDIT: If I create a new "requirements2.txt" file as follows: torch==2.1.0 trl==0.4.7 peft==0.4.0 accelerate==0.21.0 datasets==2.13.0 transformers==4.35.0 huggingface-hub>=0.16.4,<0.18 sentencepiece==0.1.99 bitsandbytes==0.41.1 gradio

Installation does work.

However, scipy-1.12.0 still appears to be missing. After manual install I get the following warnings/errors: site-packages\bitsandbytes\cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable. warn("The installed version of bitsandbytes was compiled without GPU support. " 'NoneType' object has no attribute 'cadam32bit_grad_fp32'

Configuration already exists at .../.cache\huggingface\accelerate\default_config.yaml, will not override. Run accelerate config manually or pass a different save_location.

ewandel avatar Jan 27 '24 09:01 ewandel