amdnsr

OverflowError: out of range integral type conversion attempted while running python qlora.py

12

`python qlora.py --model_name_or_path decapoda-research/llama-13b-hf` (I have updated the tokenizer_config.json and config.json as per the various discussions [here](https://huggingface.co/decapoda-research/llama-13b-hf/discussions/) `tokenizer_class`: `LlamaTokenizer` and `architectures`: `LlamaForCausalLM`) ================================================================================== adding LoRA modules... trainable params: 125173760.0 ||...

AttributeError: 'tuple' object has no attribute 'load_in_8bit' while trying inference

2

I'm using the following code to test the inference pipeline, but I'm getting this error ``` File "/home/envs/qlora_env/lib/python3.8/site-packages/transformers/modeling_utils.py", line 2209, in from_pretrained load_in_8bit = quantization_config.load_in_8bit AttributeError: 'tuple' object has no...

Error while trying to run training in Windows

9

Error invalid device ordinal at line 359 in file G:\F\Projects\AI\text-generation-webui\bitsandbytes\csrc\pythonInterface.c C:\arrow\cpp\src\arrow\filesystem\s3fs.cc.2598: arrow::fs::FinalizeS3 was not called even though S3 was initialized. This could lead to a segmentation fault at exit This...

Contradictory information in documentation about the ability to push qunatized models to hub

1

### System Info Using Google Colab and the main branch of the transformers library on GitHub. ### Who can help? @sgugger @stevhliu @MKhalusova ### Information - [X] The official example...