Carlos Mocholí
Carlos Mocholí
What error are you getting with the upgraded Python?
Can you verify that you are using the correct Python executable? You can do so by running `python -V`. It should print a version higher than 3.7. If not, then...
It seems like your `pip` is linked to a different python. Can you try `python -m pip install ...`?
This is not implemented and not explored at the moment.
This seems to be a DeepSpeed issue, so it might disappear with #118. Which script are you running? I would suggest trying out a DeepSpeed example on your setup to...
Falcon 40B won't fit in a single 80GB card. I will report back when I find out what's the minimum memory requirement to fine-tune it. But I don't have access...
@gpravi Distributed support for LoRA is tracked in #161
QLoRA finetuning support is tracked in #176. Until that is supported, you can try the suggestions described in https://github.com/Lightning-AI/lit-gpt/blob/main/tutorials/oom.md
If you had the weights (`*.bin` files) already downloaded at `checkpoints/tiiuae/falcon-7b-instruct/coreml`, you can do `python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/tiiuae/falcon-7b-instruct/coreml --model_name falcon-7b-instruct`