Carlos Mocholí
Carlos Mocholí
This is now supported via https://github.com/Lightning-AI/lightning/pull/17475
The removal of apex has simplified this proposal greatly. I edited my proposed API in https://github.com/Lightning-AI/lightning/issues/9956#issuecomment-1207246337
Sure. You can open a PR on Lightning with the changes to let our CI run.
Hi! `weights_only=True` shouldn't have anything to do with safetensors. Can you share the precise error that you get? There should only be weights and primitives in the state dict
So we need to find out what's causing the "Unsupported operand 149" to know if it's litgpt saving something that we shouldn't. Would it be possible for you to share...
cc @rasbt in case you have tried this combination
At some point I would like that we merge them. It was originally separate to keep the code complexity low
I would consider this a feature request more than a bug report. I wouldn't do anything automatic but the messaging could be improved. An easy improvement is to move https://github.com/Lightning-AI/litgpt/blob/main/litgpt/finetune/lora.py#L240-L243...
Which command are you running and have you made any changes to the repo? What's your hardware setup and PyTorch version?
Hi @codeur-rapide. This conversion step doesn't make the model more or less efficient, it's just a mapping from the original HF model `state_dict()` keys to our model `state_dict()` keys. For...