Maheswar KK
Maheswar KK
> The lawnchair `12.1.0 Alpha 4` is part of the branch `12.1-dev` which is no longer active, the current active branch is `14-dev` Can you please send the link to...
@Sangh0 There will be basically no performance degrade. Yes, I think scaling is performed? @danielhanchen
Actually, Daniel and Mike already have too much on their hands. Upvote if you want to, but don't expect release any time soon. Sorry @danielhanchen and @shimmyshimmer...
Should be, it has the Llama arch.
> @danielhanchen , yeah i have tried that as well. But the issue is autoawq searches for config.json but we only have adapter_config.json as i have finetuned using LORA peft...
You have to push it using this to get all the files needed: ```python model.push_to_hub_merged("model", tokenizer, save_method = "merged_16bit", token = "token") ``` Try it and let me know @sids07.
> @mahiatlinux, Yeah i have used same command to save my model but it didn't have all the files. Using same command i.e. > > ``` > model.save_pretrained_merged("model", tokenizer, save_method...
> Uh silly question but @danielhanchen are you sure that Unsloth isn't already supporting full finetuning by default? > > If you delete the `model = FastLanguageModel.get_peft_model(...)` step from one...
Hi there everyone. No, MultiGPU has not been released yet and it is still underway. Please be patient. Apologies for the delays!
Try using the CUDA_VISIBLE_DEVICES environment variable in the script itself. ```python import os os.environ['CUDA_VISIBLE_DEVICES'] = '0' # Use GPU 0 ``` or ```python import os os.environ['CUDA_VISIBLE_DEVICES'] = '1' # Use...