Sebastian Raschka

I agree. That's what I had first but then I thought you guys wouldn't be happy to remove it entirely ... but I agree, it's the simplest solution.

Hi there, I am actually not sure what the context here is. Was this in response to an error someone else was getting?

Sure, here is it with LoRA: ``` {'checkpoint_dir': PosixPath('checkpoints/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T'), 'data': Alpaca2k(mask_prompt=False, val_split_fraction=0.03847, prompt_style=, ignore_index=-100, seed=42, num_workers=4, download_dir=PosixPath('data/alpaca2k')), 'devices': 1, 'eval': EvalArgs(interval=100, max_new_tokens=100, max_iters=100), 'logger_name': 'csv', 'lora_alpha': 16, 'lora_dropout': 0.05, 'lora_head':...

Maybe the next thing to investigate here is to try bnb 0.42.0 or 0.43.0. I ran this with 0.41.0 above.

Thanks for the PR. I'd say this would definitely need a documentation though so that non-docker users won't get confused what this subfolder is for 😅

Thanks asking and doing this! Perhaps this could go under ``` appendix-A/04_optional-docker-environment/ ``` Also brief notes would be ok, I can write it up as text (I am not a...

Thanks a lot. I will try and review it carefully in the next couple of days!

This looked & worked great. I just made some updates to the docs to add more wording for beginners.

I only tested this on my laptop, which doesn't have an NVIDIA card. Otherwise I am using cloud resources for GPU training where I can't easily install and use Docker.

How about we add a `"validate_prompt: Your text"` to the configs but leave it empty (disable) it by default. This way users can choose to use it because it can...