Sebastian Raschka

> Can you someone please guide how to force model to fine tune using flaort16 instead of bfloat16 as V100 doesn't support bfloat16. Hi @usmanxia, you can install the recent...

It's on my todo list for next week. Some other prios first, but yeah, I hope I can get it to work :)

Looks awesome! thanks for the PR! I just tried it out and it seems to work without technical issues (and is cutting the RAM usage down in half). The only...

Awesome! There were few minor things with the cache and the `generate` function call in the `generate/adapter_v2.py` script, but it seems to work for me now! Besides updating the `finetune/adapter_v2.py`...

Hey, I just needed to use the adapter_v2 script for something else and thought I'd just go ahead and implement the fix. I hope you don't mind @Diormiu. And big...

That's pretty cool! What do you think @lantiga & @carmocca ?

That's a good point. I also wondered if we even needed a `generate.py` script in the top level. Like you suggest, I am in favor of having the script under...

One way would be to use the Dolly 2.0 JSON file as a template and structure your dataset in the same fashion, using the same keys. And then run the...

Or, maybe even easier would be to structure it similar to the Alpaca dataset, which has slightly different names for the keys, and then use the [prepare_alpaca](https://github.com/Lightning-AI/lit-llama/blob/main/scripts/prepare_alpaca.py) script.

> Yes, but the question is how i can automatically fill instruction, input, and output using the web-scraped texts from the wiki pages? Oh, I think I now understand what...