Chansung Park

Need to explore every possible combinations of different hyperparameters + float16 instead of 8int

Thanks for the feedback! Need to check how to craft better prompt template

It works in batch mode

it works now. but batch mode is deprecated for now.

I am planning to add streaming feature soon! :) in that case batch requests handling feature will be disabled (well will remain as an option)

Thanks @alexanderfrey Hugging Face library does not support streaming feature out of the box, so I thought I need a sort of money patch. Luckily, I found one from different...

check this out : https://twitter.com/algo_diver/status/1638079375085305856?s=20

Thanks for the kind words :) Unfortunately V100's memory is insufficient to run 8Bit Alpaca LoRA model.

The one from my account which was traine on the cleaned dataset provided by this repo

just updated the repository and experimentally running here : https://notebookse.jarvislabs.ai/BuOu_VbEuUHb09VEVHhfnFq4-PMhBRVCcfHBRCOrq7c4O9GI4dIGoidvNf76UsRL