Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

Update WizardLM dataset

Open olliestanley opened this issue 2 years ago • 1 comments

SFT-8 training is using SFT-8 training is using a slightly less cleaned version

Beyond SFT-8 we should replace with the newer, more cleaned version

I think this is just a matter of changing the HF dataset ID

olliestanley avatar May 10 '23 18:05 olliestanley

Is this still a current issue? I tried to update the dataset but the whole structure of the dataset changes. Am also not sure if this does not include vicuna data, which might result in duplicates if training with wizardlm + vicuna

CloseChoice avatar Jun 17 '23 14:06 CloseChoice