Fine tuning for additional policies LlamaGuard

[harindermashiana]

Can you please share some details about fine-tuning LlamaGuard for additional categories? Specifically, every time we need to add one additional category to the existing model, do we need to fine-tune on the old dataset(old categories) + new dataset(new category) or do we just need to fine-tune on the new dataset?

Can you please share a few bullet points/steps to do the fine-tuning and which files to reference based on your answer?

Thanks,