Can pyvacy support GPT-like models?

[xiehuanyi]

I am recently finetuning a gpt-like model on some toy-dataset with fake personal data. I am trying to test differential privacy on this LLMs. I wonder if pyvacy will work for this task, or is there any other better options?