Inference of a federated learnt transformer

[sauravtii]

What is your question?

In this tutorial, how can I use the transformer which was trained in a federated manner on IMDB dataset, for inference?

[tanertopal]

@sauravtii not sure I understand the question. Can you elaborate further?

[sauravtii]

Sure @tanertopal. So my question is, in this tutorial we are fine-tuning a pre-trained transformer model (distill-bert) on IMDB dataset. So, after fine-tuning is complete, how can I use the fine-tuned model for inference or how can I use the fine-tuned model for performing predictions?

Also, where does the fine-tuned model gets saved?

[mnabihali]

Did you find a solution for this issue?