Rishika Bhagwatkar

Thank you for the clarification. I have another question: Why is the batch size hardcoded to 1? Is it just to avoid padding text tokens? Or am I missing something?

Hi, thank you so much for clarifying everything. Just one last question: does the code use beam search to generate the outputs?