Reza Yazdani

Hi @tomeras91 Thanks for reporting this issue. I will look into this. @mrwyattii, thanks for reproducing this. Yes, I think the issue is probably somewhere else. Thanks, Reza

Hi @tomeras91 Thanks for reporting this. I am going to take a look at it and send a fix soon Best, Reza

Hi @joehoover , I ran this with the master branch and I see the following output: ` [{'generated_text': 'All happy families are alike, but each unhappy family is unhappy in...

Hi @hyhuang00 Thanks for catching this. I will look into this. Can you please provide me the script you are using to run this? -Reza

@lanking520, Thanks for trying this on multiple GPUs, I will try this on my end to see what the issue is. I will let you know once I fix it....

Hi @dancingpipi I will look into this and will send a fix soon. Best, Reza

@dancingpipi, sorry I was sick and now I am back and will take care of this. I will let you once I prepare the PR.

Hi @dancingpipi I finally get some time to test this on my side. So, I modified your script a bit so that I inject the transformer kernel without passing the...

Hi @callzhang Could you please provide a test script so that I can try on my end and can understand the problem better? Thanks, Reza

Thanks I will try this on my end