intel-extension-for-pytorch icon indicating copy to clipboard operation
intel-extension-for-pytorch copied to clipboard

intel-extension-for-pytorch vs. intel-extension-for-transformers

Open NaamaVian opened this issue 2 years ago • 2 comments

Describe the issue

Hello,

I noticed that there exists intel-extension-for-transformers, though intel-extension-for-pytorch also allows the deployment of LLMs. What is the difference between the two, and which one is best for deploying LLama2-70b?

Thanks!

NaamaVian avatar Oct 25 '23 07:10 NaamaVian