intel-extension-for-transformers icon indicating copy to clipboard operation
intel-extension-for-transformers copied to clipboard

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

Results 95 intel-extension-for-transformers issues
Sort by recently updated
recently updated
newest added
trafficstars

## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...

Please provide detailed steps (all the necessary pip installs as well as the code from first line till last line) for qlora finetuning qwen2-0.5b on cpu. I as requesting this...

## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...

I tried to use intel-extension-for-transformers to infer the qwen7b model execution and encountered the following error,I can't fix it. Please help analyze it. ...................................................................................... model_init_from_file: support_bestla_kv = 0 model_init_from_file: kv...

I ran the rag example in intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/README.md and I got this error - ![example_py](https://github.com/user-attachments/assets/9c553bca-7466-479e-a66b-dca79b670869) Steps to re-create - 1) !apt-get install -y ffmpeg !apt-get install -y libgl1-mesa-glx libgl1-mesa-dev 2) !pip3...