intel-extension-for-transformers
intel-extension-for-transformers copied to clipboard
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...
Please provide detailed steps (all the necessary pip installs as well as the code from first line till last line) for qlora finetuning qwen2-0.5b on cpu. I as requesting this...
## Type of Change feature or bug fix or documentation or others API changed or not ## Description detail description JIRA ticket: xxx ## Expected Behavior & Potential Risk the...
I tried to use intel-extension-for-transformers to infer the qwen7b model execution and encountered the following error,I can't fix it. Please help analyze it. ...................................................................................... model_init_from_file: support_bestla_kv = 0 model_init_from_file: kv...
I ran the rag example in intel_extension_for_transformers/neural_chat/pipeline/plugins/retrieval/README.md and I got this error -  Steps to re-create - 1) !apt-get install -y ffmpeg !apt-get install -y libgl1-mesa-glx libgl1-mesa-dev 2) !pip3...