intel-extension-for-transformers
intel-extension-for-transformers copied to clipboard
A beginner friendly quantize and text embeddings tutorial for XPUs
trafficstars
I have added a beginner friendly tutorial to illustrate how HF text embedding models can be quantised and loaded using Intel XPUs and then use to generate embeddings. (through jupyter notebook)
I have used "BAAI/bge-m3" model from HF and used Intel extension for transformers and transformers library to quantise it on XPU.