ipex-llm
ipex-llm copied to clipboard
intel-analytics
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Ma...
It's werid that lstm failed to save(https://github.com/intel-analytics/BigDL/issues/5200) while we have ut to cover the serialize test(https://github.com/intel-analytics/BigDL/blob/main/scala/dllib/src/test/scala/com/intel/analytics/bigdl/dllib/keras/layers/LSTMSpec.scala#L94) and our jekins can pass. I tried to run the LSTMSerialTest on local and...
## Description I fix some empty links in readthedocs, add some links to it.
A general user guide of Friesian and feature engineering
I cannot enable ray dashboard while using RayOnSpark on K8s with cluster mode. Environment * python=3.6.10 * ray=1.9.2 * protobuf=3.19.4 * prometheus-client = 0.14.1 code: ```python sc = init_orca_context(cluster_mode="spark-submit", init_ray_on_spark=True,...
Problem: According to the [Chronos User Guide](https://bigdl.readthedocs.io/en/latest/doc/Chronos/Overview/chronos.html#examples-and-demos), users can run some Chronos examples in Jupyter Notebook. However, one example in `Quickstarts` section named [Use TSDataset and Forecaster for Time-Series Forecasting](https://bigdl.readthedocs.io/en/latest/doc/Chronos/QuickStart/chronos-tsdataset-forecaster-quickstart.html)...
## Description Add Friesian Nearline User Guide ### 3. How to test? - [ ] Document test
In [imageInference](https://github.com/intel-analytics/BigDL/tree/main/python/dllib/examples/nnframes/imageInference) readme, it describes downloading the pre-trained Inception-V1 model from https://s3-ap-southeast-1.amazonaws.com/bigdl-models/imageclassification/imagenet/bigdl_inception-v1_imagenet_0.4.0.model, which was not valid.
## Description This PR will release a tutorial for running Orca PyTorch Pyspark program on K8s cluster, it provides a detailed step-by-step guide and a simple FashionMNIST example that allows...
## Motivation Since we find for some models(e.g. Autoformer in Chronos), JIT and ipex brings some improvement on inference latency while Onnxruntime and OpenVINO can not work properly (e.g. lack...
When running jenkins job for dien train, I fail the job when using build method to use the friesian API, I passed the job when using pip install method so...
Metadata
Owner
Metadata
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Ma...