ipex-llm
ipex-llm copied to clipboard
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Ma...
ERROR executor.Executor: Exception in task 2.0 in stage 3.0 (TID 6) java.lang.NullPointerException
VGG Model on CIFAR-10 Why did the following error occur? 18/08/22 16:22:59 INFO executor.Executor: Finished task 2.0 in stage 1.0 (TID 5). 2024 bytes result sent to driver 18/08/22 16:23:02...
## motivation This is inspired by https://docs.openvino.ai/latest/openvino_inference_engine_tools_benchmark_tool_README.html. We need a benchmark tool for developers and users to benchmark the training and inferencing performance on their own platform. Our users need...
time series data might not be that large and overfitting has become a problem for many users. We should bring a validation loop to forecaster's `fit` and make sure the...
- [ ] SGX=1 for running in SGX - [ ] Test with non SGX - [ ] Test with SGX
**_Updated 7/13/2022 according to comments_** Please use this demo page to understand what prompt we will give our users. https://theaperdeng.github.io/complex-installation-document-panel/ ## Motivation bigdl-chronos's dependencies is becomming more and more unmanagable...
I use spark-submit-with-dllib to submit my task to yarn, but got an jep error: ``` creating: createTorchLoss creating: createTorchOptim creating: createAUC creating: createZooKerasAccuracy creating: createEstimator creating: createMaxEpoch 22-07-12 11:35:57 [Thread-9]...
## Description In the previous implementation, we convert rdd of spark row to pandas dataframe directly, in this pr, we convert spark row to arrow table first, then convert arrow...
The exception is: An error occurred while calling o59.estimatorTrain. : com.intel.analytics.bigdl.dllib.utils.InvalidOperationException at com.intel.analytics.bigdl.dllib.utils.Log4Error$.invalidOperationError(Log4Error.scala:38) at com.intel.analytics.bigdl.dllib.keras.models.InternalDistriOptimizer.train(Topology.scala:1161) at com.intel.analytics.bigdl.dllib.keras.models.InternalDistriOptimizer.train(Topology.scala:1302) at com.intel.analytics.bigdl.dllib.keras.models.InternalDistriOptimizer.train(Topology.scala:969) at com.intel.analytics.bigdl.dllib.estimator.Estimator.train(Estimator.scala:192) at com.intel.analytics.bigdl.dllib.estimator.python.PythonEstimator.estimatorTrain(PythonEstimator.scala:100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)...
- [ ] pip install bigdl-nano[pytorch] will install 0.14.0xxxx instead of 2.1.0xxxx - [ ] (PR #5106) unsetenv is not supported on windows, https://github.com/intel-analytics/BigDL/blob/main/python/nano/src/bigdl/nano/pytorch/__init__.py#L22 ```bash if 'KMP_INIT_AT_FORK' in os.environ: del...
## Description Fix nano pytorch import issue on windows since unsetenv is not supported on windows. Related issue: #5102