ipex-llm
ipex-llm copied to clipboard
Nano: openvino related fundamental examples
-
[ ] need fundamental examples to
python/nano/tutorial/inference/openvino
and show how to directly load an openvino model and use it asmodel(x)
. 2 examples forasync_predict
,model(x)
respectively. -
[ ] need save/load examples to
/python/nano/tutorial/notebook/inference/pytorch
and show how to save(export)/load an optimized model.
I think we may also need a fundamental example to python/nano/tutorial/inference/pytorch
to show the usage of async_predict
on optimized pytorch model.
I think we may also need a fundamental example to
python/nano/tutorial/inference/pytorch
to show the usage ofasync_predict
on optimized pytorch model.
Yeah I think we do, but maybe we can start a thread to first add the save(export) fundamental example first.
I think we may also need a fundamental example to
python/nano/tutorial/inference/pytorch
to show the usage ofasync_predict
on optimized pytorch model.Yeah I think we do, but maybe we can start a thread to first add the save(export) fundamental example first.
OK, I wil work on it.