ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Nano: openvino related fundamental examples

Open TheaperDeng opened this issue 2 years ago • 3 comments

  • [ ] need fundamental examples to python/nano/tutorial/inference/openvino and show how to directly load an openvino model and use it as model(x). 2 examples for async_predict, model(x) respectively.

  • [ ] need save/load examples to /python/nano/tutorial/notebook/inference/pytorch and show how to save(export)/load an optimized model.

TheaperDeng avatar Sep 15 '22 04:09 TheaperDeng

I think we may also need a fundamental example to python/nano/tutorial/inference/pytorch to show the usage of async_predict on optimized pytorch model.

hjzin avatar Sep 21 '22 06:09 hjzin

I think we may also need a fundamental example to python/nano/tutorial/inference/pytorch to show the usage of async_predict on optimized pytorch model.

Yeah I think we do, but maybe we can start a thread to first add the save(export) fundamental example first.

TheaperDeng avatar Sep 21 '22 06:09 TheaperDeng

I think we may also need a fundamental example to python/nano/tutorial/inference/pytorch to show the usage of async_predict on optimized pytorch model.

Yeah I think we do, but maybe we can start a thread to first add the save(export) fundamental example first.

OK, I wil work on it.

hjzin avatar Sep 21 '22 07:09 hjzin