DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard

Add local AML deployment option

Open jeffra opened this issue 3 years ago • 0 comments

Provide local AML deployment option, this will use the AML inference server for the front end.

We can then easily deploy an MII generated score file via: azmlinfsrv --model_dir <model-path> --entry_script score.py

jeffra avatar Jul 27 '22 19:07 jeffra