DeepSpeed-MII
DeepSpeed-MII copied to clipboard
Add local AML deployment option
Provide local AML deployment option, this will use the AML inference server for the front end.
We can then easily deploy an MII generated score file via: azmlinfsrv --model_dir <model-path> --entry_script score.py