dstoolkit-mlops-base icon indicating copy to clipboard operation
dstoolkit-mlops-base copied to clipboard

Endpoint Model Profiler

Open FlorianPydde opened this issue 3 years ago • 0 comments

AML provides a model profiling functionality which enables team to assess their deployment services (memory consumption, latency, etc): https://docs.microsoft.com/en-us/azure/machine-learning/how-to-deploy-profile-model?pivots=py-sdk

During model deployment to AKS (TEST/PROD), it may be useful to create the model profile and upload it to the default blob storage, for simplicity. This file can used to trigger action based specifics metrics or display it on a operation dashboard

FlorianPydde avatar Nov 03 '21 09:11 FlorianPydde