multi-model-server
multi-model-server copied to clipboard
awslabs
Multi Model Server is a tool for serving neural net models for inference
Pip packages: sagemaker-inference=1.5.2 multi-model-server=1.1.2 mxnet-model-server=1.0.8 (Note sagemaker-inference still refers to this) When inference requests are issued to MMS, it fails with a Permission Denied error. Stack-trace is included below. This...
## Issue #, if available: ## Description of changes: - Adds builspec yaml file for the following - Nightly (modelarchiver + python tests + API test) - smoke (modelarchiver +...
Before or while filing an issue please feel free to join our [ slack channel](https://join.slack.com/t/mms-awslabs/shared_invite/enQtNDk4MTgzNDc5NzE4LTBkYTAwMjBjMTVmZTdkODRmYTZkNjdjZGYxZDI0ODhiZDdlM2Y0ZGJiZTczMGY3Njc4MmM3OTQ0OWI2ZDMyNGQ) to get in touch with development team, ask questions, find out what's cooking and more!...
Before or while filing an issue please feel free to join our [ slack channel](https://join.slack.com/t/mms-awslabs/shared_invite/enQtNDk4MTgzNDc5NzE4LTBkYTAwMjBjMTVmZTdkODRmYTZkNjdjZGYxZDI0ODhiZDdlM2Y0ZGJiZTczMGY3Njc4MmM3OTQ0OWI2ZDMyNGQ) to get in touch with development team, ask questions, find out what's cooking and more!...
- Removes circleci related files ## Issue #, if available: ## Description of changes: ## Testing done: **To run CI tests on your changes refer [README.md](https://github.com/awslabs/multi-model-server/blob/master/ci/README.md)** By submitting this pull...
1. We define a tensorflow_saved_model_service.py to serve tensorflow models 2. We extend it as tensorflow_vision_service.py to serve image requests 3. Added a README on how to use the tf_vision example....
## Issue #, if available: ## Description of changes: This adds an example for Tensorflow C handler using pybind. Any Tensorflow frozen model can be used to do the inference...
I executed the Create a .mar file from onnx model, from (https://github.com/awslabs/multi-model-server/blob/master/model-archiver/docs/convert_from_onnx.md), however it produces errors, and the curl test case fails. (curl -X POST http://127.0.0.1:8080/predictions/squeezenet -T kitten.jpg). It produces...
Hey guys, great library. I'm having trouble converting a ONNX model to the .mar format using the steps outlined here: https://github.com/awslabs/mxnet-model-server/blob/f8845f917187957d0ae44c6a44b8fecec6746811/model-archiver/docs/convert_from_onnx.md The .mar file is created but every time I...
