multi-model-server
multi-model-server copied to clipboard
Generic integration test framework
The integration tests right now supports only image based models and hence uses hardcoded kitten image as input. The tests should be general so that it can address all the models in the model zoo. Also, all the references should be put to mms S3 bucket to avoid failures in case of any change to onnx buckets .
This can be done by pulling models from S3 bucket with input, expected output and other artefacts about models kept in same folder. Also make sure that all the outputs are correct rather than just checking if we get a results. The framework should take into consideration NLP models and resent ss where input is not kitten.jpg which is being used for current tests.