TFServingCache
TFServingCache copied to clipboard
Distributed model cache for TF Serving
Results
4
TFServingCache issues
Sort by
recently updated
recently updated
newest added
The model stores depend on external APIs, so the interaction with these APIs should be tested using realistic mocks, e.g. S3Mock.
enhancement
Service discovery mechanisms rely on health metrics. To support this, liveness and readiness statuses should be exposed through a HTTP endpoint.
enhancement
In order to ease development of TF Serving Cache, the project needs a clear guide on compiling the project and getting the services up and running.
documentation
Hi, I found this project very exciting, do you have any plans for the projected future (more functionality, better deployment and etc)? Maybe you are interested in contributors?