TFServingCache icon indicating copy to clipboard operation
TFServingCache copied to clipboard

Distributed model cache for TF Serving

Results 4 TFServingCache issues
Sort by recently updated
recently updated
newest added

The model stores depend on external APIs, so the interaction with these APIs should be tested using realistic mocks, e.g. S3Mock.

enhancement

Service discovery mechanisms rely on health metrics. To support this, liveness and readiness statuses should be exposed through a HTTP endpoint.

enhancement

In order to ease development of TF Serving Cache, the project needs a clear guide on compiling the project and getting the services up and running.

documentation

Hi, I found this project very exciting, do you have any plans for the projected future (more functionality, better deployment and etc)? Maybe you are interested in contributors?