serving
serving copied to clipboard
Export `:tensorflow:serving:build_info` for prometheus
Feature Request
Describe the problem the feature is intended to solve
For now, TensorFlow Serving doesn't export build information for Prometheus. If tf serving exports metrics like promethues or redis exporter, it would be helpful for managing lots of services and pods in production. (e.g. finding outdated pods)
for example,
:tensorflow:serving:build_info{tensorflow_serving_git_branch="...", tensorflow_serving_git_commit="...", tensorflow_git_commit="...", cpu_arch="...", ...} 1
Describe the solution
Maybe export metrics in tensorflow_serving/model_servers directory using followings.
- TF Serving Version: https://github.com/tensorflow/serving/blob/3b5b9270cb9fd8de3dfa7743bda050f7fac39214/tensorflow_serving/model_servers/version.h#L55
- CPU Arch: using preprocessor constant like
ARCH_X86? - TensorFlow Version: inject constant from https://github.com/tensorflow/tensorflow/blob/cf08ef7ef053e250bdd362204f3158b70aa5954e/tensorflow/tensorflow.bzl#L74-L75 when compiling model server?
@jeongukjae,
Thank you for this feature request. Let me take this to team and we will update this thread once we have any updates.
Any updates here?