serving icon indicating copy to clipboard operation
serving copied to clipboard

Export `:tensorflow:serving:build_info` for prometheus

Open jeongukjae opened this issue 2 years ago • 2 comments

Feature Request

Describe the problem the feature is intended to solve

For now, TensorFlow Serving doesn't export build information for Prometheus. If tf serving exports metrics like promethues or redis exporter, it would be helpful for managing lots of services and pods in production. (e.g. finding outdated pods)

for example,

:tensorflow:serving:build_info{tensorflow_serving_git_branch="...", tensorflow_serving_git_commit="...", tensorflow_git_commit="...", cpu_arch="...", ...} 1

Describe the solution

Maybe export metrics in tensorflow_serving/model_servers directory using followings.

  • TF Serving Version: https://github.com/tensorflow/serving/blob/3b5b9270cb9fd8de3dfa7743bda050f7fac39214/tensorflow_serving/model_servers/version.h#L55
  • CPU Arch: using preprocessor constant like ARCH_X86?
  • TensorFlow Version: inject constant from https://github.com/tensorflow/tensorflow/blob/cf08ef7ef053e250bdd362204f3158b70aa5954e/tensorflow/tensorflow.bzl#L74-L75 when compiling model server?

jeongukjae avatar Jun 22 '23 04:06 jeongukjae

@jeongukjae,

Thank you for this feature request. Let me take this to team and we will update this thread once we have any updates.

singhniraj08 avatar Jun 23 '23 08:06 singhniraj08

Any updates here?

jeongukjae avatar Sep 20 '23 02:09 jeongukjae