Niraj Singh

Results 263 comments of Niraj Singh

@jeongukjae, Thank you for filing this feature request. We will discuss this feature implementation internally and update this thread. Thanks.

@kokroo, You can try building Tensorflow Serving from source and if you are interested in optimized builds you can follow [optimize build section](https://www.tensorflow.org/tfx/serving/setup#optimized_build) to utilize platform-specific instruction sets for your...

@yarikmarkov, Just to confirm, Do you want TF Serving to have arguments to update [these parameters](https://github.com/grpc/grpc/blob/master/src/cpp/server/server_builder.cc#L173-L184) in grpc code base?

@saeid93, Similar feature request #2097 is already in work. Requesting you to follow and +1 that thread for updates. Yes there are no option currently to configure resources per model...

@saeid93, Configuring to limit CPU usage/core per model in mutli-model setup is currently not in our roadmap right now. But this sounds like a good feature to implement. I will...

@ZhengJuCn, Currently we have `--per_process_gpu_memory_fraction` to limit the memory usage of model server and there is no such method available to limit GPU usage on model level. Ref: [/pull/694](https://github.com/tensorflow/serving/pull/694) Please...

@yimingz-a, Please take a look into this feature request to configure GPU memory limit for each model in tensorflow model server. Thank you!

@rrkarim, I have found a similar[ issue](https://github.com/tensorflow/serving/issues/421#issuecomment-300718439) and commenting out ```python #from tensorflow.contrib.image.python.ops.single_image_random_dot_stereograms import single_image_random_dot_stereograms ``` in ` bazel-bin/tensorflow_serving/example/mnist_saved_model.runfiles/org_tensorflow/tensorflow/contrib/image/__init__.py ` resolves the issue. Please try this and let us know...

@rrkarim, I think below are the commits you are looking for. Thanks! Add an example which call the Remote Predict Op directly.(commit: d5b980f487996aa1f890a559eae968735dfebf5d) Added abstract layer for remote predict op...

@nniuzft, Created this PR to update broken links in [SignatureDefs in SavedModel for TensorFlow Serving](https://www.tensorflow.org/tfx/serving/signature_defs#background) page. Kindly review and do the needful. Thank you!