Niraj Singh

Results 263 comments of Niraj Singh

@jccarles, Can you please share the eval_config passed in evaluator component to analyse the root cause of the issue? Thank you!

@mdreves, Can we dispatch the evaluator between different task managers. Thanks!

@UMuktesh, Thank you for reporting this issue. I am able to replicate this error. While setting `max_output_tokens` to `None`, we are getting response from the model, but changing `max_output_tokens` to...

@xxl4, There are some filters that can't be turn off, these all go into the "OTHER" finish reason. For example: one of the non-configurable filters is child safety, which is...

@Mersanko, Replied on [#python/317](https://github.com/google-gemini/generative-ai-python/issues/317#issuecomment-2095190154) thread. Please close this issue and follow the thread on python repo for updates. Thank you!

@flesaint, Unfortunately adding logic to allow serving metadata other than signaturedefs is not on the roadmap right now. To support custom metadata in Serving, there is a similar feature request...

@flesaint, Please help us with the 'saved_model_cli' result for your served model to debug the issue further. Thanks!

@flesaint, Interesting to see the TF Serving identifies multiple signature for Tensorflow model, but fails to do so for tflite model. Thank you for providing the "saved_model_cli" and model server...

@Prabha-Veerubhotla, TF serving binary has C++ dependencies. C++ logging has a hard coded limit on log size 15K which results in this truncation of log messages. A typical workaround of...

@Prabha-Veerubhotla, Going through complete list of available [command line flags](https://github.com/tensorflow/serving/blob/master/tensorflow_serving/model_servers/main.cc#L81), I couldn't find any flag or param to set custom error message limit. Thanks.