netfs

i think having different # of features in request compared to that what model expects -- is usually an indicator of training vs serving "skew". you are assuming here that...

> @netfs > I understand what you mean. > > But I need this patch for model migration on the running service. > Loosening checks allows to adding/removing features seamlessly....

> I update multiple models daily on our S3 bucket, and run AB tests between the updated models. > It is not practical to switch the model version on the...

Once M1 is officially supported by TF, we can try and provide (docker/m1) builds for TF Serving. Presently M1 builds in TF is driven by community supported builds.

i think the problem here is building https://github.com/protocolbuffers/upb (external) repo with the described compiler+optimization levels. @satishpasumarthi it may be faster to resolve this by reporting an issue to https://github.com/protocolbuffers/upb with...

@mihaimaruseac -- do you have recommendations on how can we get protocolbuffers/upb#300 fixes into TF? it seems TF serving get `upb` from TF, and TF gets it from `grpc` (part...

i do not think TF 2.3 updated their grpc dependency: https://github.com/tensorflow/tensorflow/blame/88ab72153e13d925f951e9464a121cda47083e3b/tensorflow/workspace.bzl#L687 i think the fastest way to fix this, is to send a PR to tensorflow with the relevant grpc...

@mihaimaruseac is (i think) asking for a PR that updates TF's grpc dependency (see https://github.com/tensorflow/serving/issues/1642#issuecomment-651945515 above)

We today fixed a bug in the profiler side (https://github.com/tensorflow/tensorflow/commit/2baf9981d73fb3d12ba4331a3b3f5d82894e6aae). Can you again try this on TF master in ~1 day (once TF Serving catches up with the above TF...

@yisitu do you know if https://github.com/tensorflow/tensorflow/commit/2baf9981d73fb3d12ba4331a3b3f5d82894e6aae will fix this issue (seen on master TF serving repo, but not on 2.3 release)?