Protobuf message size limit

[justgos]

When processing batches of trees of few thousand nodes, session.run fails with the following message:

[libprotobuf ERROR external/protobuf/src/google/protobuf/io/coded_stream.cc:208] A protocol message was rejected because it was too big (more than 67108864 bytes). To increase the limit (or to disa ble these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream. h. W tensorflow/core/framework/op_kernel.cc:993] Internal: Failed to deserialize WeaverMessage: Weaver Message couldn't be parsed.

It could probably be solved by linking newer version of tensorflow repository: https://github.com/tensorflow/tensorflow/pull/7301

[moshelooks]

Thanks for bringing this up. In the meantime you can lower the batch_size parameter of e.g. td.Compiler.build_feed_dict (default is 100); this controls how many inputs get stored in each proto.

On Thu, Mar 16, 2017 at 4:59 AM, justgos [email protected] wrote:

When processing batches of trees of few thousand nodes, session.run fails with the following message:

[libprotobuf ERROR external/protobuf/src/google/ protobuf/io/coded_stream.cc:208] A protocol message was rejected because it was too big (more than 67108864 bytes). To increase the limit (or to disa ble these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream. h. W tensorflow/core/framework/op_kernel.cc:993] Internal: Failed to deserialize WeaverMessage: Weaver Message couldn't be parsed.

It could probably be solved by linking newer version of tensorflow repository: tensorflow/tensorflow#7301 https://github.com/tensorflow/tensorflow/pull/7301

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tensorflow/fold/issues/36, or mute the thread https://github.com/notifications/unsubscribe-auth/AAsbjiGcvb-qOQk0oq8ICWyS6mgkJGdGks5rmSQNgaJpZM4MfMtg .