How can I solve this error: KeyError: u'BatchMatMulV2', model: BERT; tensorflow: 1.14.

[zhoujiang2013]

Traceback (most recent call last): File "/usr/local/bin/simple_tensorflow_serving", line 11, in load_entry_point('simple-tensorflow-serving==0.6.6', 'console_scripts', 'simple_tensorflow_serving')() File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 487, in load_entry_point Create path to host static files: static return get_distribution(dist).load_entry_point(group, name) File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2728, in load_entry_point return ep.load() File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2346, in load return self.resolve() File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2352, in resolve module = import(self.module_name, fromlist=['name'], level=0) File "/usr/local/lib/python2.7/site-packages/simple_tensorflow_serving-0.6.6-py2.7.egg/simple_tensorflow_serving/server.py", line 225, in model_name, model_base_path, custom_op_paths, session_config) File "/usr/local/lib/python2.7/site-packages/simple_tensorflow_serving-0.6.6-py2.7.egg/simple_tensorflow_serving/tensorflow_inference_service.py", line 72, in init self.load_saved_model_version(model_version) File "/usr/local/lib/python2.7/site-packages/simple_tensorflow_serving-0.6.6-py2.7.egg/simple_tensorflow_serving/tensorflow_inference_service.py", line 175, in load_saved_model_version session, [tf.saved_model.tag_constants.SERVING], model_file_path) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/saved_model/loader_impl.py", line 197, in load return loader.load(sess, tags, import_scope, **saver_kwargs) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/saved_model/loader_impl.py", line 350, in load **saver_kwargs) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/saved_model/loader_impl.py", line 278, in load_graph meta_graph_def, import_scope=import_scope, **saver_kwargs) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/training/saver.py", line 1696, in _import_meta_graph_with_return_elements **kwargs)) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/framework/meta_graph.py", line 806, in import_scoped_meta_graph_with_return_elements return_elements=return_elements) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/util/deprecation.py", line 488, in new_func return func(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/framework/importer.py", line 391, in import_graph_def _RemoveDefaultAttrs(op_dict, producer_op_list, graph_def) File "/usr/local/lib/python2.7/site-packages/tensorflow/python/framework/importer.py", line 158, in _RemoveDefaultAttrs op_def = op_dict[node.op] KeyError: u'BatchMatMulV2'

[tobegit3hub]

It seems that your model has the op named 'BatchMatMulV2' but it can not be found in current TensorFlow version. Please make sure you use the same version of TensorFlow as the environment for exporting the BERT model or using 2.4.0+ which has supported BatchMatMulV2.