Transformer_tf2.0
Transformer_tf2.0 copied to clipboard
Transfromer tensorflow2.0版本实现
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.0.0beta1 to 2.11.1. Release notes Sourced from tensorflow's releases. TensorFlow 2.11.1 Release 2.11.1 Note: TensorFlow 2.10 was the last TensorFlow release that supported GPU on native-Windows. Starting...
WARNING:tensorflow:Gradients do not exist for variables ['ner_transformer/encoder_layer/multi_head_attention/dense/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_1/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_1/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_2/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_2/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_3/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_3/bias:0', 'ner_transformer/encoder_layer/sequential/dense_4/kernel:0', 'ner_transformer/encoder_layer/sequential/dense_4/bias:0', 'ner_transformer/encoder_layer/sequential/dense_5/kernel:0', 'ner_transformer/encoder_layer/sequential/dense_5/bias:0', 'ner_transformer/encoder_layer/layer_normalization/gamma:0', 'ner_transformer/encoder_layer/layer_normalization/beta:0', 'ner_transformer/encoder_layer/layer_normalization_1/gamma:0', 'ner_transformer/encoder_layer/layer_normalization_1/beta:0'] when minimizing the loss.