Transformer_tf2.0 icon indicating copy to clipboard operation
Transformer_tf2.0 copied to clipboard

Transfromer tensorflow2.0版本实现

Results 2 Transformer_tf2.0 issues
Sort by recently updated
recently updated
newest added

Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.0.0beta1 to 2.11.1. Release notes Sourced from tensorflow's releases. TensorFlow 2.11.1 Release 2.11.1 Note: TensorFlow 2.10 was the last TensorFlow release that supported GPU on native-Windows. Starting...

dependencies

WARNING:tensorflow:Gradients do not exist for variables ['ner_transformer/encoder_layer/multi_head_attention/dense/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_1/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_1/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_2/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_2/bias:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_3/kernel:0', 'ner_transformer/encoder_layer/multi_head_attention/dense_3/bias:0', 'ner_transformer/encoder_layer/sequential/dense_4/kernel:0', 'ner_transformer/encoder_layer/sequential/dense_4/bias:0', 'ner_transformer/encoder_layer/sequential/dense_5/kernel:0', 'ner_transformer/encoder_layer/sequential/dense_5/bias:0', 'ner_transformer/encoder_layer/layer_normalization/gamma:0', 'ner_transformer/encoder_layer/layer_normalization/beta:0', 'ner_transformer/encoder_layer/layer_normalization_1/gamma:0', 'ner_transformer/encoder_layer/layer_normalization_1/beta:0'] when minimizing the loss.