SUMMER1234 issues

Results 7 issues of


                                            SUMMER1234

[ALBERT] : Gradient for bert/embeddings/LayerNorm/gamma:0 is NaN : Tensor had NaN values [[node CheckNumerics_4 (defined at usr/local/lib/python3.5/dist-packages/tensorflow_core/python/framework/ops.py:1748) ]]

I try to change ALBERT optimizer to RAdam, but got this error after 1000steps. I tried lower batch size but still not work Traceback (most recent call last): File "/usr/lib/python3.5/runpy.py",...

eval reach a good performance but saved model cannot predict as good as eval

eval reach a good performance but saved model cannot predict as good as eval

what is t2t-decoder in back translation

*** forward translation *** run.sh: line 64: t2t-decoder: command not found *** backward translation *** run.sh: line 77: t2t-decoder: command not found

TypeError: unsupported operand type(s) for -: 'NoneType' and 'NoneType'

/Users/summer-sun/anaconda3/lib/python3.6/site-packages/tensorflow/python/ops/gradients_impl.py:110: UserWarning: Converting sparse IndexedSlices to a dense Tensor of unknown shape. This may consume a large amount of memory. "Converting sparse IndexedSlices to a dense Tensor of unknown shape....

how to use lookahead in tensorflow

RuntimeError: CuDNN error: CUDNN_STATUS_SUCCESS

what cuda version should use? I always get this error for rnn RuntimeError: CuDNN error: CUDNN_STATUS_SUCCESS after upgrade cuda error solved but code not worked