the problem during training ( tf 1.4.0 cuda 8.0 cudnn 6.0 python 2.7.16)

[jackson1895]

hi , after adopting the solution to your #12 problem, the following problems still occur

Save eval, global step 9000

loaded infer model parameters from ../test_out_put/translate.ckpt-9000, time 0.14s

330

src: /home/lhb/lihaibo/dataset/PHOENIX-2014-T-release-v3/PHOENIX-2014-T/features/fullFrame-227x227px/dev/21November_2009_Saturday_tagesschau-4911/
ref: in der neuen woche unbeständig mit vielen wolken die zeitweise regen bringen .
nmt: am tag die es morgen und den den den regen .

loaded eval model parameters from ../test_out_put/translate.ckpt-9000, time 0.13s eval dev: perplexity 153.64, time 232s, Thu May 16 20:45:45 2019. eval test: perplexity 145.05, time 285s, Thu May 16 20:50:31 2019. loaded infer model parameters from ../test_out_put/translate.ckpt-9000, time 0.14s

327

src: /home/lhb/lihaibo/dataset/PHOENIX-2014-T-release-v3/PHOENIX-2014-T/features/fullFrame-227x227px/dev/21June_2011_Tuesday_tagesschau-1264/
ref: im osten und südosten beginnt der tag noch freundlich während im übrigen land schon schauer und gewitter unterwegs sind .
nmt: am nun die es morgen den den den den regen .

loaded infer model parameters from ../test_out_put/translate.ckpt-9000, time 0.14s

External evaluation, global step 9000

decoding to output ../test_out_put/output_dev. done, num sentences 519, time 346s, Thu May 16 20:56:33 2019. 17.0109051037 4.73932799638 2.21729209827 0.943421025948 bleu dev: 0.9 saving hparams to ../test_out_put/hparams

External evaluation, global step 9000

decoding to output ../test_out_put/output_test. done, num sentences 642, time 418s, Thu May 16 21:03:32 2019. 17.3306824749 4.96482052496 2.50959547569 1.26761051914 bleu test: 1.3 saving hparams to ../test_out_put/hparams global step 9100 lr 1e-05 step-time 1.47s wps 0.01K ppl 155.52 bleu 0.94 global step 9200 lr 1e-05 step-time 1.46s wps 0.01K ppl 159.43 bleu 0.94 global step 9300 lr 1e-05 step-time 1.46s wps 0.01K ppl 169.96 bleu 0.94 global step 9400 lr 1e-05 step-time 1.46s wps 0.01K ppl 152.75 bleu 0.94 global step 9500 lr 1e-05 step-time 1.46s wps 0.01K ppl 153.21 bleu 0.94 global step 9600 lr 1e-05 step-time 1.46s wps 0.01K ppl 134.32 bleu 0.94 global step 9700 lr 1e-05 step-time 1.46s wps 0.01K ppl 168.70 bleu 0.94 global step 9800 lr 1e-05 step-time 1.46s wps 0.01K ppl 149.64 bleu 0.94 global step 9900 lr 1e-05 step-time 1.46s wps 0.01K ppl 162.74 bleu 0.94 global step 10000 lr 1e-05 step-time 1.46s wps 0.01K ppl 139.05 bleu 0.94

Save eval, global step 10000

loaded infer model parameters from ../test_out_put/translate.ckpt-10000, time 0.14s

141

src: /home/lhb/lihaibo/dataset/PHOENIX-2014-T-release-v3/PHOENIX-2014-T/features/fullFrame-227x227px/dev/09August_2010_Monday_heute-5906/
ref: ihnen einen schönen abend und machen sie es gut .
nmt: im abend .

loaded eval model parameters from ../test_out_put/translate.ckpt-10000, time 0.13s eval dev: perplexity 140.93, time 232s, Thu May 16 21:31:46 2019. eval test: perplexity 133.20, time 286s, Thu May 16 21:36:32 2019. Traceback (most recent call last): File "/home/lhb/.conda/envs/nsly/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/home/lhb/.conda/envs/nsly/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/lhb/lihaibo/code/NSLT/nslt/nslt/nmt.py", line 378, in tf.app.run(main=main, argv=[sys.argv[0]] + unparsed) File "/home/lhb/.conda/envs/nsly/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 48, in run _sys.exit(main(_sys.argv[:1] + flags_passthrough)) File "/home/lhb/lihaibo/code/NSLT/nslt/nslt/nmt.py", line 368, in main run_main(FLAGS, default_hparams, train_fn, inference_fn) File "/home/lhb/lihaibo/code/NSLT/nslt/nslt/nmt.py", line 361, in run_main train_fn(hparams, target_session=target_session) File "train.py", line 292, in train step_result = loaded_train_model.train(train_sess) File "model.py", line 175, in train self.batch_size]) File "/home/lhb/.conda/envs/nsly/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 895, in run run_metadata_ptr) File "/home/lhb/.conda/envs/nsly/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1124, in _run feed_dict_tensor, options, run_metadata) File "/home/lhb/.conda/envs/nsly/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1321, in _do_run options, run_metadata) File "/home/lhb/.conda/envs/nsly/lib/python2.7/site-packages/tensorflow/python/client/session.py", line 1340, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.UnknownError: exceptions.AttributeError: 'NoneType' object has no attribute 'astype' [[Node: PyFunc = PyFunc[Tin=[DT_STRING, DT_BOOL], Tout=[DT_FLOAT], token="pyfunc_1"](arg0, PyFunc/input_1)]] [[Node: IteratorGetNext = IteratorGetNextoutput_shapes=[[300,227,227,3], [1,?], [1,?], [1], [1]], output_types=[DT_FLOAT, DT_INT32, DT_INT32, DT_INT32, DT_INT32], _device="/job:localhost/replica:0/task:0/cpu:0"]]

Looking forward your reply,thanks !

[jackson1895]

#13