Jonathan Shen

Hi, we are looking into it. Please give us some time.

Hi, we added a unit test in https://github.com/tensorflow/lingvo/commit/51724298228462ed3887c0ef605240bec3853ad4 and were unable to reproduce this. Do you also get the same error with num_cnn_layers > 0? Please double check your input...

Hi, we cannot offer detailed debugging help to all users. Please try to debug it as much as you can yourself. If you check FProp(), `self.proj[i].FProp()` happens after the rnn...

We have not tested this setup. However, we should be compatible with whatever tensorflow standard ways there are to set it up.

tl;dr you want worker_split_size=1 A split is one minibatch of inputs. With worker_split_size=2 you're saying that each minibatch should be given two gpus, but in this case the model you're...

For the sync case, can you paste more of the error (eg. where the slice operation is defined) For the async case, I think there is a bug here https://github.com/tensorflow/lingvo/blob/1aba0c93ae9592af88e43460aad9d19fa5b87e5a/lingvo/trainer.py#L1677...

It looks like it's trying to split the input batch onto the two devices and failing. Can you make sure that everything in the input batch being returned from your...

Hi, we don't have any immediate plans to push these features. I will keep this issue open and update it when it is pushed.

Seems to be a common problem with RTX cards https://github.com/tensorflow/tensorflow/issues/24496 according to that thread setting allow_growth=True fixes it

Pull requests are completely welcome, see https://github.com/tensorflow/lingvo/blob/master/CONTRIBUTING.md There is no CI on github but the PR is run through internal CI on our side. The commit will also be made...