Duncan Riach

I've been trying different batch sizes and number of steps. There seems to be a non-determinism effect that kicks-in with larger batch size and a seemingly independent effect related to...

@MFreidank, we (@wenscarl and I) have isolated the remaining source of nondeterminism in this model. See [this comment](https://github.com/tensorflow/tensorflow/issues/39751#issuecomment-715456763) on TensorFlow [Issue 39751](https://github.com/tensorflow/tensorflow/issues/39751) for more information about the source. We have...

Update, @wenscarl has confirmed that the patch we are about to release (to be enabled via `fwd9m.tensorflow.enable_determinism`) will resolve the final source of nondeterminism in this model, causing it to...

Hi @Zminghua, I don't have an estimated release date for the patch, but it's relatively high priority for us. The patch will work with TensorFlow version 2.3 and earlier. A...

Oh, you're welcome. Right, you can just clone the code and use it, of course, rather than waiting for the PyPI release.

Update: we have confirmed that `fwd9m.tensorflow.enable_determinism`, which currently includes patching of `segment_sum` and `unsorted_segment_sum` will, in fact, work on TensorFlow 2.4.0. I don't understand why this is. It's not what...

Hi @phqtuyen, Please pull the `master` branch and try again. This was a bug that only showed up with stock TensorFlow versions 1.14 through 2.0. It was fixed in the...

This should be fixed in TF 2.7 by PR [51861](https://github.com/tensorflow/tensorflow/pull/51861). Please will someone confirm so that this issue can be closed.

Thanks for the suggestion, @h-grieve. I have made a note of your request. You are probably already aware of [this list](https://pytorch.org/docs/stable/generated/torch.use_deterministic_algorithms.html#torch.use_deterministic_algorithms), although it may not contain the detail you desire....

Hi Youngsam, First of all, please will you come to the issue on the GitHub web app and edit your comments. By responding to the emails from GitHub, you've added...