framework-reproducibility

framework-reproducibility copied to clipboard

[WIP] Feature/patch/softmax cross entropy with logits

14

Addressing previously reported [tensorflow issue #38185](https://github.com/tensorflow/tensorflow/issues/38185). Also tied to `tfdeterminism` issues #19, #14, #9. Fused implementation of `{sparse_,}softmax_cross_entropy_with_logits` exhibits non-determinism in its backprop. This PR will provide a patch that...

MFreidank

Lack of reproducibility when using Huggingface transformers library (TensorFlow version)

11

Dear developers, I included in my code all the steps listed in this repository but still could not achieve reproducibility either using TF 2.1 or TF 2.0. Here's the link...

dmitriydligach

Getting OpenNMT-tf to train reproducibly

13

Hi, I'm trying to use this patch with Tensorflow 2.0, but the learning is still non-deterministic. I guess it is due to XLA optimization. How can I disable XLA? Bests,

atebbifakhr

added missing parentheses in tensorflow.md tf.config.experimental.enable_op_determinism()

faisal3325