mesh

mesh copied to clipboard

Line 13 in lm1b.gin "dataset.get_tfds_vocabulary.dataset_name = %dataset_name" causes an error There is no function named "get_tfds_vocabulary" in /mesh_tensorflow/transformer/dataset.py To fix the error the line can be replaced with "vocabulary.get_tfds_vocabulary.dataset_name=%dataset_name"

ulapopov

[Run the Transfomer model (no Tensor2Tensor dependencies)](https://github.com/tensorflow/mesh#run-the-transfomer-model-no-tensor2tensor-dependencies) The file "examples/transformer_standalone.py" does not exist anymore. There is a [pull request](https://github.com/tensorflow/mesh/pull/30/files) and transformer_standalone.py has been replaced by mesh_tensorflow.transformer.main 9 months ago, but...

ulapopov

I like to run the following Keras example deduced from [here](https://www.kaggle.com/niyati11/project-convo1d) ```python # 1D CNN neural network model_m = Sequential() model_m.add(Reshape((TIME_PERIODS, num_sensors), input_shape=(input_shape,))) model_m.add(Conv1D(100, 10, activation='relu', input_shape=(TIME_PERIODS, num_sensors))) model_m.add(Conv1D(100, 10,...

taless474

set default maximum group size for allreduce-in-bfloat16 to 8.

copybara-service[bot]

I'm wondering if tf2 is absolutely needed in mesh_tensorflow/utils.py? I'm trying to reproduce on the provided Google colab https://github.com/tensorflow/tensor2tensor/tree/master/tensor2tensor/rl with tensorflow 1.13.1 and T2T 1.13.1 (the recommended config), but I...

snowbabyjia

Is it possible to split it such that layers are split along some dimension of the mesh too? For example: Mesh shape: `x:16,y:32` Layout: `layers: x, hidden: y` If I...

leogao2

spelling error

3

spelling error in Transformer spelling

kartikeyaGUPTA45

Hello I found a bug (brackets missing) about mesh tensorflow. Please check the code. https://github.com/tensorflow/mesh/blob/master/mesh_tensorflow/simd_mesh_impl.py Line 882: return _default_value It should be return _default_value() , right ? Regards, Andy

AsukiLiu

[Bug Fix] Evaluation and Prediction for Aligned model

1

Hello, Both evaluation and prediction currently not working with the aligned model "Bert Style". I have fixed this issue by adding a new if statement in "transformer/utils.py": ``` elif mode...

agemagician

Make log_step_count_steps and save_summary_steps gin configurable for configurable logging frequency.

jinoobaek-qz