Szymon Tworkowski

icon indicating a website link https://syzymon.github.io

icon company University of Warsaw icon location Warsaw, Poland icon location PhD student @ University of Warsaw, interested in large language models.

Results 3 issues of Szymon Tworkowski

Effective train/eval batch_size is always 1 due to batcher default arg "variable_shapes=True"

### Description When providing inputs with a constant shape - for instance imagenet32 where examples are always of length *3072*, but it also applies e.g. to this config: https://github.com/google/trax/blob/master/trax/supervised/configs/reformer_imagenet64.gin and...

Reformer imagenet64 gin config - dataset loading failure

1 comment

### Description Imagenet64 dataset from tensor2tensor used in this gin config: https://github.com/google/trax/blob/master/trax/supervised/configs/reformer_imagenet64.gin seems to have some loading issues. I tried to run this config on Google Colab: https://colab.research.google.com/drive/1ysEQYOaIspHPBVu6S9jOxc7BkE2oDrh0 and ran...

Fix a typo in README.md