XLnet-gen

XLnet-gen copied to clipboard

Hi, I tried using the Colab notebook you linked to in your README for this repo at: https://colab.research.google.com/drive/12u-CmB9evMIASNOqJtDW26gmNvSgepBv However, the last code cell raises an exception: ``` 2021-01-17 19:47:05.890096: I...

shaneh2

How to fine tune xlnet large model with new text using XLnet-gen?

3

Hi: Thanks for this repo. Text generation is my main interest and I was wondering how the xlnet large model can be fine tuned with new text then used as...

GenTxt

I run into the following error after inputting my prompt: ``` ----PROMPT---- Today I plan to WARNING:tensorflow:From language_generation.py:605: DatasetV1.make_one_shot_iterator (from tensorflow.python.data.ops.dataset_ops) is deprecated and will be removed in a future...

catyeo18

Can you update the code to Tensorflow 2? Thanks

urlocal12

TypeError: gather_nd() got an unexpected keyword argument 'batch_dims'

1

Any idea about this below error. Try to execute this. ``` Instructions for updating: Use keras.layers.dense instead. Traceback (most recent call last): File "language_generation.py", line 686, in main() File "language_generation.py",...

nvnvashisth

This is not a problem, but rather a discovery. I was working on a Japanese version of XLNet recently, due to lack of training data(nothing more than JPNWiki) and complexity...

illuminascent

Nothing happens when generating with the ---PROMPT---

3

``` ----PROMPT---- Hello world, this is some sample text that you can use!! WARNING:tensorflow:From /home/timisb/.local/lib/python3.6/site-packages/tensorflow/python/data/ops/dataset_ops.py:494: py_func (from tensorflow.python.ops.script_ops) is deprecated and will be removed in a future version. Instructions for...

timpal0l

OOM error on colab TPU when pretraining XLNet

1

I am sorry to bother you here with the problme about xlnet pretraining. I saw your comment on xlnet issues, you has the same error: Error recorded from outfeed: Bad...

cxa-unique

Thank you for the code and for wading through all of those einsum's to get things working! I'm trying to generate some text using tensorflow 2.0 and have thus far...

xsys-technology

Collab notebook results VS samples?

1

So I've tried using the collab notebook for conditional generation, but the results are nowhere near as long or as good quality as the samples listed in the Medium article....

zacharymacleod