nlp-tutorial

nlp-tutorial copied to clipboard

local variable 'MosesTokenizer' referenced before assignment

1

The corresponding package is installed and Data set downloaded，Run vocab.py . The following error occurred： “local variable 'MosesTokenizer' referenced before assignment”

pkly110

Question about validate acc

1

Thanks for your great job! I learned a lot. However, I have a question. I train the model for 7 epochs reaching a train acc of 95.2 and test(validate) acc...

ALUKErnel

Hi, I am curious about the inference part in the model. Does any example to show how it works? Many thank.

14H034160212

Hi, In cleaning function in the script : `nlp-tutorial/news-category-classifcation/preprocessing.py`, line 21 is written as `text = re.sub(r'[!]{2,}', '?', text) # multiple ?s -> ?`. There should be ? in first...

VirkSaab

Hi Lyeoni, First of all, thank you a lot for your work in making these tutorials, which are interesting ! I am trying to run the question-answer-matching tutorial and reproduce...

JeremyWau

neural-machine-translation - nmt ZeroDivisionError: integer division or modulo by zero

1

Traceback (most recent call last): File "", line 1, in runfile('D:/nlp-tutorial/neural-machine-translation/nmt/train.py', wdir='D:/nlp-tutorial/neural-machine-translation/nmt') File "C:\ProgramData\Anaconda3\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 827, in runfile execfile(filename, namespace) File "C:\ProgramData\Anaconda3\lib\site-packages\spyder_kernels\customize\spydercustomize.py", line 110, in execfile exec(compile(f.read(), filename, 'exec'), namespace)...

abdoelsayed2016

How about the speed of the model

2

JiyangZhang

Using the classifier

10

Hi After saving the model in news-category-classification, how do you actually use it to predict text classification? Can you put up an example, please?

davidniki02

num_samples should be a positive integer value, but got num_samples=0

1

python train.py --epochs 12 --batch_size 2 --learning_rate .001 --hidden_size 64 --n_layers 1 --dropout_p .1 number of trained word vectors of data/glove.6B.100d.txt: 400000 Traceback (most recent call last): File "train.py", line...

staticgsm

How could utilize GPU totally?

1

Thanks for your code! I found that when I do training, the GPU are not totally utilized. So it there is way to add batch to train more pairs at...

liuyaqiao