Thierno Ibrahima DIOP

icon location Dakar, Senegal icon location NLP/Deep learning research engineer

Results 5 issues of Thierno Ibrahima DIOP

BPE using sequence of bytes. HOW ?

1 comment

Hello, I read the paper about GPT 2 : it says that they used BPE on a sequence of bytes and that they only needed a vocab size of 256....

correcting bad size(size of the compressed file) used in read_data with processing in cap3

correct the size in the read_data with processing (chap3) by using a while loop, the size used in the code is the size of the compressed file which is not...

callback execution

the callback is executed automaticly when a notification is recieved is there a possiblity to wait for the user to clik the notification thx

fix typo

train_size referenced before assignment

9 comment

Hello, when trying to use the create-corpora -d corpora -f out/clips.tsv command i have the following error UnboundLocalError: local variable 'train_size' referenced before assignment caused by at line 115. Help...