genie-toolkit icon indicating copy to clipboard operation
genie-toolkit copied to clipboard

Auto-annotation is very slow

Open gcampax opened this issue 3 years ago • 0 comments

It seems to be invoking the Python script for every single sentence to autoparaphrase, which causes the model to load from disk and initialize, and doesn't take advantage of sentence batching. (Not sure if the problem is the auto-paraphrase part or the BERT lexical expansion part. The debugging is too noisy.)

gcampax avatar Jul 09 '20 21:07 gcampax