genie-toolkit
genie-toolkit copied to clipboard
Auto-annotation is very slow
It seems to be invoking the Python script for every single sentence to autoparaphrase, which causes the model to load from disk and initialize, and doesn't take advantage of sentence batching. (Not sure if the problem is the auto-paraphrase part or the BERT lexical expansion part. The debugging is too noisy.)