DeepPavlov icon indicating copy to clipboard operation
DeepPavlov copied to clipboard

Reducing amount of download files and memory strain for OBQA by using wikipedia api instead of local downloads.

Open Aryagm opened this issue 3 years ago • 0 comments

Want to contribute to DeepPavlov? Please read the contributing guideline first.

What problem are we trying to solve?:

The OBQA model needs very large download files and lots of RAM.

How can we solve it?:

Maybe we can use the[ wikipedia api](https://pypi.org/project/Wikipedia-API/) to get the text in the article instead of  storing the articles locally.

Are there other issues that block this solution?:

Not sure.

Aryagm avatar May 10 '21 13:05 Aryagm