Thomas Klebel

https://github.com/HenrikBengtsson/future/issues/93

using jst_import_zip together with jst_read_ngram is excruciatingly slow

2

Possible bottlenecks: - Reading from zip (compare with other functions when read from zip) - Reading in parallel: The files are being read on separate processes but the data the...

Writing to sqlite seems simple. Follow the example at https://rud.is/books/21-recipes/looking-up-the-trending-topics.html#discussion

It could accept a vector with paths, and thus replace jstor_import. For this case, it should only accept a specification with one type of files (article OR book). jstor_import should...

if you search for a term, they generate a graph about dependencies with other terms. General information about their data could be interesting too: http://cls.corpora.uni-leipzig.de/de/deu_newscrawl_2011