Knut Jägersberg

I read a few papers 2 weeks ago, but I can't recall them. As I get on the topic now, I found some interesting ones: https://github.com/ikergarcia1996/MetaVec SOTA claim. Also highly...

yes, this error keeps bugging me too. what i ended up doing was downloading the code, changing the error and rezipping it to make it installable without the error. important...

That would be awesome. I mean, it should be dead simple, but the issue I bump into is speed: fsts % as.numeric()) %>% arrange(number) pb

I think I have not used progress bar correctly, the total should be 40. Nonetheless, speed seems rather slow. Wont restart it though. it got 20 % now. Nonetheless, could...

im quite sure that is possible, I did that some time ago myself. with a parallel for loop. I remember, it worked.

by unparallizing data.table and using mclapply that was it I think. https://github.com/Rdatatable/data.table/issues/1727

so technically no for loop :)

aaand its done already. for a 50 gb file roughly 15 minutes ? that is acceptable, but could it be faster?

curiously, the bottleneck appears to be read.fst and not fwrite... one could parallelize read.fst and than write sequentially in a well timed manner? > system.time(fwrite(df, tempfile(), append = T)) user...

I've had this issue now, too. I used the R package and dbplyr. It was a join resulting in a biggish table (4 billion records, 2 columns). I was able...