Vaexization of some algorithm

[HajimeKawahara]

Commented by @erwanp. Consider replacing some parts in PreMODIT to use Vaex directly. I need to get a little more familiar with Vaex though.

[erwanp]

On my side I'd have to get a bit more familiar with premodit. Can we set up a quick call?

I understand that premodit does some kind of binning of lines. If that's the case, you can definitely do it in Vaex, I..e, before loading into RAM. Its slower than in RAM, but no memory usage.

Let's discuss more on Slack?

[HajimeKawahara]

Thanks! Yeah, let's go to Slack