fst
fst copied to clipboard
Write to fst binary file with an apply-like method
trafficstars
This would reduce the memory footprint of writing to a fst file. It is also possible to use a parLapply approach, where data is generated in a parallel, but serialized to a fst file sequentially. In the latter scenario, we have to test the speed of data transfer from the nodes to the master, because it might be too slow for practical purposes (for example on a MPI cluster on Windows).