fst
fst copied to clipboard
fstpackage
Lightning Fast Serialization of Data Frames for R
The VCL vector class library is a tool that allows for much faster C++ code by handling multiple data in parallel using SIMD instructions. The highest available SIMD instruction set...
The `integer64` type uses a `double` vector at it's base. Currently, this vector is compressed using the same compression schemes ar for `double` type columns. But knowing the type is...
When saving to a network drive without compression I get about 50Mbps and with compression at 100 I get 8Mbps. Saving to a local drive however is much much faster...
The build-in dictionary could speed-up compression of character columns significantly. Alternatively, we could use the ZSTD compressor with a pre-trained dictionary.
Hi, nice package! It would be a great competitor to feather package if it was compatible with python pandas dataframes. Any plan to make it available in python? Cheers, Benoit...
Something I would find incredibly useful is to be able to run select-like queries when reading from fst. Given that data.tables have keys I was thinking that either this data.table...
By specifying a condition on one or more columns of the stored table, data can be read using far less memory than a full read combined with a selection of...
Is it possible to append to an fst without having to load it (completely)?
Metadata
Owner
Metadata
Lightning Fast Serialization of Data Frames for R