fst
fst copied to clipboard
fstpackage
Lightning Fast Serialization of Data Frames for R
`fst` is a good function to get the general information, I think meta_fst could be renamed as "summary_fst" for the list returned by `fst`. Both `fst` and `meta_fst` recieves the...
Came across the [FSST repository](https://github.com/cwida/fsst) today and wondered if this approach might be an improvement for string compression in `fst,` as long as the column type was known or assumed...
Hi, Love the package! But I've got a sticky problem. I wrote a program that writes millions of .fst files in parallel. Some of these, it turns out, are corrupt...
I have a dataset of car trips. The dataset has four columns ( trip_id timestamp, lat, lon) , and each trip_id will have a few hundreds rows with points showing...
My use case is that I have multiple data frames (each 1-3GB) in which there are several integer columns and 50+ double columns, I need to write them to `/dev/shm/`...
How about implementing the best encryption/information security features?
This might be a simple or complex feature request. Basically, from my testing FST seems to be a great way of storing very large (many GB) 2D images and then...
I came across this blog post, sqlite is much faster in their case. I think it is because the which operation is very slow, what do you think? https://kbroman.org/blog/2017/04/30/sqlite-feather-and-fst/
The following code is a minimal example of what I do to generate many `data.table` and store them in `fst` in parallel. To ensure that all `fst` files written on...
user case: need to append market data recorded everyday to existing historical market data. Thank you for this great package!
Metadata
Owner
Metadata
Lightning Fast Serialization of Data Frames for R