fst

fst copied to clipboard

Fixes the error below if there is a 0-row fst table being called. c.f. [#99 ](https://github.com/fstpackage/fst/issues/99) ```R library(fst) # create a 0-row data frame noRows = data.frame(aa=numeric(0), bb=character(0), cc=logical(0)) fst::write_fst(noRows,...

AndyTwo2

R crashes while reading an fst file

15

A simple fst read can send R crashing down, if the file is corrupted ! How could a data file be so bad that it sends R crashing? Perhaps the...

sanjmeh

I've really enjoyed using `fst` — the read/write and compression are wonderful. Sometimes I create problems for myself when I try to read a column that doesn't exist in a...

adviksh

attributes are not saved

1

Including row.names: ```r df

OfekShilon

write_fst Seems To Skip Small Tables When Writing In A for Loop

5

I am using `fst` version 0.9.8 with R-4.3.2. I am writing 'data.table' class data frames in a `for` loop. The tables have different number of rows as they are the...

drag05

relatively new install issue

7

ERROR: dependency ‘fstcore’ is not available for package ‘fst’ ``` huf_decompress.c:(.text+0x3b9f): undefined reference to `HUF_decompress4X1_usingDTable_internal_fast_asm_loop' /usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: ./libZSTD.a(huf_decompress.o): relocation R_X86_64_PC32 against undefined hidden symbol `HUF_decompress4X1_usingDTable_internal_fast_asm_loop' can not be used when making...

iwelch

Compression rate to minimize reading time?

2

Thank you so much for all your great work. I wondered which compression factor would minimize reading time for large files with e.g. 100 million observations, if I'm not concerned...

frederickluser

Can `read_fst` use a filter condition beforehand?

1

The `from` and `to` parameters in `read_fst` is great. I wonder if we can use a filter to select only the rows we needed. If this could be done on...

hope-data-science

Big-endian seems to work: maybe remove misleading requirement on CRAN?

3

CRAN lists little-endian as a requirement. Why is it so? What may be needed to add big-endian support? P. S. `fstlib` claims that it can be compiled on all major...

barracuda156

Why is the first read slower?

2

I notice that in fresh session first use of `read_fst` is slower than next uses. The same file. The same number of cores. Just running the same command again. RStudio...

tentacles-from-outer-space