fst

fst copied to clipboard

UTF-8 Encoding Info Loses If The First String Is ASCII

15

Hi, there's a bug in the dev version. The utf8 encoding doesn't get preserved if the first string is ASCII. See the reproducible example below, thanks. ``` r library(fst) library(data.table)...

shrektan

How to extract contents from a fst file when R crashes reading it

2

Hey everyone, first of all thank you for this package, which is quite helpful in our work. For the first time after writing and reading a lot files already, I...

gabowi

"Embedded nul in string" error in large files

23

I tried to load the following (zipped) tsv file with fread and then saved using write_fst (specifying uniform_encoding=F). http://www.patentsview.org/data/20170808/uspatentcitation.zip or http://www.patentsview.org/data/20170808/rawinventor.zip Tried to load fst file, but get the following...

hyokangs

On the surface, it appears fst is in compatible with R 4.1 installs using Rcpp 1.0.6. Curiously, though, I have one machine that's somewhat behind on updates with R 4.0.5...

twest820

Progress bar when read/write

1

Thank you for creating this awesome package, and it has been my go-to package whenever I save big files on disk. I hope to see the progressbar when I read/write...

matthewgson

Function `fst` not working when the directory has Chinese

1

I have tried several times and find that the function `fst` will yield the following error if the path has Chinese characters:  Any solutions? Thanks.

hope-data-science

Hello, I tried to save a table named "enquête" into a file with the same name. : write.fst(enquête,"Z:/enquête.fst") It seems that the french character "ê" is translated to UTF8 before...

jllipatz

compression size on highly redundant data

5

Hi Mark, I was wondering if you've an explanation as to why the compression from `fst` on this particular data.frame seems to end up with larger size compared to native...

arunsrinivasan

Can't read 0 columns of a fst file

4

``` > read.fst(..., columns = character()) Error in res$resTable[[1]] : subscript out of bounds ``` If you're wondering why I'd want to do this, it's that I just wanted to...

Kodiologist

read_fst() checks for incomplete fst files

3

I am running R on a Mac with a M1 chip. When I use the following code chunk R crashes with a 'floating point exception': ```{R} q = fst::fst("large_file.fst") q...

j-kreis