fst

fst copied to clipboard

Single value subsetting (i.e. `[[`) interface

1

All of base R data.frames, data.tables and tibbles support `x[[i, j]]` type subsetting. While I realise that there is quite a bit of heterogeneity (among the mentioned packages) in how...

nbenn

benchmark against parquet

1

Could you add the benchmark of fst against parquet?

waynelapierre

Github actions compile troubles

2

I assume this is closely related to #226 and at least in part to #238 but I decided to open a separate issue because #226 is marked as resolved (and...

nbenn

Question: What are the minimum and maximum number of cores I need for which fst's performance is optimized?

1

Hi all - Thank you for developing this very cool package! I run my processing / analysis workflow on my work's HPC cluster. Usually I distribute the work by simply...

strazto

fstmetadata not being to read some files where `c:/users/path`

5

I work in a corporate environment and I don't have admin rights to the my Windows machine. What this means is that I can't write to `c:\` nor `c:\users\` but...

xiaodaigh

Inverse column selection

1

Is it possible (and if not could it be implemented) to inversely select colums? If I have a file with columns v1:v5 I could use `columns = c("v1", "v2", "v3")`...

Moohan

Feature request: data-integrity check by adding hashvalue

3

Data integrity is pretty important in the organization I work for. Accountants ask for 'hashvalues' of datasets, when they perform audits. It must be certain that the right dataset is...

petermuller71

Optionally reduce block and buffer sizes

1

As noted at https://github.com/richfitz/storr/pull/111#issuecomment-510237712, this could conserve memory without sacrificing speed, and it could improve load balancing among threads.

wlandau

Optional connection argument to compress_fst

2

Writing directly to a connection could help conserve memory. Suggested at https://github.com/richfitz/storr/pull/111#issuecomment-509136783.

wlandau

Write failure corrupts existing file

5

```r require(fst) # 0.9.0 df

arunsrinivasan