parquetize

parquetize copied to clipboard

Replace read_delim by read_delim_arrow

1

In `csv_to_parquet()` function, it would be graet to replace [read_delim()](https://readr.tidyverse.org/reference/read_delim.html) from {readr} with [read_delim_arrow()](https://arrow.apache.org/docs/r/reference/read_delim_arrow.html) from arrow, which would improve performance.

ddotta

evol: add an option to check arguments passed by user

3

Hi @ddotta, A first implementation to allow arguments checking. We can do the same thing to check the returned dataset. It will be even simpler, the function will just take...

nbc

Add a `duckdb_to_parquet` using low level arrow functions

3

Just to signal that I wrote an enhanced interface to SQL that is in https://github.com/jllipatz/SQL. That's just WIP... _Originally posted by @jllipatz in https://github.com/ddotta/parquetize/issues/27#issuecomment-1508256414_

ddotta

Add in the other functions of parquetize the functionality with chunks proposed in `table_to_parquet()`

1

ddotta

To reassure the owners of the original data : - Structure of data - Number of rows/cols...

ddotta