pega-datascientist-tools Use arrow also for internal reading in readDSExport R function

Use arrow also for internal reading in readDSExport R function

Open operdeck opened this issue 4 years ago • 3 comments

Consider arrow package for fast reading (& writing perhaps) of LDJSON files and even ordinary csv.

Nov 12 '21 10:11 operdeck

Implemented in Python in PR #32

Dec 15 '21 13:12 StijnKas

Using it also in ADMDatamart function in R. TODO use it also when reading the data.json from the export zips.

Dec 16 '21 20:12 operdeck

Arrow already used by R's ADMDatamart but to be used internally also when reading the data.json file from a DS export

Dec 24 '21 11:12 operdeck