Gaffer icon indicating copy to clipboard operation
Gaffer copied to clipboard

Create a ExportToLocalFile Operation

Open p3430233 opened this issue 2 years ago • 3 comments

Create a ToFile operation that writes an Iterable of strings to a CSV file

p3430233 avatar Jul 13 '22 15:07 p3430233

@p3430233 - in what file format? Just Linux?

n3101 avatar Jul 19 '22 09:07 n3101

As a useful follow on from https://github.com/gchq/Gaffer/issues/2675, an ExportTo Operation should be created called ExportToLocalFile. This will take an iterable of Strings (like created by ToCsv) and save it to a local file. This is a useful operation for local data science work with Gaffer.

t92549 avatar Aug 03 '22 12:08 t92549

We should ensure this works "lazily", i.e. it will iterate through results and write them as they come in (perhaps in bulk), so files larger than available memory can be written. Tests for this should be made.

t92549 avatar Aug 03 '22 12:08 t92549

Closed by https://github.com/gchq/Gaffer/pull/2729

t92549 avatar Aug 31 '22 14:08 t92549