byzer-lang icon indicating copy to clipboard operation
byzer-lang copied to clipboard

#1812 Add !fs utils getmerge support

Open allwefantasy opened this issue 2 years ago • 0 comments

What changes were proposed in this pull request?

Test Script:

load delta.`python_data.vega_datasets` as vega;
save overwrite vega as csv.`/tmp/vega` where fileNum="4" and header="true";

!fs -rm /tmp/output.csv;
-- !fs utils getmerge "/tmp/vega/*.csv"  /tmp/output.csv 1
!fs utils getmerge _ -source "/tmp/vega/*.csv"  -target /tmp/output.csv -skipNLines 1;

load  csv.`/tmp/output.csv` where header="true" as tt;
-- select count(*) from vega as output;
select count(*) from tt as output;

How was this patch tested?

Manually

Are there and DOC need to update?

Spark Core Compatibility

ALL

allwefantasy avatar Aug 11 '22 08:08 allwefantasy