orc icon indicating copy to clipboard operation
orc copied to clipboard

orc-tools unknown subcommand "Merge"

Open echoeslove opened this issue 1 year ago • 3 comments

follow https://orc.apache.org/docs/java-tools.html

execute

java -jar orc-tools-2.0.0-uber.jar merge

display

Unknown subcommand: merge

echoeslove avatar May 05 '24 14:05 echoeslove

Ya, thank you for reporting.

It will be delivered via ORC 2.0.1 in two weeks.

https://issues.apache.org/jira/browse/ORC-1644

dongjoon-hyun avatar May 05 '24 15:05 dongjoon-hyun

This will be resolved via #1928 .

dongjoon-hyun avatar May 09 '24 03:05 dongjoon-hyun

Now you can use 2.0.1 version.

wget https://repo1.maven.org/maven2/org/apache/orc/orc-tools/2.0.1/orc-tools-2.0.1-uber.jar

prepare data

echo -e "1,foo\n2,bar" > 1.csv
echo -e "3,apache\n4,orc" > 2.csv
java -jar orc-tools-2.0.1-uber.jar convert 1.csv --schema  'struct<c1:int,c2:string>'  --output 1.orc
java -jar orc-tools-2.0.1-uber.jar convert 2.csv --schema  'struct<c1:int,c2:string>'  --output 2.orc

use merge command

java -jar orc-tools-2.0.1-uber.jar merge --output merge.orc 1.orc 2.orc
Output path: merge.orc, Input files size: 2, Merge files size: 2

dump

java -jar orc-tools-2.0.1-uber.jar meta -d merge.orc
Processing data file merge.orc [length: 546]
{"c1":1,"c2":"foo"}
{"c1":2,"c2":"bar"}
{"c1":3,"c2":"apache"}
{"c1":4,"c2":"orc"}

cxzl25 avatar May 16 '24 04:05 cxzl25