cassandra-loader icon indicating copy to clipboard operation
cassandra-loader copied to clipboard

Loader can't load data to a table with a UDT column

Open rs017991 opened this issue 10 years ago • 6 comments
trafficstars

It would be really great for the loader to support User-defined types.

Note that collections may contain UDTs and UDTs may contain collections/other UDTs, so CQLDelimParser.schemaBits(...) would need to support some level of recursion.

Side note: The skipCols options cannot be used to skip over a column with a non-supported type because parsers are eagerly built.

rs017991 avatar Nov 06 '15 15:11 rs017991

Skip columns would work if you quoted the UDT, or if the UDT did not have embedded delimiters.

brianmhess avatar Nov 10 '15 20:11 brianmhess

Indeed it would be great to have support to UDTs

diegopeleteiro avatar Apr 12 '16 11:04 diegopeleteiro

The tool is great. I really loved it. Is there any solution to UDT types other than skiping the columns? My data have sets and collections and the unloader tool gives the error below:

Exception in thread "main" java.util.concurrent.ExecutionException: java.text.ParseException: Set data type not recognized (udt) at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.datastax.loader.CqlDelimUnload.run(CqlDelimUnload.java:402) at com.datastax.loader.CqlDelimUnload.main(CqlDelimUnload.java:471)

trex77 avatar Dec 11 '18 06:12 trex77

There is a udt branch you could try. I think that got pretty solid, but I haven't been working on this in a while.

brianmhess avatar Dec 21 '18 18:12 brianmhess

This utility support UDTs?

kalpana04-star avatar Jun 02 '20 13:06 kalpana04-star

Check out the "udt" branch. You may also want to look at the dsbulk utility from DataStax.

brianmhess avatar Jun 03 '20 18:06 brianmhess