scalding
scalding copied to clipboard
Unable to produce a parquet table with scalding
Hi to the scalding team I am trying to produce a parquet file with scalding, following example available at: https://github.com/twitter/scalding/tree/develop/scalding-parquet I succeeded to compile example using maven with both scala 2.10 and scala 2.11 Note that I got a stange error under Eclipse with scala 2.10 for this instruction: val sink = TypedParquetSink[SampleClass](outputPath) Error: I can't expand macro compiled with previous versions of scala
Running this job in local mode appears not allowed
I don't understand what is the right command to run it with an hadoop distribution Shall we used --hdfs, --hadoop2_mr1 ... ?? Have you any complete example of such a process please ? Thanks for your help