scalding icon indicating copy to clipboard operation
scalding copied to clipboard

Unable to produce a parquet table with scalding

Open catherineverdiergo opened this issue 8 years ago • 0 comments

Hi to the scalding team I am trying to produce a parquet file with scalding, following example available at: https://github.com/twitter/scalding/tree/develop/scalding-parquet I succeeded to compile example using maven with both scala 2.10 and scala 2.11 Note that I got a stange error under Eclipse with scala 2.10 for this instruction: val sink = TypedParquetSink[SampleClass](outputPath) Error: I can't expand macro compiled with previous versions of scala

Running this job in local mode appears not allowed

I don't understand what is the right command to run it with an hadoop distribution Shall we used --hdfs, --hadoop2_mr1 ... ?? Have you any complete example of such a process please ? Thanks for your help

catherineverdiergo avatar Jan 10 '17 11:01 catherineverdiergo