Liran

Results 46 comments of Liran

We have 2 options either not sending a partitionBy config and then partitions are ignored and com.uber.hoodie.NonpartitionedKeyGenerator is used to partition. Or write a simple unknown partition: ``` steps: -...

@drinks5 can you try the following JAR and let me know if that works for you? https://github.com/YotpoLtd/metorikku/releases/download/v0.0.125/yarn_metorikku_2.11.jar or https://github.com/YotpoLtd/metorikku/releases/download/v0.0.125/yarn_metorikku_2.12.jar

You are right dates are not supported currently in our Json schema implementation. As a workaround load it as string and use SQL function to_timestamp or to_date as documented here:...

Do you mean to add a writer that outputs to some restful API?

Can you share your spark submit as well?

if you're running spark-sql -e "select * from employee" you're seeing information?

Also are you seeing an empty parquet? Or nothing is being written?

I'm wondering if maybe it's writing to the local FS instead of HDFS, can you add the following to your job config: ```showPreviewLines: 10``` Can you see in the STDOUT...

This is the entire output from the spark-submit? If so, it looks like it's not running any steps... malformed YAML? can you paste the job/metric YAML here with backticks so...

Sorry for the late reply... I think outputType: parquet should be outputType: Parquet