metadata-digger icon indicating copy to clipboard operation
metadata-digger copied to clipboard

Published 20 hours ago • verified publisher icon data-hunters

Tag names are not converted according to specified convention for JSON

Open jc-a3s opened this issue 5 years ago • 0 comments

When json output is specified in configuration, tag names are not converted. It's because this process in ColumnNamesConverter class is based on DataFrame schema but in case of JSON output format we have embedded structure. Things to do:

  • Retrieve fields of Map type
  • Iterate over the fields and change keys of the Map using withColumn function or any other similar.

jc-a3s avatar Nov 09 '19 13:11 jc-a3s