spark-json-schema
spark-json-schema copied to clipboard
zalando-incubator
JSON schema parser for Apache Spark
Hi, I am trying to use this library to convert json-schema to Spark Structs. Using scala version 2.12.14 ``` import org.zalando.spark.jsonschema.SchemaConverter import scala.io.Source val schemaUrl = "https://raw.githubusercontent.com/CMSgov/price-transparency-guide/master/schemas/allowed-amounts/allowed-amounts.json" val html =...
Hey, I tested this awesome library with json schema with recursive objects and this cause Stack overflow Exception. In my opinion the library should generate a structType with a configurable...
I have schema where **allof** key has been used and this module is not able to parse this keys.
Add support for decimal type #43 and timestamp type #37 decimal type has optional parameters precision and range (spark default are 10 and 0). example: ``` "decimal_field": { "type": "decimal",...
Are you planning to add timestamp type to the json schema?
Proposed support for required fields. See [#41](https://github.com/zalando-incubator/spark-json-schema/issues/41)
Since JSON schema draft 4 object definition supports a `required` property. This property is an array of fields that should be present in the object instance. Fields that are not...
Updating `spark-sql` version 2.0.1 => 2.4.3 Adding two test cases for references of multiple types. I found not obvious from the tests cases how the conversion of references like the...
Hey guys, I am trying to generate spark json schema for below format- { "$schema": "http://json-schema.org/draft-04/schema#", "type": "object", "properties": { "maintenanceWorkOrder": { "type": "object", "properties": { "workOrderNumber": { "type": "string"...
Hello, We have some long digits of numbers coming in as number or integer. The precision could be up to 15 digits. The numbers get rounded up. Are we able...
