Ronan Stokes
Ronan Stokes
You can also install in a Databricks notebook environment using the %pip command in a notebook cell. The %pip command does not illustrate the issue above. To install the library...
Newest versions will be based on Databricks runtime 9.1 LTS or later
Thanks for your feedback - i'll review the above and look into it
I'll add a fix for this - for now there are several workarounds: ``` df_spec = (dg.DataGenerator(spark, name="test_data_set1", rows=data_rows, partitions=spark.sparkContext.defaultParallelism) # generate array with same data definition for each element...
Thanks for your feedback If the baseColumnType is `hash`, then the generated column for customer_id will compute a hash of the base column - by default , the column named...
A couple of comments : 1 - the FakerText integration is not deterministic at present - so running multiple times will produce different results 2 - I'll look at the...
Overall data is repeatable from run to run with the exception of use of the Faker plugins and data generated from templates The following code will generate a psuedo first...
Issues related to generation of template text values will be in the next release (v0.2.2)
Hi Souvik Are these all sourced from open source projects with open source licenses ?
this will be a post initial release enhancement