Ronan Stokes
Ronan Stokes
## Expected Behavior Time intervals can be specified as "12 minutes, 2 seconds". You can also specify "1 minute, 2 seconds". You should be able to specify "1 minute 1...
## Expected Behavior ## Current Behavior ## Steps to Reproduce (for bugs) ## Context ## Your Environment * `dbldatagen` version used: * Databricks Runtime version: * Cloud environment used:
## Expected Behavior Add explicit support for Spark 3.2 (included in Databricks runtime 9.1) ## Current Behavior The current versions of the framework work in Databricks 9.1 (which is based...
If you have a named cluster specification in your Databricks environment and it had the current or a previous build of the datagenerator installed, when you uninstall the library and...
## Enhancement: Generate standard data sets It would be useful to be able generate standard data sets without having to define columns etc for quick demos and benchmarking of different...
Some users have requested the ability to generate 100 GB or 1 TB of data without specifying the number of rows
Currently you can generate simulated updates to an existing data set by either - sampling results from an existing dataset and updating fields - restricting the number of unique values...
## Proposed changes Draft PR for test coverage verification only Describe the big picture of your changes here to communicate to the maintainers. If it fixes a bug or resolves...
## Proposed changes Added support for rate-micro-batch source Added ageLimit option for rate source More extensive testing for streaming scenarios Note: still work in progress - PR opened to validate...
## Proposed changes Describe the big picture of your changes here to communicate to the maintainers. If it fixes a bug or resolves a feature request, please provide a link...