doric
doric copied to clipboard
hablapps
Type safety for spark columns
## Description (relatively ) new doric functions: * **`Array[String]` columns**: * there is now a function called `mkString` like scala. Actually it is the `concat_ws` function from spark. * **`Decimals`...
Feature suggestion Spark [3.3.3](https://spark.apache.org/releases/spark-release-3-3-3.html) has been released. We should: - ~Update sbt to be this version the default version~ - [ ] Update CI - [ ] Update docs -...
Feature suggestion Spark [3.4.0](https://spark.apache.org/releases/spark-release-3-4-0.html) has been released. We should: - [x] Update sbt to be this version the default version #346 - [x] Update CI #346 - [x] Update docs...
Feature suggestion Spark [3.4.1](https://spark.apache.org/releases/spark-release-3-4-1.html) has been released. We should: - [ ] Update sbt to be this version the default version - [ ] Update CI - [ ] Update...
Feature suggestion Spark [3.2.4](https://spark.apache.org/releases/spark-release-3-2-4.html) has been released. We should: - ~Update sbt to be this version the default version~ - [ ] Update CI - [ ] Update docs -...
Look into the following functions if they already are in doric or we have to add them: From functions - [x] def percentile_approx(e: Column, percentage: Column, accuracy: Column): Column ✅...
Look into the following functions if they already are in doric or we have to add them: From functions: - [ ] def max_by(e: Column, ord: Column): Column - [...
### Feature suggestion Given `dc: DoricColumn[Person]` We would like to access fields of struct columns with the dynamic interface as follows: `dc.name: DoricColumn[String]` so that doric infers the type of...
### Feature suggestion The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/ - [x] set-output - dawidd6/action-download-artifact #328...