awesome-spark
awesome-spark copied to clipboard
[ADD] G-Research Spark Extension
Description
- Name: G-Research Spark Extension
- URL: https://github.com/G-Research/spark-extension
- License: Apache-2.0
Why
This project provides several transformation functions for Spark (both Scala and Python), like global row number, writePartitionedBy, groupByKey and so on.
Checklist
- [X] Item hasn't been proposed yet (there is no open PR, it hasn't been rejected or removed).
- [X] Item is added at the on of the relevant section.
- [X] Description ends with period and doesn't contain trailing whitespace.
Code of Conduct
- [X] I agree to follow Awesome Spark's Code of Conduct.
BTW, I'm not sure that is the difference between "General purpose Libraries" and "Utilities". Maybe these sections should be merged into one.
This PR is being marked stale because it hasn't been updated in a while Typically, it means that none of the maintainers is familiar enough with the proposed addition, to personally recommend it.
Please note, that proprietary resources, are less likely to be included.
To increase chances of the proposed addition being approved, please be sure to provide enough information about the project, including but not limited to, explanation why it is a good fit for this list.