doric
doric copied to clipboard
Spark 3.1 new functions
Look into the following functions if they already are in doric or we have to add them:
From functions
- [x] def percentile_approx(e: Column, percentage: Column, accuracy: Column): Column ✅ covered in #184
- [ ] def nth_value(e: Column, offset: Int, ignoreNulls: Boolean): Column
- [ ] def nth_value(e: Column, offset: Int): Column
- [x] def acosh(e: Column): Column ✅ covered in #223
- [x] ~def acosh(columnName: String): Column~ :x: won't do, same function with DoricColumn
- [x] def asinh(e: Column): Column ✅ covered in #223
- [x] ~def asinh(columnName: String): Column~ :x: won't do, same function with DoricColumn
- [x] def atanh(e: Column): Column ✅ covered in #223
- [x] ~def atanh(columnName: String): Column~ :x: won't do, same function with DoricColumn
- [x] def assert_true(c: Column): Column ✅ covered in #184
- [x] ~def assert_true(c: Column, e: Column): Column~ :x: won't do, same function with DoricColumn
- [x] def raise_error(c: Column): Column ✅ covered in #184
- [x] def timestamp_seconds(e: Column): Column ✅ covered in #184
- [x] def slice(x: Column, start: Column, length: Column): Column ✅ covered in #109
From column
- [ ] def withField(fieldName: String, col: Column): Column
- [ ] def dropFields(fieldNames: String*): Column