doric icon indicating copy to clipboard operation
doric copied to clipboard

Spark 3.1 new functions

Open eruizalo opened this issue 2 years ago • 0 comments

Look into the following functions if they already are in doric or we have to add them:

From functions

  • [x] def percentile_approx(e: Column, percentage: Column, accuracy: Column): Column ✅ covered in #184
  • [ ] def nth_value(e: Column, offset: Int, ignoreNulls: Boolean): Column
  • [ ] def nth_value(e: Column, offset: Int): Column
  • [x] def acosh(e: Column): Column ✅ covered in #223
  • [x] ~def acosh(columnName: String): Column~ :x: won't do, same function with DoricColumn
  • [x] def asinh(e: Column): Column ✅ covered in #223
  • [x] ~def asinh(columnName: String): Column~ :x: won't do, same function with DoricColumn
  • [x] def atanh(e: Column): Column ✅ covered in #223
  • [x] ~def atanh(columnName: String): Column~ :x: won't do, same function with DoricColumn
  • [x] def assert_true(c: Column): Column ✅ covered in #184
  • [x] ~def assert_true(c: Column, e: Column): Column~ :x: won't do, same function with DoricColumn
  • [x] def raise_error(c: Column): Column ✅ covered in #184
  • [x] def timestamp_seconds(e: Column): Column ✅ covered in #184
  • [x] def slice(x: Column, start: Column, length: Column): Column ✅ covered in #109

From column

  • [ ] def withField(fieldName: String, col: Column): Column
  • [ ] def dropFields(fieldNames: String*): Column

eruizalo avatar Jun 24 '22 12:06 eruizalo