Oleks V

Issue 207: Add Sentinels support for spark-redis library

3

Adding sentinel support. This is working solution, we badly needed sentinels for our use case. WIth this fix its working in our organization

Fixed serde issue when reading/writing a dataframe in binary mode. Please consider next example ```scala case class Outer( arr0: Array[Inner], str0: String, str1: String, arr1: Array[String], str2: String) case class...

Added examples to use Map.get(missingKey)

Adding Planning status to UI filter

2

Currently there is no Planning filter in UI on Jobs Tab. Its immensely difficult to traverse all jobs to find reflections that are waiting for other reflection to complete. Currently...

Make Query result limit value configurable instead of hardcoded 500 to reduce roundtrips to support also queries returning dozens of thousands rows with a few columns

2

With 500 hardcoded value its extremely unperformant having roundtrips to collect large amount of data. As for now Dremio doesnt allow to download results for queries posted via REST API,...

LAG window function schema issue. Non null conflict.

1

### Describe the bug ``` select lag(a) over () as x1 from (select 2 id, 'b' a union all select 1 id, null a union all select 3 id, null);...

Implement IGNORE NULLS for window functions

7

### Is your feature request related to a problem or challenge? Now DataFusion lacks the IGNORE NULLS support for Window functions ``` DataFusion CLI v35.0.0 ❯ select lag(a) ignore nulls...

fix Sort Merge Join to pass TPCH tests

5

I was trying to mark the Sort Merge Join as stable and run TPCH tests with SMJ enforced. Got the issue below, we need to fix before returning to discuss...

There are some places in Datafusion doing assertions which leads the application to crash. Its better to replace assertions with error wherever possible Example: `assert_eq!` here to keep it consistent...

Improve DataFusion error handling

1

### Is your feature request related to a problem or challenge? I'm trying to collect known issues related to error handling in datafusion. So far I can see different categories...