Jonas Irgens Kylling
Jonas Irgens Kylling
> > Just support for `BigInteger` would be perfect, and probably cover most use cases. `DecimalType.SYSTEM_DEFAULT()` is `Decimal(38, 18)` right, so something else would be needed for `Decimal(38, 0)`? >...
> > Interesting, this is what is used for `BigDecimal` already? I tried writing a data frame based on data classes with a `BigDecimal` field to a table with schema...
Let me rephrase the question: How would I use the Kotlin Spark API to get a Spark data frame with schema `Decimal(38, 0)` having a single row with value `2`,...
> I just played around with it a bit. If you add `10..0` as `BigDecimal` it turns to `null` indeed. You need `BigInteger` encoding support to be able to get...
@zsxwing @scottsand-db Thank you for your patience! The PR has been updated to address most of the open review comments, and the feature is now behind the `delta.enableFastS3AListFrom` feature flag....
> Looks great! > > Sorry for the delayed review. This is a really exciting feature and we would LOVE to get it for Delta Lake 2.2. Awesome! It would...
Hey! I've also encountered a memory leak with [jaq](https://github.com/01mf02/jaq) because of this. I'm wondering if we can solve this use case by restricting and extending Chomsky's interface for recursive functions?...
There remains some work to decide on how to configure the bloom filters in Hive (and also Iceberg and Delta). We could do the following: For the Hive table properties:...
Sorry, I don't have a fix for the issue, besides aligning the `defualtBranch` in `.gitconfig` and the branch name used in the test. This is environment dependent though, so is...
Use cases where we can no longer assume that the commit and checkpoint files within the Delta log are immutable should likely just disable the cache on the coordinator. Having...