Himadri Pal comments

Results 11 comments of


                                            Himadri Pal

Support Rewrite Datafiles into a custom Partition Spec

here is a revised PR #9803 for this issue for spark 3.5

Add support for providing output-spec-id during rewrite - spark 3.5

Thanks for reviewing @RussellSpitzer, fixed all the review comments.

Sql catalog

@JanKaul WDYT? I think this PR is ready for review, I can add the update and delete in a separate PR.

Implement Spark-compatible cast between decimals with different precision and scale

I was trying to take a look at this one - I added this test in the CometCastSuite - ```scala test("cast between decimals with different precision and scale") { val...

Implement Spark-compatible cast between decimals with different precision and scale

thank you @andygrove for the guidance and tip. I'll explore `spark.comet.explainFallback.enabled=true` as well.

Implement Spark-compatible cast between decimals with different precision and scale

this [arrow pr](https://github.com/apache/arrow-rs/pull/6836) will fix this issue completely. waiting for [arrow release](https://github.com/apache/arrow-rs/issues/6342) and then Datafusion release later.

Implement Spark-compatible CAST from String to Decimal

I was looking at this issue and now - with comet enabled and comet disabled shows same result - ```sql +-----+-----------+ | n| converted| +-----+-----------+ |-10.0| -10.00| | +1.0| 1.00|...

Implement Spark-compatible CAST from String to Decimal

take, this [arrow-pr](https://github.com/apache/arrow-rs/pull/6905#pullrequestreview-2523334113) should fix one.

[SPARK-47094][SQL] SPJ : fix bucket reducer function

@szehon-ho please take a look.

[SPARK-47094][SQL] SPJ : fix bucket reducer function

> > With this fix, incompatible number of buckets do not return 1 as GCD, hence the buckets do not reduce to 1 when it used in incompatible number of...