Andrii Rosa comments

Results 55 comments of


                                            Andrii Rosa

[WIP] Fault tolerant scheduler 2.0

Still on top of several PRs (#14328, #14329, #14330, #14320) but is ready for review.

[WIP] Fault tolerant scheduler 2.0

Rebased

[WIP] Fault tolerant scheduler 2.0

Ready for review

[WIP] Fault tolerant scheduler 2.0

Thanks for the review. Went through the first section of comments. Going to continue tomorrow.

[WIP] Fault tolerant scheduler 2.0

@losipiuk Updated

[WIP] Fault tolerant scheduler 2.0

Updated

[WIP] Fault tolerant scheduler 2.0

Updated

[WIP] Fault tolerant scheduler 2.0

Updated

Allow scans with the number of partitions exceeding the limit

An attempt to remove the limitation on the number of partitions per scan. This change doesn't remove the setting defining the limit, instead when the number of partitions is higher...

Allow scans with the number of partitions exceeding the limit

The `hive.max-partitions-per-scan` setting was added in 2016 by @electrum to avoid memory pressure on coordinator. This change resolves the problem with memory pressure by avoiding enumerating partitions eagerly in one...