[HUDI-4551] The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS is the parallelism of the execution environment

[SteNicholas]

trafficstars

What is the purpose of the pull request

The default value of READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS is 4, which could be the parallelism of the execution environment.

Brief change log

• Updates READ_TASKS, WRITE_TASKS, CLUSTERING_TASKS with no default value, which default is the parallelism of the execution environment.
• Updates COMPACTION_TASKS with no default value, which default is WRITE_TASKS*COMPACTION_DELTA_COMMITS/5.

Verify this pull request

Committer checklist

• [ ] Has a corresponding JIRA in PR title & commit

• [ ] Commit message is descriptive of the change

• [ ] CI is green

• [ ] Necessary doc changes done or have another open PR

• [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

[danny0405]

Thanks for the contribution, i have reviewed and applied a patch here: 4551.patch.zip

[hudi-bot]

CI report:

• 9cb9cdcfb2292ea75e5153b526d440c9a7c8af0f Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[SteNicholas]

@danny0405, I have addressed above comments and updated the parallelism of all ITTests. PTAL.