[HUDI-8034] Support custom key generator with HoodieCatalogTable

[lokeshj1703]

Change Logs

Currently KeyGenUtils#inferKeyGeneratorTypeForAutoKeyGen does not support custom key generators but supports the other key generator types. This PR aims to add support for it. Also HoodieCatalogTable should be modified to add support for storing partition fields with key generator partition type. This was left out in HUDI-7996 because of no support for custom keygen with HoodieCatalogTable

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

• [ ] Read through contributor's guide
• [ ] Change Logs and Impact were stated clearly
• [ ] Adequate tests were added if applicable
• [ ] CI passed

[hudi-bot]

CI report:

• 7db628f48fede3c0b6e550d78c7be24d714b3bed Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build