Fix incompatible with vllm 0.3.0 and fix size mismatch when fine-tuning model is loading

[BRM10213]

…issue #2994)

Why are these changes needed?

1. Add support for pydanticv2 and resolve incompatible with vllm 0.3.0 issue #2994.
2. Fix error when fine tuning is loading by Peft Adapter (size mismatch from checkpoint)

Related issue number (if applicable)

• Closes #2994
• Closes #3070
• Closes #2754

Checks

• [x] I've run format.sh to lint the changes in this PR.
• [x] I've included any doc changes needed.
• [x] I've made sure the relevant tests are passing (if applicable).

[aiapprentice101]

This is awesome! Thank you for the great work. It's very much needed as we keep up-to-date with vllm. Hope it can be merged soon.

[aliasaria]

This is good -- I hope we can merge soon