Increase test coverage for Lora and qlora

[ved1beta]

⚠️ Please check that this feature request hasn't been suggested before.

• [x] I searched previous Ideas in Discussions didn't find any similar feature requests.
• [x] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

add unit tests for the following :

• [x] Parameter Freezing Validation
• [x] Basic Configuration Validation
• [ ] QLoRA 4-bit + LoRA Integration (already exist)
• [ ] Target Module Selection Validation (SKIPPING)
• [x] test for Adapter Merging/Unmerging

✔️ Solution

NA

❓ Alternatives

na

📝 Additional Context

na

Acknowledgements

• [x] My issue title is concise, descriptive, and in title casing.
• [x] I have searched the existing issues to make sure this feature has not been requested yet.
• [x] I have provided enough information for the maintainers to understand and evaluate this request.