Implement litellm instead of different LLM inference classes

[rachittshah]

Suggestion:

Instead of having different packages for LLM inference, we can create a single litellm class which allows the user to use multiple LLMs and reduces dependency management.

Happy to build this!