crewAI
crewAI copied to clipboard
[FEATURE] Add support to introduce custom OpenAPI standard LLM + Embeddings models
Feature Area
Integration with external tools
Is your feature request related to a an existing bug? Please link it here.
No
Describe the solution you'd like
I would like to be able to use the tools provided by crewAI using my custom deployed models on my infrastructure. I think that as long as the tools can use the OpenAPI standard with OpenAI library, then there is easy integration. The only thing that needs to be added is the capability of not relying on providers and just have the same functionality with the custom models deployment like an instance of any model in vllm for example
Describe alternatives you've considered
No response
Additional context
No response
Willingness to Contribute
I could provide more detailed specifications
Exactly my task💯 CrewAI team, please make it 🙏🏻