[Roadmap] Improve `models` subpackage

[ocss884]

Motivation

CAMEL is a framework to implement and organize different agents. We would like to provide more models and more convenient host choices (remote API call or local hosting) to users.

Phase 1

• [ ] Anthropic #283
• [ ] Design the architecture for remote backend and local hosting.
• [ ] vLLM
• [ ] GPT-4V
• [ ] llama.cpp / Ollama (#394)
• [ ] DeepSpeed-FastGen (https://github.com/microsoft/DeepSpeed/blob/master/blogs/deepspeed-fastgen/README.md)
• [ ] Gemini pro
• [ ] PowerInfer
• [ ] LLaVA-1.5
• [ ] Mistral-7b
• [ ] replicate api support

Phase 2

• [ ] Improve model config data storage solution
• [ ] Implement response caching mechanism
• [ ] Implement monitoring tools for system performance and cost.