[BUG] Cannot create a new crew if you are using a secure environment (eg not allowing remote connections)
Description
Downloading crewai one would assume you can create a new crew without needing connections to the internet. Some environments require signing of certificates to ensure connections are valid and expected.
For example, when creating a new crew as specified in the startup instructions:
crewai create crew latest-ai-development
the output says...
Error fetching provider data
HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json
Looking at this file it seems to just be a list of prices.
I'm not sure why such a file needs to be downloaded or what it's purpose serves, but in a secure environment it feels like it's unnecessary.
Is there a flag one can pass to skip this process or to allow trusted hosts? Pip for example has the --trusted-host flag
Steps to Reproduce
- On a computer run
pip install 'crewai[tools]' - Disconnect from the internet or enable a security platform like Netskope
- Run
crewai create crew latest-ai-development
Expected behavior
The scaffold for the application is setup without an error.
Screenshots/Code snippets
Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))
Operating System
macOS Ventura
Python Version
3.12
crewAI Version
0.86.0
crewAI Tools Version
0.86.0
Virtual Environment
Venv
Evidence
Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))
Possible Solution
Add flag to skip internet connections or for trusted domains
Additional context
Secure computer, requires whitelisted domain interaction
This is not a bug, this file is the list of available model available from our LLM provider LiteLLM, but not prices
Agree that creating a crew with the cli should not require internet connectivity. Plenty of environments hosting their own LLMs that have limited or no outside connectivity.
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
This issue was closed because it has been stalled for 5 days with no activity.