crewAI icon indicating copy to clipboard operation
crewAI copied to clipboard

[BUG] Cannot create a new crew if you are using a secure environment (eg not allowing remote connections)

Open digiguru opened this issue 1 month ago • 2 comments

Description

Downloading crewai one would assume you can create a new crew without needing connections to the internet. Some environments require signing of certificates to ensure connections are valid and expected.

For example, when creating a new crew as specified in the startup instructions:

crewai create crew latest-ai-development

the output says...

Error fetching provider data
HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json

Looking at this file it seems to just be a list of prices.

I'm not sure why such a file needs to be downloaded or what it's purpose serves, but in a secure environment it feels like it's unnecessary.

Is there a flag one can pass to skip this process or to allow trusted hosts? Pip for example has the --trusted-host flag

Steps to Reproduce

  1. On a computer run pip install 'crewai[tools]'
  2. Disconnect from the internet or enable a security platform like Netskope
  3. Run crewai create crew latest-ai-development

Expected behavior

The scaffold for the application is setup without an error.

Screenshots/Code snippets

Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))

Operating System

macOS Ventura

Python Version

3.12

crewAI Version

0.86.0

crewAI Tools Version

0.86.0

Virtual Environment

Venv

Evidence

Error fetching provider data: HTTPSConnectionPool(host='raw.githubusercontent.com', port=443): Max retries exceeded with url: /BerriAI/litellm/main/model_prices_and_context_window.json (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x127ac7bc0>: Failed to resolve 'raw.githubusercontent.com' ([Errno 8] nodename nor servname provided, or not known)"))

Possible Solution

Add flag to skip internet connections or for trusted domains

Additional context

Secure computer, requires whitelisted domain interaction

digiguru avatar Jan 02 '25 12:01 digiguru