skodavalla

Results 2 comments of skodavalla

[BUG]CrewAI Agent Fails to Pass endpoint to LiteLLM for Ollama Provider

Same error on using base_url='http://192.168.10.8:11434/api' 2025-03-26 19:18:58,428 - LiteLLM - INFO - LiteLLM completion() model= llama3.2:latest; provider = ollama 2025-03-26 19:18:58,493 - root - ERROR - LiteLLM call failed: litellm.APIConnectionError:...

ERR Server error error="failed to load model with internal loader: grpc service not ready" ip=172.17.0.1 latency=40.041976229s method=POST status=500 url=/v1/audio/transcriptions

Please let me know if any additional info is needed. Also the container size is more than 40GB can it be reduced?