CrewAI-Studio icon indicating copy to clipboard operation
CrewAI-Studio copied to clipboard

Unable to use Azure OpenAI resource as LLM while creating Agents

Open shubham039 opened this issue 8 months ago • 1 comments

Hi,

I want to use Azure Openai model as LLM in CrewAI studio. But I am unable to.

I tried putting the following params in the .env file:

AZURE_API_KEY= AZURE_API_BASE = AZURE_API_VERSION = OPENAI_PROXY_MODELS = "azure/gpt-4o-mini"

I commented the "OPENAI_API_KEY" and "OPENAI_API_BASE" param

While creating the Agents. I selected "OpenAI: azure/gpt-4o-mini" But when I am running the crew I am getting the belowmentioned error:

ValueError: OpenAI API key not set in .env file

I then uncommented the OPENAI_API_KEY and OPENAI_API_BASE param, and put azure openai endpoint and azureopenaikey as values: OPENAI_API_KEY= OPENAI_API_BASE=

Now when I'm running the crew I am getting this error:

Error running crew: litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'

Traceback: { 'result': "Error running crew: litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}", 'stack_trace': 'Traceback (most recent call last):\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\llms\openai\openai.py", line 711, in completion\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\llms\openai\openai.py", line 638, in completion\n self.make_sync_openai_chat_completion_request(\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\litellm_core_utils\logging_utils.py", line 145, in sync_wrapper\n result = func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\llms\openai\openai.py", line 457, in make_sync_openai_chat_completion_request\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\llms\openai\openai.py", line 439, in make_sync_openai_chat_completion_request\n raw_response = openai_client.chat.completions.with_raw_response.create(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\_legacy_response.py", line 364, in wrapped\n return cast(LegacyAPIResponse[R], func(*args, **kwargs))\n ^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\_utils\_utils.py", line 279, in wrapper\n return func(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\resources\chat\completions\completions.py", line 914, in create\n return self._post(\n ^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\_base_client.py", line 1242, in post\n return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\_base_client.py", line 919, in request\n return self._request(\n ^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\openai\_base_client.py", line 1023, in _request\n raise self._make_status_error_from_response(err.response) from None\nopenai.NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resourcenotfound'}}\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\main.py", line 1693, in completion\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\main.py", line 1666, in completion\n response = openai_chat_completions.completion(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\llms\openai\openai.py", line 721, in completion\n raise OpenAIError(\nlitellm.llms.openai.common_utils.OpenAIError: Error code: 404 - {'error': {'code': '404', 'message': 'Resourcenotfound'}}\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\app\pg_crew_run.py", line 62, in run_crew\n result = crewai_crew.kickoff(inputs=inputs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\crew.py", line 640, in kickoff\n result = self._run_sequential_process()\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\crew.py", line 752, in _run_sequential_process\n return self._execute_tasks(self.tasks)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\crew.py", line 850, in _execute_tasks\n task_output = task.execute_sync(\n ^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\task.py", line 310, in execute_sync\n return self._execute_core(agent, context, tools)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\task.py", line 454, in _execute_core\n raise e # Re-raise the exception after emitting the event\n ^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\task.py", line 374, in _execute_core\n result = agent.execute_task(\n ^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agent.py", line 266, in execute_task\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agent.py", line 247, in execute_task\n result = self.agent_executor.invoke(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 119, in invoke\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 108, in invoke\n formatted_answer = self._invoke_loop()\n ^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 166, in _invoke_loop\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 146, in _invoke_loop\n answer = self._get_llm_response()\n ^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 216, in _get_llm_response\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\agents\crew_agent_executor.py", line 207, in _get_llm_response\n answer = self.llm.call(\n ^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\llm.py", line 739, in call\n return self._handle_non_streaming_response(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\crewai\llm.py", line 575, in _handle_non_streaming_response\n response = litellm.completion(**params)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\utils.py", line 1154, in wrapper\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\utils.py", line 1032, in wrapper\n result = original_function(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\main.py", line 3069, in completion\n raise exception_type(\n ^^^^^^^^^^^^^^^\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\litellm_core_utils\exception_mapping_utils.py", line 2201, in exception_type\n raise e\n File "C:\Users\TechHub2\Documents\CrewAI\CrewAI-Studio\venv\Lib\site-packages\litellm\litellm_core_utils\exception_mapping_utils.py", line 399, in exception_type\n raise NotFoundError(\nlitellm.exceptions.NotFoundError: litellm.NotFoundError: NotFoundError: OpenAIException - Error code: 404 - {'error': {'code': '404', 'message': 'Resourcenotfound'}}\n' }

shubham039 avatar Apr 04 '25 14:04 shubham039