langchain icon indicating copy to clipboard operation
langchain copied to clipboard

For AzureOpenAI() wrapper deafault model_name is text-davinci-003

Open rajib76 opened this issue 1 year ago • 0 comments

System Info

If we do not pass the model_name in the AzureOpenAI() wrapper, it picks up text-davinci-003 as the default model which in turn makes the cost calculation of tokens incorrect. Should model_name be made mandatory parameter for AzureOpenAI()

Who can help?

@hwchase17 @agola11

Information

  • [ ] The official example notebooks/scripts
  • [ ] My own modified scripts

Related Components

  • [X] LLMs/Chat Models
  • [ ] Embedding Models
  • [ ] Prompts / Prompt Templates / Prompt Selectors
  • [ ] Output Parsers
  • [ ] Document Loaders
  • [ ] Vector Stores / Retrievers
  • [ ] Memory
  • [ ] Agents / Agent Executors
  • [ ] Tools / Toolkits
  • [ ] Chains
  • [ ] Callbacks/Tracing
  • [ ] Async

Reproduction

Use the AzureOpenAI() wrapper without passing model_name and then do a get_openai_callback() to get the cost

Expected behavior

It should calculate the cost based on the model name

rajib76 avatar Jun 16 '23 01:06 rajib76