klangst-ETR comments

Repositories
Issues
Comments

Results 3 comments of


                                            klangst-ETR

[ENHANCEMENT] Add ability to add LLM input and output token cost and add cost column

I don't know of a good registry. My initial thought was to allow the user to be able to configure with model name and input and output token costs (and...

Feature suggestion - Handling LLM quotas when evaluating

Do you have a suggestion that I could implement now? I am exceeding my azure gpt4 rate limit of 80k tokens per minute when evaluating 48 questions/answers for all metrics....

Open AI error with version 0.1.0

If you have langchain 0.1 installed, try this: # Load your environment variables azure_api_key = os.environ.get('AZURE_OPENAI_API_KEY') api_type = os.environ.get('OPENAI_API_TYPE') azure_openai_api_version = os.environ.get('OPENAI_API_VERSION') azure_api_endpoint = os.environ.get('AZURE_OPENAI_ENDPOINT') azure_gpt3_model = os.environ.get('GPT3_MODEL_NAME') azure_gpt4_model =...