fiddler-auditor

fiddler-auditor copied to clipboard

Brings fiddler-auditor up to date with OpenAI, Langchain and Poetry

2

Fixes issue #54 This release includes changes to the package dependencies and code to: 1. OpenAI compatiblitiy 2. Langchain compatiibility 3. Poetry compatibility README.md update to include Poetry build instructions...

lestan

Fiddler-Auditor 0.0.5 is very outdated

1

Fiddler Auditor version 0.0.5 is very outdated. Here are some of the incompatibilities: 1. OpenAI APIs have changed and this release uses a very old (0.0.27) version vs. the current...

lestan

Bumps [jinja2](https://github.com/pallets/jinja) from 3.1.2 to 3.1.3. Release notes Sourced from jinja2's releases. 3.1.3 This is a fix release for the 3.1.x feature branch. Fix for GHSA-h5c8-rqwp-cp95. You are affected if...

dependabot[bot]

I encountered an issue while working with the LLM_Evaluation_Azure notebook. The error message I received is as follows: `InvalidRequestError: The API deployment for this resource does not exist. If you...

soratavipa

Aruuthakur

Reported by @DannyBrock 

iterix

Add support for Ollama, Palm, Claude-2, Cohere, Replicate, Llama2 CodeLlama (100+LLMs) [LiteLLM]

1

This PR adds support for the above mentioned LLMs using LiteLLM https://github.com/BerriAI/litellm/ LiteLLM is a lightweight package to simplify LLM API calls - use any llm as a drop in...

ishaan-jaff

iterix

Instead of housing all the expected behaviors in a single file improve the organization by creating a separate sub-module

iterix

Add JSON Format Reports

1

LLMEvalResult class can only format results in HTML. I suppose we need to add a JSON format option too to its easy processability for developers.

mstfatay