empirical
empirical copied to clipboard
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
## Steps to reproduce - create .env in the root of the project - try running `npx ../../packages/cli run --env-file '/Users//Desktop/Github/empirical/.env` from examples ## Error ``` ❯ npx ../../packages/cli run...
- [ ] working setup with JS script scorer that imports faithfulness - [ ] Docs changes - [ ] Schema changes - [ ] Changeset
Hi guys! There is new model recently arrived. Could you please add support of it to your site? I'd be very grateful. https://mistral.ai/news/codestral/
- Empirical currently supports Gemini models via Google API keys, which are accessed through Google AI Studio and Google Workspaces - The user's company uses Vertex AI within Google Cloud,...
- Empirical currently supports Gemini models via Google API keys, which are accessed through Google AI Studio and Google Workspaces - The user's company uses Vertex AI within Google Cloud,...
### Discussed in https://github.com/empirical-run/empirical/discussions/235 Originally posted by **TalkTomeG00se** May 29, 2024 Hello! First I want to say thank you for this awesome tool, really enjoy it's flexibility and ease of...