Having trouble building Evals locally? Try this.

[silverfoxf7]

Describe the bug

I used

git clone [email protected]:openai/evals.git

and couldn't get pip install -e . to run.

Error logs said I was missing a setup.py or setup.cfg file. That's odd. Poking around, I realized that my git clone hadn't copied pyproject.toml and mypy.ini into my local directory.

No problem, I manually downloaded those files and voila it compiled.

So then I ran oaieval gpt-3.5-turbo test-closedqa-uniqueness and got this error: ModuleNotFoundError: No module named 'evals.utils'

Upon closer inspection, it was the "git clone" issue again! For some reason, cloning the repo isn't bringing in all of the files and folders. Sure enough, I was missing the utils folders under /evals/

I downloaded the entire repo as a Zip file. That zip contained all of the files, at which point building and running the oaievals worked.

To Reproduce

1. git clone this main branch
2. run 'pip install -e .'
3. it will fail.

Code snippets

No response

OS

macOS

Python version

Python 3.9.7

Library version

openai-evals 1.0.3.post1

[mmtmn]

I posted a similar issue when this repository first came out here. Make sure to update your pip!