evaluate icon indicating copy to clipboard operation
evaluate copied to clipboard

`import` is very slow

Open AmitMY opened this issue 6 months ago • 0 comments

In tests, or when wanting to just debug something quickly, the process hangs on import evaluate. I benchmarked it on two devices:

python -c "import time; start = time.time(); import datasets; print(f'datasets: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import transformers; print(f'transformers: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import evaluate; print(f'evaluate: {time.time() - start:.3f}s')"

Linux server: datasets: 0.724s transformers: 1.527s evaluate: 3.438s

macOS: datasets: 1.076s transformers: 1.072s evaluate: 8.987s

9 seconds on my mac (m1 pro) is very slow just for the import. can you please look at why this is the case?

AmitMY avatar May 22 '25 17:05 AmitMY