evaluate
evaluate copied to clipboard
`import` is very slow
In tests, or when wanting to just debug something quickly, the process hangs on import evaluate.
I benchmarked it on two devices:
python -c "import time; start = time.time(); import datasets; print(f'datasets: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import transformers; print(f'transformers: {time.time() - start:.3f}s')"
python -c "import time; start = time.time(); import evaluate; print(f'evaluate: {time.time() - start:.3f}s')"
Linux server: datasets: 0.724s transformers: 1.527s evaluate: 3.438s
macOS: datasets: 1.076s transformers: 1.072s evaluate: 8.987s
9 seconds on my mac (m1 pro) is very slow just for the import. can you please look at why this is the case?