evaluate icon indicating copy to clipboard operation
evaluate copied to clipboard

HuggingFace evaluate-cli create command results Error: "datasets[0]" must be a string

Open shivanraptor opened this issue 9 months ago • 2 comments

I follow the official documentation of evaluate 0.4.0 to freshly create a custom metric in an empty folder with the following command:

evaluate-cli create "My Metric" --module_type "metric"

The command returns the following error:

Error: "datasets[0]" must be a string

The command creates these files but I am unsure whether the files are intact:

app.py  my_metric.py  README.md  requirements.txt  tests.py

How to resolve this error?

using evaluate version 0.4.0

shivanraptor avatar Nov 07 '23 02:11 shivanraptor