Tyler W
Tyler W
If you need to search for a substring that exists in the default echo strings: echo "!!-- Type your search query to find files" echo "!!-- To seach again type...
Currently, there does not way to run "evaluate-metric/glue" metric with an Evaluations suite. This PR proposes one implementation to achieve this. ## Example of Current Issue Assume the followin `EvaluationSuite`...
## Problem If a user would like to automate the retrieval of metrics, she needs to know the result key at least or possible keys. For example, suppose I have...
## Issue Currently I there does not seem to be a way to define the `config_name` for metric for a `SubTask` inside an `evaluate.EvaluationSuite`. ## Version evaluate version: 0.4.0 transformers...
### System information - **Have I written custom code (as opposed to using a stock example script provided in TensorFlow Model Analysis)**: No - **OS Platform and Distribution (e.g., Linux...