Eliya Habba
Eliya Habba
Bug in the MMLU dataset production process: ``` from unitxt.templates import MultipleChoiceTemplate # self.template = MultipleChoiceTemplate(type='multiple_choice_template', artifact_identifier='template_0', _requirements_list=[], caching=None, apply_to_streams=None, dont_apply_to_streams=None, skip_rendered_instance=True, postprocessors=['processors.first_character'], instruction='', target_prefix='', title_fields=[], input_format='Question: [question] Choices: [choices]...
I recently encountered an issue where a change in the code, specifically modifying the check from `if key == "type"` to `if key == "__type__"`, caused my locally saved data...