GLM icon indicating copy to clipboard operation
GLM copied to clipboard

使用glm-large-chinese微调分类任务

Open mechigonft opened this issue 2 years ago • 0 comments

报错:Traceback (most recent call last): File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 470, in main(args) File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 119, in main finetune(args, train_valid_datasets_provider, model_kwargs, File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 297, in finetune train_dataset, valid_dataset = train_valid_datasets_provider(args, tokenizer) File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 56, in train_valid_datasets_provider train_dataset = SuperGlueDataset(args, task_name, data_dir, args.seq_length, "train", tokenizer, File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/dataset.py", line 134, in init self.processor = PROCESSORStask_name KeyError: 'multichoice'

dataset.py的字典PROCESSORS并没有multichoice这个key,请问如何解决 PROCESSORS = { "mnli": MnliProcessor, "mnli-mm": MnliMismatchedProcessor, "agnews": AgnewsProcessor, "yahoo": YahooAnswersProcessor, "yelp-polarity": YelpPolarityProcessor, "yelp-full": YelpFullProcessor, "xstance-de": lambda: XStanceProcessor("de"), "xstance-fr": lambda: XStanceProcessor("fr"), "xstance": XStanceProcessor, "wic": WicProcessor, "rte": RteProcessor, "cb": CbProcessor, "wsc": WscProcessor, "wsc1": WscProcessor, "boolq": BoolQProcessor, "copa": CopaProcessor, "multirc": MultiRcProcessor, "record": RecordProcessor, "ax-g": AxGProcessor, "ax-b": AxBProcessor, "sst2": Sst2Processor, "cola": ColaProcessor, "mrpc": MrpcProcessor, "qqp": QqpProcessor, "qnli": QnliProcessor, # "squad": SquadProcessor, "race": RaceProcessor, "squad": SquadProcessor, "afqmc": AFQMCProcessor, "tnews": TNewsProcessor, 'cluewsc': CLUEWSCProcessor, # 'cmrc': CMRCProcessor } # type: Dict[str,Callable[[1],DataProcessor]]

mechigonft avatar Nov 09 '23 08:11 mechigonft