opencompass icon indicating copy to clipboard operation
opencompass copied to clipboard

[Feature] ensure greedy decoding with huggingface model

Open Leymore opened this issue 1 year ago • 0 comments

Describe the feature

something like

from transformers.generation import GenerationConfig
self.model.generation_config = GenerationConfig.from_pretrained(path, trust_remote_code=True)
self.model.generation_config.do_sample = False

Will you implement it?

  • [X] I would like to implement this feature and create a PR!

Leymore avatar Oct 13 '23 11:10 Leymore