DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Is beam search supported?

Open flexwang opened this issue 8 months ago • 2 comments

flexwang avatar Nov 12 '23 00:11 flexwang

Beam search is not currently supported.

mrwyattii avatar Nov 13 '23 16:11 mrwyattii

Is the support on the roadmap?

flexwang avatar Nov 21 '23 04:11 flexwang