petals icon indicating copy to clipboard operation
petals copied to clipboard

Published 20 hours ago • verified publisher icon bigscience-workshop

DynamicCache and Beam Search

Open artek0chumak opened this issue 2 months ago • 0 comments

Make sure that RemotePastKeyValues will reorder beams when the method reorder_cache is called. Related: #570

  • [ ] Write down a code for reordering
  • [ ] Add Beam-Search scores comparison in the test

artek0chumak avatar Apr 09 '24 13:04 artek0chumak