LLM-VM icon indicating copy to clipboard operation
LLM-VM copied to clipboard
verified publisher icon anarchy-ai

Custom batch decoding algorithm

Open VictorOdede opened this issue 2 years ago • 3 comments

Implement parallel decoding for any model: https://arxiv.org/abs/2305.10427

VictorOdede avatar Oct 26 '23 11:10 VictorOdede

assign it to me please

rishirishhh avatar Nov 22 '23 19:11 rishirishhh

@rishirishhh you are welcome to work on it! Getting assigned tickets officially requires contributor status - which you can achieve by winning bounties!

mmirman avatar Nov 23 '23 15:11 mmirman

Hey @VictorOdede, would like to take a shot at this issue

bilal-aamer avatar Nov 27 '23 11:11 bilal-aamer