llama.rn icon indicating copy to clipboard operation
llama.rn copied to clipboard

Published 20 hours ago • verified publisher icon mybigday

Parallel decoding

Open jhen0409 opened this issue 8 months ago • 0 comments

llama.cpp now supports parallel decoding in one context so we can support.

Breaking change: Deprecate stopCompletion method and move to return values of completion.

jhen0409 avatar Oct 23 '23 01:10 jhen0409