Andrew Lim
Andrew Lim
@lucasavila00 It would be great if you could implemented your model grammar work via BNF into Candle
Mac OS 18 rev = "86f37fa803c40e9ee14c43e0028ad32f841ceb07" The error only occurs with 1) "microsoft/Phi-3-mini-128k-instruct", 2) with a constrained grammar. There is no error when using "meta-llama/Llama-3.1-8B-Instruct" with constrained grammar. I believe...
Hi everyone, The memory leak happens because when numbering engine ids it starts at 0, instead of current engine ID + 1. The engine cannot terminate correctly because of this...
To fix the zoom error add the 'align' option. ``` // Configuration for the Timeline const options: TimelineOptions = { align:'center', }; ```