Michał Moskal
Michał Moskal
turn LLM output to string, encode and compare token ids
We currently fail here, for simple rx like '\d*' ```rust impl FunctionalRecognizer for RecRx { fn initial(&self) -> RecRxState { self.dfa .universal_start_state(regex_automata::Anchored::Yes) .expect("dfa has no universal start state; make sure...
For example, the llama tokenizer has "" as 35 and "▁" (space) as 29871, as well as "" as 36 and "!" as 29991, etc. We need to: * pick...
pyctrl has `log_level`. in js we also need the setter (as you cannot set variables in other modules from the outside)
Currently, this fails `test_fork` and `test_noop`, possibly more. See #99
Currently scoped to execute Guidance grammars serialized as protobuf.
In some cases the controllers are trusted and performance is particularly important. In these cases we should be able to deploy a natively compiled controller. We would need a library...
The following gives stop_reason: "failed" but no indication why. ```python import pyaici.server as aici async def main(): await aici.FixedTokens("Some long text that will serve as a prompt for the model...
This implements sliding window in v2 block manager. First commit comes from #3967 by @ruthe98, but the actual change was somewhat more complex including the concept of a null block....
This add options to join multiple UF2 files into one, renumbering the blocks. Just found this; must have done it a year ago or more. Untested.