Michał Moskal
Michał Moskal
I get an error (actually a warning since canvas is optional) on `yarn install --frozen-lockfile --prefer-offline`. Node.js v20.11.0 ``` warning Error running install script for optional dependency: "/Users/michal/src/ai/genaiscript/node_modules/canvas: Command failed....
The following: ```python from guidance import substring b = ("Hello " + substring("foobar baz " * 100)).serialize() print(len(b)) ``` Throw stack overflow exception: ``` Traceback (most recent call last): File...
This program should have the same `devs disasm` regardless if the import is present or not ```ts import { startBME680 } from "@devicescript/drivers" console.log(Buffer.alloc) ```
We always bundle them. We also bundle `vm` but I guess that one may be useful outside.
The paged attention (v1 and v2) decode kernel does not support sliding window natively - the way it works now it just takes all the blocks passed in (up to...
This is an early work in progress. This introduces a `controller: SequenceController` field in `SamplingParams`. This can be thought of as an extension of the already existing `logits_processors` (and in...
If we register for both IR button and distance alarm, only one of them will work (the last one likely) Similarly, once we have events for color detection and ambient...
needs to wait for /beta->/
This patch adds `SamplingController` object on `LLMEngine`. It subsumes `LogitsProcessor` functions in `SamplingParams` as suggested in #5423. Instead of calling the class `LogitPostProcessor` I used `SamplingController` since it's a bit...
`config.json` for the llama-3 already specifies bfloat16 dtype. Thus removing torch dependency from the top-level tests (many tests do not require torch to run). CC @riedgar-ms @hudson-ai