aici
aici copied to clipboard
AICI: Prompts as (Wasm) Programs
https://component-model.bytecodealliance.org/
Impl in pyctrl: https://github.com/microsoft/aici/commit/171dfcf4b91e6c97f5e048df588d76fbd3b2a88c also add token_repr
dockerized application reproducibly built by output of the generative script of repl agent name with passed parameters and ENV variables ability to use one demand spawn off instances of such...
...for posterity. # Additional pointers/background material: ## TLA+ type annotations * https://apalache.informal.systems/docs/adr/002adr-types.html#11-type-grammar-type-system-1-or-ts1 * https://apalache.informal.systems/docs/lang/variants.html * https://github.com/informalsystems/apalache/blob/main/tlair/src/main/scala/at/forsyte/apalache/tla/types/parser/tokens.scala * https://github.com/microsoft/tlaplus-examples/tree/gptools/genaisrc ## 3DGen/Everparse * https://github.com/project-everest/everparse/blob/master/src/3d/ocaml/parser.mly * https://github.com/project-everest/everparse/issues/57
Creating an issue on aici to link to draft vLLM PR and discussion https://github.com/vllm-project/vllm/pull/2888 Cc: @mmoskal
latex markdown typst rust ipynb python js,ts,html,css,json,xml,toml,etc formats
Possibly via `POST /v1/run?controller=xyz` ?
- [ ] shared memory/futex implementation - [ ] figure out what to do with fork() in aicirt Docs: - https://shift.click/blog/futex-like-apis/ - https://devblogs.microsoft.com/oldnewthing/20170601-00/?p=96265 WIP for shm only: [win.patch](https://github.com/microsoft/aici/files/14203218/win.patch)