Maykeye
Maykeye
Even if PyQt is used, launcher as a whole can not be distributed under MIT as a whole(as it currently does). It must be either GPL or it must not...
> Unless I've missed, ion currently has no conditional compilation. Tying that with some built-in consts for OS and such would be great It does exactly that already: if you...
I'm having similar issue in 0.6.0, but the opposite way: field of left join becomes non-nullable: CREATE TABLE [T1]([V] INTEGER NOT NULL); let q = sqlx::query!(" SELECT A.V F1, B.V...
> There isnt really specific benefits of a archived instance My free space begs to differ. For example, "FTB Presents Stoneblock 2" for me now unpacked is 330 MB. Archived...
Regarding width, fortunately Signal is not final (`@final` is [commented out](https://github.com/amaranth-lang/amaranth/blob/db49294cf722e9463666bd06f81a86f930b8707c/amaranth/hdl/ast.py#L896) ). So for now at least it's possible to workaround by wrapping signals in python code directly like class...
It definitely feels slower on nerys OPT model comparing to Kobold running on the same hardware. On Kobold with input = "test" it generates 200 tokens in about 9 seconds....
Since this issue includes other custom modules, here's what I did for mosaic gpt ```diff diff --git a/modules/models.py b/modules/models.py index a6c45cc..c5847ac 100644 --- a/modules/models.py +++ b/modules/models.py @@ -56,7 +56,9 @@...
Well, these modifications are not necessary anymore, since #1772 got merged. Just `pip install einops` to get the necessary module. After that `mosaicml/mpt-7b-storywriter` works on HEAD. Originally mentioned Santacoder also...
Isn't that what `--share` / `--public-api` do?
Seems to work fine without any special tweaking, at least `$ python server.py --model databricks_dolly-v2-12b --load-in-8bit --api` works 