Grdykopląs Namorzyn comments

Results 9 comments of


                                            Grdykopląs Namorzyn

Token generation is extremely slow when using 13B models on an M1 Pro with llama.cpp, but it runs at a fine speed with Dalai (which uses an older version of llama.cpp)

I'm getting similar experience with following line: main -i --threads 12 --interactive-first -r "### Human:" --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m ggml-model-q4_1.bin It's Ryzen 9...

Token generation is extremely slow when using 13B models on an M1 Pro with llama.cpp, but it runs at a fine speed with Dalai (which uses an older version of llama.cpp)

> @ssuukk Does adding `--mlock` help in your situation, or no? With --mlock it is as slow as without, but maybe even slower - now it takes 2 seconds to...

Alfa Romeo support

It's working for Stelvio, although some errors are thrown: ```024-01-18 19:41:38.348 ERROR (MainThread) [homeassistant.components.mqtt.models] Exception raised when updating state of sensor.car_car_vehicleinfo_fuel_distancetoempty_value, topic: 'homeassistant/sensor/ZARPAHDN5N7D39795_car_vehicleInfo_fuel_distanceToEmpty_value/state' with payload: b'null' Traceback (most recent call...

Text Cursor Forcefully Moves to End with Curly Braces in Nodes on comfyUI Portable Version

Me too!

Could not find 'librealm-jni.so'. Looked for: [x86], but only found: [].

Nexus 5X here, too

Weights link broken from project page

Indeed!

Register of unknown size

I have more than 200 w bus devices in the air, this was just a random log message I noticed, so this might be indeed the case you describe Ed....

Support Synology Routers

+1 for rt2600ac

[FIX] Docker-compose up

Same on Synology NAS. Just fails with `server-1 exited with code 132`, running it manually produces nothing: ``` root@storage2:~/khoj# docker-compose run server /bin/bash WARN[0000] /root/khoj/docker-compose.yaml: `version` is obsolete [+] Creating...