alpaca.cpp
alpaca.cpp copied to clipboard
antimatter15
Locally run an Instruction-Tuned Chat-Style LLM
Installation with default CMakeLists.txt parameters for me, working on the old i3770k caused a stop error and the chat did not open. managed to solve the problem a few days...
when `__USE_POSIX199309` is defined (as per time.h), then `CLOCK_MONOTONIC` is declared. solves the error: `CLOCK_MONOTONIC` undeclared, while doing `make chat`
Thank you antimatter15 for all your good work and time! You are the best! I had Alpaca fix its own parameters that it thought were best. Adjust your CPU cores...
模型下载地址： ```zsh curl -o ggml-alpaca-7b-q4.bin -C - https://gateway.estuary.tech/gw/ipfs/QmQ1bf2BTnYxq73MFJWu1B7bQ2UD6qG7D7YDCxhTndVkPC curl -o ggml-alpaca-7b-q4.bin -C - https://ipfs.io/ipfs/QmQ1bf2BTnYxq73MFJWu1B7bQ2UD6qG7D7YDCxhTndVkPC curl -o ggml-alpaca-7b-q4.bin -C - https://cloudflare-ipfs.com/ipfs/QmQ1bf2BTnYxq73MFJWu1B7bQ2UD6qG7D7YDCxhTndVkPC ```
In terms of curiosity run cppcheck on alpaca.cpp and got that message: Checking chat.cpp ... chat.cpp:564:9: error: Common realloc mistake: 'buf' nulled but not freed upon failure [memleakOnRealloc] buf =...
- This fixes a major application breaking untraceable error (Large prompts crashing with no error output #122) - Tested and working
Fixes issue with using CTRL+C to interrupt prediction. The second CTRL+C would always close the application. This fix adds a check for the ESC key and sets the is_interactive variable...
``` [pi@raspberrypi:...ub/alpaca.cpp]$ make chat I llama.cpp build info: I UNAME_S: Linux I UNAME_P: unknown I UNAME_M: armv7l I CFLAGS: -I. -O3 -DNDEBUG -std=c11 -fPIC -pthread -mfpu=neon-fp-armv8 -mfp16-format=ieee -mno-unaligned-access -funsafe-math-optimizations I...
Metadata
Owner
Metadata
Locally run an Instruction-Tuned Chat-Style LLM