alpaca.cpp

alpaca.cpp copied to clipboard

Please, add the ability to control "randomness". Let the randomness value be shown in the answer so that it can be specified to reproduce exactly the same answer again (if...

openMolNike

Fix: Add error handling for memory buffer allocation in ggml_init to prevent segmentation fault

1

## Problem When loading a large language model like Alpaca 30B, the `ggml_init` function tries to allocate a significant amount of memory (25.5 GB). Even if the system has sufficient...

ahmetkca

win 10 not work

10

PS C:\Users\Администратор\Downloads\opera\alpaca.cpp> .\Release\chat.exe main: seed = 1680110322 llama_model_load: loading model from 'ggml-alpaca-7b-q4.bin' - please wait ... llama_model_load: ggml ctx size = 6065.34 MB PS C:\Users\Администратор\Downloads\opera\alpaca.cpp>

lagait

This pull request aims to introduce a new feature to the project: the implementation of a web interface that utilizes a REST API for communication with the backend, secured through...

innermost47

Hello I was wondering if it was possible that the answers could be given in tts data? exemple : me: test IA : Testing... testing.... This message will self-destruct in...

LinkoMania

ggml_new_tensor_impl: not enough space in the context's memory pool (needed 1178743392, available 1106773248)

6

Hello, I'm trying to run this on Windows 11, and after fixing the cmake errors with #106 by adding the definitions, when I try to load the 30B model I...

Dannythm

chat.exe starts a blank terminal then shuts itself off on win11

4

My OS is windows 11. I downloaded the bin file and put it in alpaca-win folder but chat.exe starts a blank terminal then shuts itself off. Then I tried building...

pxc3113

Run from command line / as batch process?

7

Just two quick questions: is it possible to start the bin model also from the command line and e.g. specify a file as input prompt? And would it also be...

rds0001

chat.exe will instantly exit with no text or error msg

14

chat.exe will produce blank line with no text and will exit. On windows 10 compiled with cmake Please help.

yigalnavon

[Enhancement] Alpaca 7B running on Android (Pixel 7 pro)

7

I was able to build Android executable(tested using my Google Pixel 7 Pro). For more details please refer : https://github.com/rupeshs/alpaca.cpp/tree/linux-android-build-support 

rupeshs