alpaca.cpp

alpaca.cpp copied to clipboard

Dockerfile for build and run

3

This is a Dockerfile that builds and runs. Let me know if it works for you and/or you want a PR. ``` FROM ubuntu:18.04 # Add GCC and G++ New...

raldebsi

Continues generating tokens after showing the prompt for user input (13B)

2

Using default settings, except for `-m ggml-alpaca-13b-q4.bin`, and the following prompt: ``` Simulate an endless interactive fiction role playing game by taking input from the player and simulating the game...

tjohnman

Stops after sampling parameters: temp = 0.100000, top_k = 40, top_p = 0.950000, repeat_last_n = 64, repeat_penalty = 1.300000

5

I tried compiling and running the pre made one. I have i7 windows 11 pro with 16 gb ram. It stops and goes back to command prompt after this: main:...

betolley

Extremely slow response time from Prompts

19

Has anyone else had issues with the response taking forever on alpaca? Have the 13B version installed and operational; however, when prompted for an output the response is extremely slow....

Bigcow11

Toxic behavior from 13B model

4

Am I the only one who is experiencing this or what? The 13B model is toxic! :smile: ### Example 1  ### Example 2 

abhinand5

MacOSX illegal instructions

5

Does anyone have an idea why the mac version does not start on my end? I have an M1 MacBook Pro 16 GB. I assume it has something to do...

slajar

[13B] Answering question but also adds random other stuff (seems like from the source)

5


socksprox

Strange characters in alpaca output

2

I have installed alpaca.cpp according to a [tutorial on medium.com](https://medium.com/geekculture/writing-a-medium-article-using-ai-stanford-alpaca-running-on-your-local-pc-e025416a032a) (Windows Linux Subsystem on a Win 11 PC). Everything worked fine but when I enter a prompt I get only...

simondueckert

Would it be possible to make Alpaca aware of complete programming languages and provide complete documentation for very specific projects.

1

This is very broad and general issue. But I'd like to see Alpaca start writing, editing and explaining code in Python and C language. Do you think it would be...

BoQsc

Memory managment / memory leak?

2

Hello guys. First of all - Amazing work, both of you @antimatter15 and @ggerganov I was playing with alpaca.cpp on my home computer (AMD 3400g, 16 Gb of RAM, Ubuntu...

kha84