llama.go icon indicating copy to clipboard operation
llama.go copied to clipboard

feat: interactive mode for a chatgpt like experience

Open mfreeman451 opened this issue 2 years ago • 1 comments
trafficstars

Just wanted to create an issue to track this, I am going to implement it in a different branch and will submit a PR when it's usable.

mfreeman451 avatar Apr 13 '23 17:04 mfreeman451

Great! I've fixed a bit of your latest addition with Ring container, will wait for interactive mode :)

I'm going to investigate some other things like AVX intrinsics and mmap() for faster model loading.

gotzmann avatar Apr 15 '23 15:04 gotzmann